-- Logs begin at Sun 2022-08-07 10:14:16 UTC, end at Sun 2022-08-07 11:14:18 UTC. -- Aug 07 10:40:37.445282 dv-cinder-850320-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 07 10:40:37.453360 dv-cinder-850320-3-smb devstack@keystone.service[80135]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 07 10:40:37.455898 dv-cinder-850320-3-smb devstack@keystone.service[80135]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 7 10:40:37 2022] *** Aug 07 10:40:37.455898 dv-cinder-850320-3-smb devstack@keystone.service[80135]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 07 10:40:37.455898 dv-cinder-850320-3-smb devstack@keystone.service[80135]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 07 10:40:37.455898 dv-cinder-850320-3-smb devstack@keystone.service[80135]: nodename: dv-cinder-850320-3-smb Aug 07 10:40:37.455898 dv-cinder-850320-3-smb devstack@keystone.service[80135]: machine: x86_64 Aug 07 10:40:37.455898 dv-cinder-850320-3-smb devstack@keystone.service[80135]: clock source: unix Aug 07 10:40:37.455898 dv-cinder-850320-3-smb devstack@keystone.service[80135]: pcre jit disabled Aug 07 10:40:37.455898 dv-cinder-850320-3-smb devstack@keystone.service[80135]: detected number of CPU cores: 4 Aug 07 10:40:37.455898 dv-cinder-850320-3-smb devstack@keystone.service[80135]: current working directory: / Aug 07 10:40:37.455898 dv-cinder-850320-3-smb devstack@keystone.service[80135]: detected binary path: /usr/bin/uwsgi-core Aug 07 10:40:37.456471 dv-cinder-850320-3-smb devstack@keystone.service[80135]: your processes number limit is 47680 Aug 07 10:40:37.456471 dv-cinder-850320-3-smb devstack@keystone.service[80135]: your memory page size is 4096 bytes Aug 07 10:40:37.456471 dv-cinder-850320-3-smb devstack@keystone.service[80135]: detected max file descriptor number: 2048 Aug 07 10:40:37.456471 dv-cinder-850320-3-smb devstack@keystone.service[80135]: lock engine: pthread robust mutexes Aug 07 10:40:37.456471 dv-cinder-850320-3-smb devstack@keystone.service[80135]: thunder lock: enabled Aug 07 10:40:37.456471 dv-cinder-850320-3-smb devstack@keystone.service[80135]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 07 10:40:37.456471 dv-cinder-850320-3-smb devstack@keystone.service[80135]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 07 10:40:37.495850 dv-cinder-850320-3-smb devstack@keystone.service[80135]: Python main interpreter initialized at 0x56537a22f9c0 Aug 07 10:40:37.495850 dv-cinder-850320-3-smb devstack@keystone.service[80135]: python threads support enabled Aug 07 10:40:37.495850 dv-cinder-850320-3-smb devstack@keystone.service[80135]: your server socket listen backlog is limited to 100 connections Aug 07 10:40:37.495850 dv-cinder-850320-3-smb devstack@keystone.service[80135]: your mercy for graceful operations on workers is 90 seconds Aug 07 10:40:37.496182 dv-cinder-850320-3-smb devstack@keystone.service[80135]: mapped 403077 bytes (393 KB) for 2 cores Aug 07 10:40:37.496255 dv-cinder-850320-3-smb devstack@keystone.service[80135]: *** Operational MODE: preforking *** Aug 07 10:40:37.496525 dv-cinder-850320-3-smb devstack@keystone.service[80135]: *** uWSGI is running in multiple interpreter mode *** Aug 07 10:40:37.496525 dv-cinder-850320-3-smb devstack@keystone.service[80135]: spawned uWSGI master process (pid: 80135) Aug 07 10:40:37.496711 dv-cinder-850320-3-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 07 10:40:37.498073 dv-cinder-850320-3-smb devstack@keystone.service[80135]: spawned uWSGI worker 1 (pid: 80144, cores: 1) Aug 07 10:40:37.498073 dv-cinder-850320-3-smb devstack@keystone.service[80135]: spawned uWSGI worker 2 (pid: 80145, cores: 1) Aug 07 10:40:37.498073 dv-cinder-850320-3-smb devstack@keystone.service[80135]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 07 10:40:42.964455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 10:40:42.964455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: from cryptography.utils import int_from_bytes Aug 07 10:40:42.965209 dv-cinder-850320-3-smb devstack@keystone.service[80145]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 10:40:42.965209 dv-cinder-850320-3-smb devstack@keystone.service[80145]: from cryptography.utils import int_from_bytes Aug 07 10:40:42.965500 dv-cinder-850320-3-smb devstack@keystone.service[80144]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 10:40:42.965500 dv-cinder-850320-3-smb devstack@keystone.service[80144]: from cryptography.utils import int_from_bytes Aug 07 10:40:42.965943 dv-cinder-850320-3-smb devstack@keystone.service[80144]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 10:40:42.965943 dv-cinder-850320-3-smb devstack@keystone.service[80144]: from cryptography.utils import int_from_bytes Aug 07 10:40:43.014390 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 10:40:43.014582 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 10:40:43.014773 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] command line args: [] {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 10:40:43.014862 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 10:40:43.015014 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 10:40:43.015091 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 10:40:43.015206 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] command line args: [] {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 10:40:43.015293 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ================================================================================ {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 10:40:43.015469 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] admin_token = **** {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.015552 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 10:40:43.015644 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ================================================================================ {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 10:40:43.015724 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] config_dir = [] {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.015900 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.015985 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] admin_token = **** {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.016083 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] config_source = [] {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.016263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] debug = True {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.016343 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] config_dir = [] {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.016461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.016714 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.016714 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] config_source = [] {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.016825 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.016959 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] debug = True {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.017041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.017147 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.017242 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.017460 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.017577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.017679 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.017785 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] list_limit = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.017887 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] log_config_append = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.018019 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.018121 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.018213 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] log_dir = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.018364 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.018477 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] log_file = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.018601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.018701 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] list_limit = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.019358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.019463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] log_config_append = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.019585 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.019672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.019785 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] log_dir = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.019861 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.019985 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] log_file = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.020060 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.020181 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.020297 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.020415 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.020645 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.020760 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.020883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.020991 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.021116 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.021349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.021482 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.021563 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.021639 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.021760 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.021840 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.022001 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.022078 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.022319 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.022408 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.022613 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.022806 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.022923 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.023004 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] publish_errors = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.023208 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.023283 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.023438 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.023514 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.023617 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.023850 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.023942 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.024087 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.024193 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.024323 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] standard_threads = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.024555 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.024634 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.024801 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.024977 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.025155 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] use_journal = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.025343 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.025435 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] use_json = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.025507 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] use_stderr = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.025580 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] publish_errors = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.025696 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] use_syslog = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.025851 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.025930 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.026141 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.026216 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.026355 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.026429 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.026634 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.026715 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.026874 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.026994 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.027123 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.027306 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] standard_threads = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.027388 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.027595 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.027668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.027830 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.027938 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.028077 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.028165 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.028325 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.028400 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] use_journal = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.028532 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] use_json = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.028606 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.028737 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] use_stderr = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.028823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.028949 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] use_syslog = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.029025 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.029254 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.029354 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 10:40:43.029530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.029613 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.029779 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.029923 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.030003 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.030255 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.030334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.030510 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.030587 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.030756 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.030931 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.031006 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.031244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.031333 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.031506 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.031587 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.031759 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.031904 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.032008 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.032242 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.032317 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.032473 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.032588 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.032706 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.032936 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.033018 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.033183 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.033371 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.033450 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.033680 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.033762 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.033912 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.034086 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.034161 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.034397 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.034515 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.035250 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.035419 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.035542 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.035737 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.035824 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.035975 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.036158 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.036285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.036439 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.036514 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.036673 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.036856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.036940 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.037125 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.037206 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.037389 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.037467 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.037643 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.037734 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.037878 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.037954 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.038116 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.038192 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.038348 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.038435 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.038584 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.038660 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.038822 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.038898 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.039057 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.039205 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.039284 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.039358 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.039513 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.039589 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.039750 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.039833 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.039984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.040066 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.040217 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.040291 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.040452 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.040535 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.040683 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.040759 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.040933 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.041007 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.041165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.041247 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.041423 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.041509 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.041658 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.041745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.041889 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.041973 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.042125 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.042200 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.042359 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.042440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.042593 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.042680 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.042830 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.042907 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.043080 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.043183 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.043313 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.043425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.043552 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.043661 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.043785 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.043889 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.044017 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.044104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.044251 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.044328 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.044483 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.044599 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.044721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.044796 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.044954 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.045030 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.045189 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.045266 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.045452 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.045540 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.045689 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.045770 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.045924 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.045995 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.046155 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.046236 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.046395 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.046473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.046629 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.046705 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.046864 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.046938 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.047098 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.047173 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.047357 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.047439 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.047577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.047661 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.047806 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.047881 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.048041 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.048117 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.048273 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.048343 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.048507 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.048585 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.048738 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.048813 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.048969 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.049044 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.049200 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.049278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.049461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.049539 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.049694 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.049768 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.049929 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.050007 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.050189 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.050269 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.050424 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.050507 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.050651 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.050725 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.050886 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.050958 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.051123 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.051198 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.051360 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.051446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.051595 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.051672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] auth.external = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.051823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.051903 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.052054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.052136 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.052315 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.052391 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.052550 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] auth.password = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.052624 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.052780 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] auth.token = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.052868 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.053014 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.053089 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.053245 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.053352 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.053503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.053588 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.053735 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.053810 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.053967 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.054038 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.054199 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.054282 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.054430 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.054514 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.054660 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.054736 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] credential.caching = True {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.054895 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.054981 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.055125 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.055210 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.055363 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.055441 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.055597 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.055674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.055839 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.055923 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.056073 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.056148 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.056330 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.056406 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.056587 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.056676 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.056825 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.056902 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.057053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] auth.external = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.057129 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.057283 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.057436 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.057598 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.057685 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.057830 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.057907 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.058061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] auth.password = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.058145 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.058298 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] auth.token = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.058375 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.058535 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.058614 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] federation.caching = True {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.058770 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.058853 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.059012 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.059087 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.059242 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.059318 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.059471 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.059553 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.059720 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.059798 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.059959 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.060035 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.060192 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] credential.caching = True {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.060275 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.060436 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.060511 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.060682 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.060757 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.060916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.060999 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.061154 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.061230 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.061419 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] identity.caching = True {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.061498 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.061652 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.061740 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.061903 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.061987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.062138 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.062214 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.062371 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.062456 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.062616 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.062694 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.062846 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.062923 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.063082 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.063167 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.063331 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.063416 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.063579 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.063656 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.063809 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.063892 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.064039 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.064113 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] federation.caching = True {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.064269 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.064345 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.064512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.064590 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.064754 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.064836 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.064984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.065060 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.065231 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.065419 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.065508 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.065580 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.065752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.065829 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.065992 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.066072 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.066243 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.066318 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.066476 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.066551 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.066711 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.066787 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.066942 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.067019 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] identity.caching = True {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.067178 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.067255 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.067418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.067496 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.067651 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.067728 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.067887 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.067970 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.068117 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.068194 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.068358 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.068433 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.068596 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.068673 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.068830 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.068906 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.069075 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.069153 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.069304 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.069393 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.069555 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.069633 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.069787 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.069865 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.070015 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.070090 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.070252 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.070330 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.070488 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.070564 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.070730 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.070807 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.070969 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.071046 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.071206 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.071283 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.071456 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.071532 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.071689 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.071766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.071920 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.071997 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.072157 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.072232 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.072385 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.072461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.072620 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.072697 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.072859 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.072934 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.073094 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.073172 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.073342 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.073424 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.073581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.user = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.073658 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.073819 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.073897 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.074064 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.074139 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.074295 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.074377 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.074539 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.074615 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.074783 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.074858 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.075010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.075093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.075245 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.075323 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.075474 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.075550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.075706 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.075790 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.075937 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.076014 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.076171 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.076248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.076407 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.076492 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.076642 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.076717 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.076885 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.076968 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.077129 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.077217 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.077384 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.077463 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.077619 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.077696 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.077851 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.077937 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.078096 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.078173 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.078497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.078579 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.078651 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.078733 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.078805 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.078875 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.078987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.user = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.079065 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.079225 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.079310 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.079468 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.079544 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.079698 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.079774 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.079944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.080028 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.080170 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.080247 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.080414 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.080491 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.080645 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.080729 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.080874 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.080952 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.081107 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.081182 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.081871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.081969 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.082120 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.082198 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.082351 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.082428 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.082584 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.082667 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.082826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] resource.caching = True {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.082905 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.083069 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.083145 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.083315 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.083399 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.083551 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.083629 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.083779 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.083854 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.084026 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.084111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.084257 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.084325 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.084489 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.084565 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.084722 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.084806 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.084956 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.085032 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.085190 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] role.caching = True {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.085266 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.085457 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.085547 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] role.driver = sql {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.085689 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.085765 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.085937 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.086014 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.086164 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.086246 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.086408 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.086486 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.086643 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.086719 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.086877 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.086954 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.087113 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.087195 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.087356 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.087431 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.087594 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.087740 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.087813 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.087882 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.088050 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.088126 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.088289 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] resource.caching = True {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.088373 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.088532 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.088608 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.088780 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.088857 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.089012 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.089172 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.089255 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.089434 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.089532 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.089685 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.089779 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.089934 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.090012 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.090202 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.090278 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.090458 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.090541 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.090677 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] role.caching = True {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.090772 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.090924 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] role.driver = sql {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.091007 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.091152 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.091238 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.091398 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.091475 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.091645 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.091723 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.091883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.091966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.092117 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.092194 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.092360 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.092436 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.092605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.092689 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.092851 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.092927 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.093088 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.093164 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.093332 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.093422 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.093572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.093649 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.093808 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] token.caching = True {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.093885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.094045 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.094130 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.094292 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.094370 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.094528 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.094679 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.094785 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.094919 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.095043 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.095170 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.095281 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.095420 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.095525 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.095670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.095767 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.095917 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.096014 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.096153 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.096238 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.096474 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.096551 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.096709 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.096785 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.096974 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.097639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.097780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.097857 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.098016 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.098093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.098250 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.098335 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.098505 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.098583 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.098768 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.098845 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] database.connection = **** {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.099016 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.099101 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.099251 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.099338 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.099486 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.099562 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.099717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.099792 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.099947 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.100030 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] token.caching = True {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.100182 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.100257 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.100414 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.100490 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.100649 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.100734 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.100894 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.100971 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.101129 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.101205 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.101389 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.101482 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.101624 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.101700 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.101866 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.101941 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.102097 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.102180 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.102338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.102413 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.102564 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.102639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.102797 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.102873 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.103027 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.103103 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.103195 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 10:40:43.103272 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.103498 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.103742 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.104034 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.104297 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] database.connection = **** {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.104543 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.104791 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.105028 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.105268 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.105528 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.105765 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.106000 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.106235 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.106479 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.106714 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.106956 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.107191 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.107439 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.107675 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.107919 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.108149 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.108389 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.108629 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 10:40:43.108799 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80144) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 10:40:43.132034 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.132267 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.132492 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.133400 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.133573 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.133800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.142177 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.143435 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.171319 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.171542 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.172339 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.172569 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.223875 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.224109 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.273932 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.274165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.274594 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.274829 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.339251 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.339421 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.339504 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.339651 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.339735 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.339873 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.339957 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.340090 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.340171 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.340299 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.340388 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.340509 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.363285 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.363520 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.363634 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.363734 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.363866 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.363947 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.364089 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.364169 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.364307 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.364389 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.364524 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.364604 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.364738 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.364951 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.375788 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.376062 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.388867 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.389118 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.389253 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.389370 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.389492 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.389574 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.389717 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.389798 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.389933 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.390016 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.390144 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.390225 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80144) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.390355 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.390566 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 10:40:43.407438 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.407642 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.407725 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 07 10:40:43.407853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 07 10:40:43.407979 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.408182 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 07 10:40:43.408264 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.408382 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 07 10:40:43.408462 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.408657 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.408745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.408918 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.408997 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.409172 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.409250 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.409479 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.420539 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.420760 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.420843 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.421037 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.421118 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.421306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.421407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.421614 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.428275 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.428514 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.431356 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.431612 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.431694 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.431893 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.431975 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.432175 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.432264 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.432452 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.432531 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.432714 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.432796 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.432975 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.433057 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.433243 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.433341 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.433536 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.433614 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.433801 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.433880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.434065 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.434142 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.434323 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.457969 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.458244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.459454 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.459726 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.459807 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.460011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.464333 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.464598 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.464679 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.464880 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.464962 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.465161 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.471501 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.471750 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.471834 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.472063 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.475951 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.476141 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.476227 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.476433 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.476514 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.476718 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.476797 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.477003 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.477085 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.477286 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.477438 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.477595 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.477678 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.477863 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.477943 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.478136 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.494046 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.494208 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.494325 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.494487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.498356 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.498518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.501527 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.501681 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.501822 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.501977 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.506736 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.506887 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.509927 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.510067 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.513089 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.513182 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.513415 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.513527 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.513717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.513836 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.514015 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.514133 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.514298 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.514416 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.514590 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.514707 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.531075 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.531212 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.531367 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.531494 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.531635 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.531759 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.531898 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.532016 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.538830 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.538953 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.540387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.540517 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.540663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.540797 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.543506 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.543631 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.543791 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.543914 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.544081 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.544208 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.544368 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.544498 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.544650 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.544778 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.556113 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.556205 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.556396 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.556478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.556676 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.556756 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.556957 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.557046 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.557239 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.557343 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.557540 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.557622 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.557815 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.557897 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.574901 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.575017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.577866 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.577972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.580785 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.580875 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.582421 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.582504 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.583928 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.584034 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.584209 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.584310 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.584488 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.584572 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.590895 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.590987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.592508 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.592599 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.595462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.595566 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.595748 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.595830 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.596026 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.596107 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.596298 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.596386 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.604876 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.604966 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.605163 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.605244 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.605466 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.605546 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.612301 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.612390 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80144) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 10:40:43.612630 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.612711 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.612918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.613000 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.613197 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.613277 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.613493 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.613588 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.613762 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.613842 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.614029 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.614109 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.614292 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.614373 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.614666 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.614753 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.614948 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.615039 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.615219 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.615299 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.615481 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.615559 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.615745 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.615824 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.616005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.616084 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80144) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 10:40:43.649887 dv-cinder-850320-3-smb devstack@keystone.service[80145]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56537a22f9c0 pid: 80145 (default app) Aug 07 10:40:43.650354 dv-cinder-850320-3-smb devstack@keystone.service[80144]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56537a22f9c0 pid: 80144 (default app) Aug 07 10:40:43.653143 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6376803-b678-4beb-b702-f3fc705e4df9 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:40:43.653463 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6376803-b678-4beb-b702-f3fc705e4df9 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:40:43.653734 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6376803-b678-4beb-b702-f3fc705e4df9 None None] PATH_INFO: `/v3` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:40:43.658007 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Sun Aug 7 10:40:43 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:40:51.314710 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537a67a-a2f8-4a86-8801-620b744faae4 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:40:51.315302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537a67a-a2f8-4a86-8801-620b744faae4 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:40:51.315302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537a67a-a2f8-4a86-8801-620b744faae4 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:40:51.319708 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:40:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 10:40:51.324766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf438a0f-fa3e-4bc3-88b5-44b40bcc8f71 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:40:51.325196 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf438a0f-fa3e-4bc3-88b5-44b40bcc8f71 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:40:51.325287 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf438a0f-fa3e-4bc3-88b5-44b40bcc8f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:40:51.396425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: INFO dbcounter [None req-cf438a0f-fa3e-4bc3-88b5-44b40bcc8f71 None None] Registered counter for database keystone Aug 07 10:40:51.415747 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG oslo_db.sqlalchemy.engines [None req-cf438a0f-fa3e-4bc3-88b5-44b40bcc8f71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80145) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 10:40:51.421799 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writer thread running {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 10:40:51.598179 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG passlib.handlers.bcrypt [None req-cf438a0f-fa3e-4bc3-88b5-44b40bcc8f71 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80145) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 07 10:40:51.598513 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG passlib.handlers.bcrypt [None req-cf438a0f-fa3e-4bc3-88b5-44b40bcc8f71 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80145) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 07 10:40:51.652702 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-cf438a0f-fa3e-4bc3-88b5-44b40bcc8f71 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:40:51.654335 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-cf438a0f-fa3e-4bc3-88b5-44b40bcc8f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:40:51.781856 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:40:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 07 10:40:51.815223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537a67a-a2f8-4a86-8801-620b744faae4 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:40:51.884405 dv-cinder-850320-3-smb devstack@keystone.service[80144]: INFO dbcounter [None req-e537a67a-a2f8-4a86-8801-620b744faae4 None None] Registered counter for database keystone Aug 07 10:40:51.905611 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG oslo_db.sqlalchemy.engines [None req-e537a67a-a2f8-4a86-8801-620b744faae4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80144) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 10:40:51.912409 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writer thread running {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 10:40:52.029420 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537a67a-a2f8-4a86-8801-620b744faae4 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:40:52.033650 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb38064-ea81-4ccf-9360-3624a211005f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:40:52.034375 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb38064-ea81-4ccf-9360-3624a211005f admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:40:52.034652 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb38064-ea81-4ccf-9360-3624a211005f admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:40:52.034918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb38064-ea81-4ccf-9360-3624a211005f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:40:52.042880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb38064-ea81-4ccf-9360-3624a211005f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:40:52.094719 dv-cinder-850320-3-smb devstack@keystone.service[80144]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ebb38064-ea81-4ccf-9360-3624a211005f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 07 10:40:52.095060 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb38064-ea81-4ccf-9360-3624a211005f admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:40:52.104698 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Sun Aug 7 10:40:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 10:40:52.110613 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf438a0f-fa3e-4bc3-88b5-44b40bcc8f71 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:40:52.125805 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf438a0f-fa3e-4bc3-88b5-44b40bcc8f71 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:40:52.130830 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d7986-1742-4ecb-a40a-0f432ce913bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:40:52.131934 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d7986-1742-4ecb-a40a-0f432ce913bc admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:40:52.132211 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d7986-1742-4ecb-a40a-0f432ce913bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:40:52.132476 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d7986-1742-4ecb-a40a-0f432ce913bc admin admin] PATH_INFO: `/v3/projects/a981d307e79a4251be167c0015c9f536` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:40:52.133926 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d7986-1742-4ecb-a40a-0f432ce913bc admin admin] RBAC: Authorizing `identity:get_project(project_id=a981d307e79a4251be167c0015c9f536)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:40:52.183998 dv-cinder-850320-3-smb devstack@keystone.service[80145]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a01d7986-1742-4ecb-a40a-0f432ce913bc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 07 10:40:52.184288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01d7986-1742-4ecb-a40a-0f432ce913bc admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:40:52.188896 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Sun Aug 7 10:40:52 2022] GET /identity/v3/projects/a981d307e79a4251be167c0015c9f536 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:40:54.148592 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f2e77-9dcc-41bd-b54f-7771a567cc4c None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:40:54.149132 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f2e77-9dcc-41bd-b54f-7771a567cc4c None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:40:54.149132 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f2e77-9dcc-41bd-b54f-7771a567cc4c None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:40:54.153219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:40:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:40:54.158397 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0982a44-608d-47e6-9a68-754a9c2bf363 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:40:54.158790 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0982a44-608d-47e6-9a68-754a9c2bf363 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:40:54.158944 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0982a44-608d-47e6-9a68-754a9c2bf363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:40:54.180344 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-a0982a44-608d-47e6-9a68-754a9c2bf363 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:40:54.181903 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a0982a44-608d-47e6-9a68-754a9c2bf363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:40:54.189721 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:40:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 07 10:40:54.211808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f2e77-9dcc-41bd-b54f-7771a567cc4c None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:40:54.223610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f2e77-9dcc-41bd-b54f-7771a567cc4c None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:40:54.227762 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6baace-1062-4c0e-8fe1-b79d7ec2b780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:40:54.228337 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6baace-1062-4c0e-8fe1-b79d7ec2b780 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:40:54.228611 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6baace-1062-4c0e-8fe1-b79d7ec2b780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:40:54.228878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6baace-1062-4c0e-8fe1-b79d7ec2b780 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:40:54.236382 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6baace-1062-4c0e-8fe1-b79d7ec2b780 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:40:54.238690 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6baace-1062-4c0e-8fe1-b79d7ec2b780 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:40:54.247655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Sun Aug 7 10:40:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 10:40:54.252749 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0982a44-608d-47e6-9a68-754a9c2bf363 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:40:54.261575 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0982a44-608d-47e6-9a68-754a9c2bf363 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:40:54.265970 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142dd5d3-dd97-4d43-9858-783155bef16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:40:54.266585 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142dd5d3-dd97-4d43-9858-783155bef16f admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:40:54.266862 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142dd5d3-dd97-4d43-9858-783155bef16f admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:40:54.267129 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142dd5d3-dd97-4d43-9858-783155bef16f admin admin] PATH_INFO: `/v3/users/fc0da4248e9e4613a07fa1302193fe96` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:40:54.268442 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142dd5d3-dd97-4d43-9858-783155bef16f admin admin] RBAC: Authorizing `identity:get_user(user_id=fc0da4248e9e4613a07fa1302193fe96)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:40:54.270771 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142dd5d3-dd97-4d43-9858-783155bef16f admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:40:54.272276 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Sun Aug 7 10:40:54 2022] GET /identity/v3/users/fc0da4248e9e4613a07fa1302193fe96 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:40:56.320329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404d97c-7b07-48c1-a671-0346ceac9770 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:40:56.320877 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404d97c-7b07-48c1-a671-0346ceac9770 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:40:56.320877 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404d97c-7b07-48c1-a671-0346ceac9770 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:40:56.322223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 10:40:56.327589 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd47af-bb1f-4f2f-99f0-b532e0d56ad2 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:40:56.328009 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd47af-bb1f-4f2f-99f0-b532e0d56ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:40:56.328135 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd47af-bb1f-4f2f-99f0-b532e0d56ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:40:56.346569 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-3bdd47af-bb1f-4f2f-99f0-b532e0d56ad2 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:40:56.347733 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-3bdd47af-bb1f-4f2f-99f0-b532e0d56ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:40:56.362433 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c3ff9-8308-4523-a9cf-c4849debe6d9 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:40:56.362719 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c3ff9-8308-4523-a9cf-c4849debe6d9 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:40:56.362994 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c3ff9-8308-4523-a9cf-c4849debe6d9 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:40:56.364314 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:40:56.369567 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bf421-688a-47e1-bff8-909b4523f2aa None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:40:56.369849 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bf421-688a-47e1-bff8-909b4523f2aa None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:40:56.370120 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bf421-688a-47e1-bff8-909b4523f2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:40:56.414430 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG passlib.handlers.bcrypt [None req-742bf421-688a-47e1-bff8-909b4523f2aa None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80144) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 07 10:40:56.414863 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG passlib.handlers.bcrypt [None req-742bf421-688a-47e1-bff8-909b4523f2aa None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80144) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 07 10:40:56.431556 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:40:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:40:56.453936 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd47af-bb1f-4f2f-99f0-b532e0d56ad2 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:40:56.460752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-742bf421-688a-47e1-bff8-909b4523f2aa None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:40:56.462371 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-742bf421-688a-47e1-bff8-909b4523f2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:40:56.475972 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:40:56.557070 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd47af-bb1f-4f2f-99f0-b532e0d56ad2 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:40:56.561940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:40:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 10:40:56.584003 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742bf421-688a-47e1-bff8-909b4523f2aa None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:40:56.590475 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727931f-1434-47dd-ac98-0d9bc943a01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:40:56.591101 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727931f-1434-47dd-ac98-0d9bc943a01e None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:40:56.591409 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727931f-1434-47dd-ac98-0d9bc943a01e None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:40:56.591682 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727931f-1434-47dd-ac98-0d9bc943a01e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:40:56.603096 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c727931f-1434-47dd-ac98-0d9bc943a01e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:40:56.611645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-c727931f-1434-47dd-ac98-0d9bc943a01e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:40:56.611645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:40:56.611645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:40:56.611645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:40:56.611645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:40:56.611645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:40:56.611645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:40:56.611645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:40:56.611645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:40:56.611645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:40:56.611645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:40:56.611645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:40:56.611645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:40:56.611645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:40:56.611645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:40:56.611645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:40:56.612646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:40:56.612646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:40:56.612646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:40:56.612646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:40:56.612646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:40:56.612646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:40:56.612646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:40:56.612646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:40:56.612646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:40:56.612646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:40:56.612646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:40:56.612646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:40:56.612646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:40:56.612646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:40:56.612646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:40:56.612646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:40:56.613491 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:40:56.613491 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:40:56.613491 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:40:56.613491 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:40:56.613491 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:40:56.613491 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:40:56.613491 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:40:56.613491 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:40:56.613491 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:40:56.613491 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:40:56.613491 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:40:56.613491 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:40:56.613491 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:40:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:40:56.619347 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727931f-1434-47dd-ac98-0d9bc943a01e None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:40:56.683527 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742bf421-688a-47e1-bff8-909b4523f2aa None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:40:56.685789 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:40:56.698971 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:40:56.717732 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727931f-1434-47dd-ac98-0d9bc943a01e None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:40:56.719866 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52acba-ab2e-42ac-92df-947a3c73761b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:40:56.720722 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52acba-ab2e-42ac-92df-947a3c73761b None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:40:56.721001 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52acba-ab2e-42ac-92df-947a3c73761b None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:40:56.721270 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52acba-ab2e-42ac-92df-947a3c73761b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:40:56.751244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f324f94-2841-4d34-af80-6bb67d03b5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:40:56.751843 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f324f94-2841-4d34-af80-6bb67d03b5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:40:56.752122 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f324f94-2841-4d34-af80-6bb67d03b5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:40:56.752398 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f324f94-2841-4d34-af80-6bb67d03b5b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:40:56.753660 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f324f94-2841-4d34-af80-6bb67d03b5b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:40:56.753966 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f324f94-2841-4d34-af80-6bb67d03b5b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:40:56.755353 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f324f94-2841-4d34-af80-6bb67d03b5b1 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:40:56.766799 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 8/15] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:40:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:40:56.772394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f324f94-2841-4d34-af80-6bb67d03b5b1 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:40:56.787582 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52acba-ab2e-42ac-92df-947a3c73761b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:40:56.789089 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52acba-ab2e-42ac-92df-947a3c73761b None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:40:56.886716 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 8/16] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:40:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 10:40:56.892619 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52acba-ab2e-42ac-92df-947a3c73761b None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:40:56.895964 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:40:56.977322 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f324f94-2841-4d34-af80-6bb67d03b5b1 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:40:56.994957 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52acba-ab2e-42ac-92df-947a3c73761b None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:40:57.010641 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703223d-4174-42dd-b5aa-45ce0af6b905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:40:57.011267 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703223d-4174-42dd-b5aa-45ce0af6b905 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:40:57.011544 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703223d-4174-42dd-b5aa-45ce0af6b905 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:40:57.011815 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703223d-4174-42dd-b5aa-45ce0af6b905 None admin] PATH_INFO: `/v3/users/fc0da4248e9e4613a07fa1302193fe96` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:40:57.012945 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703223d-4174-42dd-b5aa-45ce0af6b905 None admin] RBAC: Authorizing `identity:get_user(user_id=fc0da4248e9e4613a07fa1302193fe96)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:40:57.014428 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703223d-4174-42dd-b5aa-45ce0af6b905 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:40:57.015989 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 9/17] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:40:56 2022] GET /identity/v3/users/fc0da4248e9e4613a07fa1302193fe96 => generated 247 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:40:57.022101 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703223d-4174-42dd-b5aa-45ce0af6b905 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:40:57.028972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c42855-3cae-4ab3-8ad0-8b0813d98a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:40:57.029860 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c42855-3cae-4ab3-8ad0-8b0813d98a22 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:40:57.030143 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c42855-3cae-4ab3-8ad0-8b0813d98a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:40:57.030412 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c42855-3cae-4ab3-8ad0-8b0813d98a22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:40:57.036477 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:40:57.048455 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c42855-3cae-4ab3-8ad0-8b0813d98a22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:40:57.049949 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c42855-3cae-4ab3-8ad0-8b0813d98a22 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:40:57.068128 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-b2c42855-3cae-4ab3-8ad0-8b0813d98a22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:40:57.068128 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:40:57.068128 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:40:57.068128 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:40:57.068128 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:40:57.068128 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:40:57.068128 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:40:57.068128 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:40:57.068128 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:40:57.068128 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:40:57.068128 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:40:57.068128 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:40:57.068128 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:40:57.068128 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:40:57.068128 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:40:57.068128 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:40:57.069102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:40:57.069102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:40:57.069102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:40:57.069102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:40:57.069102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:40:57.069102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:40:57.069102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:40:57.069102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:40:57.069102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:40:57.069102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:40:57.069102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:40:57.069102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:40:57.069102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:40:57.069102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:40:57.069102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:40:57.069102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:40:57.069102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:40:57.069956 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:40:57.069956 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:40:57.069956 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:40:57.069956 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 9/18] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:40:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:40:57.075100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c42855-3cae-4ab3-8ad0-8b0813d98a22 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:40:57.122588 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703223d-4174-42dd-b5aa-45ce0af6b905 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:40:57.132363 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:40:57.156209 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44f71c-ec4b-46f9-9b3e-c772f9f1a38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:40:57.156778 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44f71c-ec4b-46f9-9b3e-c772f9f1a38b None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:40:57.157061 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44f71c-ec4b-46f9-9b3e-c772f9f1a38b None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:40:57.157357 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44f71c-ec4b-46f9-9b3e-c772f9f1a38b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:40:57.158508 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44f71c-ec4b-46f9-9b3e-c772f9f1a38b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:40:57.160563 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44f71c-ec4b-46f9-9b3e-c772f9f1a38b None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:40:57.162203 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 10/19] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:40:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:40:57.167828 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44f71c-ec4b-46f9-9b3e-c772f9f1a38b None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:40:57.177246 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c42855-3cae-4ab3-8ad0-8b0813d98a22 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:40:57.210286 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e6dac-35f5-449c-a810-8d6d4e2880cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:40:57.210899 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e6dac-35f5-449c-a810-8d6d4e2880cf None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:40:57.211178 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e6dac-35f5-449c-a810-8d6d4e2880cf None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:40:57.211448 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e6dac-35f5-449c-a810-8d6d4e2880cf None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:40:57.212091 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e6dac-35f5-449c-a810-8d6d4e2880cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:40:57.212392 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e6dac-35f5-449c-a810-8d6d4e2880cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:40:57.213806 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e6dac-35f5-449c-a810-8d6d4e2880cf None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:40:57.231294 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 10/20] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:40:57.253982 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:40:57.274353 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44f71c-ec4b-46f9-9b3e-c772f9f1a38b None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:40:57.309898 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5a338-35b7-443b-a440-a6bd8c816396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:40:57.310512 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5a338-35b7-443b-a440-a6bd8c816396 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:40:57.310786 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5a338-35b7-443b-a440-a6bd8c816396 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:40:57.311052 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5a338-35b7-443b-a440-a6bd8c816396 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:40:57.311801 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a5a338-35b7-443b-a440-a6bd8c816396 None admin] RBAC: Adding query filter params (role.id=9da6e501237c405ca021a9d9f6173caf, scope.domain.id=default, user.id=fc0da4248e9e4613a07fa1302193fe96) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:40:57.312102 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a5a338-35b7-443b-a440-a6bd8c816396 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:40:57.313572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a5a338-35b7-443b-a440-a6bd8c816396 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:40:57.321594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 11/21] 10.222.0.27 () {56 vars in 1322 bytes} [Sun Aug 7 10:40:57 2022] GET /identity/v3/role_assignments?user.id=fc0da4248e9e4613a07fa1302193fe96&scope.domain.id=default&role.id=9da6e501237c405ca021a9d9f6173caf => generated 233 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:40:59.733095 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c39d4f-31ab-4074-a16b-a0828a41661c None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:40:59.734126 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c39d4f-31ab-4074-a16b-a0828a41661c None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:40:59.734601 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c39d4f-31ab-4074-a16b-a0828a41661c None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:40:59.736525 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 11/22] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:40:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:40:59.745387 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260df9cd-7f4d-47e4-b2cc-282beb34442e None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:40:59.745815 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260df9cd-7f4d-47e4-b2cc-282beb34442e None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:40:59.745928 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260df9cd-7f4d-47e4-b2cc-282beb34442e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:40:59.764822 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-260df9cd-7f4d-47e4-b2cc-282beb34442e None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:40:59.766280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-260df9cd-7f4d-47e4-b2cc-282beb34442e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:40:59.789027 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5da286-f4fe-4e36-8ba7-4fd6c4a88b2d None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:40:59.789644 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5da286-f4fe-4e36-8ba7-4fd6c4a88b2d None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:40:59.790140 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5da286-f4fe-4e36-8ba7-4fd6c4a88b2d None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:40:59.791718 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 12/23] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:40:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:40:59.796755 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe1fdb-dd1a-4d10-a46d-f7b1e98b1779 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:40:59.797266 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe1fdb-dd1a-4d10-a46d-f7b1e98b1779 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:40:59.797789 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe1fdb-dd1a-4d10-a46d-f7b1e98b1779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:40:59.818276 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-1cbe1fdb-dd1a-4d10-a46d-f7b1e98b1779 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:40:59.819763 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-1cbe1fdb-dd1a-4d10-a46d-f7b1e98b1779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:40:59.874256 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 12/24] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:40:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:40:59.882999 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9de0d-52b4-42c9-81bc-1317ac72be31 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:40:59.883495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9de0d-52b4-42c9-81bc-1317ac72be31 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:40:59.885719 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9de0d-52b4-42c9-81bc-1317ac72be31 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:40:59.887232 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 13/25] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:40:59 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:40:59.892562 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66094a-a775-4b77-acd8-d598c096ff9e None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:40:59.893263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66094a-a775-4b77-acd8-d598c096ff9e None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:40:59.895104 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66094a-a775-4b77-acd8-d598c096ff9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:40:59.920688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 13/26] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:40:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 10:40:59.930506 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-3f66094a-a775-4b77-acd8-d598c096ff9e None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:40:59.932016 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-3f66094a-a775-4b77-acd8-d598c096ff9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:40:59.959261 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe1fdb-dd1a-4d10-a46d-f7b1e98b1779 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:00.046139 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:00.074147 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 14/27] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:40:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:00.075005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66094a-a775-4b77-acd8-d598c096ff9e None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:00.082803 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:00.151267 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe1fdb-dd1a-4d10-a46d-f7b1e98b1779 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:00.209975 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc617198-4f45-4d99-afaa-fc08d8178300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:00.210978 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc617198-4f45-4d99-afaa-fc08d8178300 None admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:00.211459 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc617198-4f45-4d99-afaa-fc08d8178300 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:00.211932 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc617198-4f45-4d99-afaa-fc08d8178300 None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:00.212903 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc617198-4f45-4d99-afaa-fc08d8178300 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:00.214613 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc617198-4f45-4d99-afaa-fc08d8178300 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:00.265026 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66094a-a775-4b77-acd8-d598c096ff9e None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:00.314145 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728f97f-0a9b-4b3b-af23-4b78cdb59e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:00.315140 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728f97f-0a9b-4b3b-af23-4b78cdb59e59 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:00.315779 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728f97f-0a9b-4b3b-af23-4b78cdb59e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:00.316268 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728f97f-0a9b-4b3b-af23-4b78cdb59e59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:00.337599 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7728f97f-0a9b-4b3b-af23-4b78cdb59e59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:00.339534 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7728f97f-0a9b-4b3b-af23-4b78cdb59e59 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:00.379485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-7728f97f-0a9b-4b3b-af23-4b78cdb59e59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:41:00.379485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:00.379485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:00.379485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:00.379485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:00.379485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:00.379485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:00.379485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:00.379485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:00.379485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:00.379485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:00.379485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:00.379485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:41:00.379485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:41:00.379485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:41:00.379485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:41:00.380432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:00.380432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:00.380432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:00.380432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:00.380432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:00.380432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:00.380432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:00.380432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:00.380432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:00.380432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:00.380432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:00.380432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:00.380432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:00.380432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:00.380432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:00.380432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:00.380432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:41:00.381226 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:41:00.381226 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:41:00.381226 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:41:00.385563 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 15/28] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:41:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:00.387123 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728f97f-0a9b-4b3b-af23-4b78cdb59e59 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:00.479410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:00.500590 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 14/29] 10.222.0.27 () {60 vars in 1131 bytes} [Sun Aug 7 10:40:59 2022] POST /identity/v3/roles => generated 219 bytes in 542 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 10:41:00.501825 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc617198-4f45-4d99-afaa-fc08d8178300 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:00.584484 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728f97f-0a9b-4b3b-af23-4b78cdb59e59 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:00.629385 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a02cf-970e-4159-91bc-ef6294ec006f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:00.630727 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a02cf-970e-4159-91bc-ef6294ec006f None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:00.631009 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a02cf-970e-4159-91bc-ef6294ec006f None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:00.631276 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a02cf-970e-4159-91bc-ef6294ec006f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:00.644867 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a02cf-970e-4159-91bc-ef6294ec006f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:00.652826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-647a02cf-970e-4159-91bc-ef6294ec006f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:41:00.652826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:00.652826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:00.652826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:00.652826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:00.652826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:00.652826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:00.652826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:00.652826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:00.652826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:00.652826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:00.652826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:00.652826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:00.652826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:00.652826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:00.652826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:00.653955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:00.653955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:00.653955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:00.653955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:00.653955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:00.653955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:00.653955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:00.653955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:00.653955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:00.653955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:00.653955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:00.653955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:00.653955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:00.653955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:00.653955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:00.653955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:00.654884 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:00.654884 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:00.654884 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:00.654884 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:00.654884 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:00.654884 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:00.654884 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:00.654884 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:00.654884 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:00.654884 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:00.654884 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:41:00.654884 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:41:00.657519 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 16/30] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:41:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:00.663978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a2a42-8062-4c58-82d1-67c951bfd12c None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:00.663978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a2a42-8062-4c58-82d1-67c951bfd12c None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:00.663978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a2a42-8062-4c58-82d1-67c951bfd12c None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:00.663978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 17/31] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:00.665476 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ded62-76a7-4609-9fbe-e34b5e67fcb3 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:00.669720 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ded62-76a7-4609-9fbe-e34b5e67fcb3 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:00.670624 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ded62-76a7-4609-9fbe-e34b5e67fcb3 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:00.673140 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 18/32] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:00.674206 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ded62-76a7-4609-9fbe-e34b5e67fcb3 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:00.686664 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc617198-4f45-4d99-afaa-fc08d8178300 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:00.697924 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:00.735546 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29b57f-5ed7-4a8b-a61d-3899f090ce15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:00.736918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29b57f-5ed7-4a8b-a61d-3899f090ce15 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:00.738010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29b57f-5ed7-4a8b-a61d-3899f090ce15 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:00.738331 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29b57f-5ed7-4a8b-a61d-3899f090ce15 None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:00.739142 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd29b57f-5ed7-4a8b-a61d-3899f090ce15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:00.739453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd29b57f-5ed7-4a8b-a61d-3899f090ce15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:00.740991 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd29b57f-5ed7-4a8b-a61d-3899f090ce15 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:00.757479 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 15/33] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:00.758823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab246c-8436-4084-b03d-fa109fb15304 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:00.759104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab246c-8436-4084-b03d-fa109fb15304 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:00.759543 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab246c-8436-4084-b03d-fa109fb15304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:00.780348 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-3eab246c-8436-4084-b03d-fa109fb15304 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:00.782115 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-3eab246c-8436-4084-b03d-fa109fb15304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:00.810787 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ded62-76a7-4609-9fbe-e34b5e67fcb3 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:00.826802 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:00.846068 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8859e31-cee7-411f-b065-46c10e081acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:00.847164 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8859e31-cee7-411f-b065-46c10e081acf None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:00.847441 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8859e31-cee7-411f-b065-46c10e081acf None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:00.847710 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8859e31-cee7-411f-b065-46c10e081acf None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:00.848371 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8859e31-cee7-411f-b065-46c10e081acf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:00.848668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8859e31-cee7-411f-b065-46c10e081acf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:00.850073 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8859e31-cee7-411f-b065-46c10e081acf None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:00.858528 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 19/34] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:00.865234 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 16/35] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:00.865234 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b081d9-a27d-4456-b889-b18322f5df54 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:00.865234 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b081d9-a27d-4456-b889-b18322f5df54 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:00.865234 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b081d9-a27d-4456-b889-b18322f5df54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:00.865549 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8859e31-cee7-411f-b065-46c10e081acf None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:00.886932 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-62b081d9-a27d-4456-b889-b18322f5df54 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:00.888141 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-62b081d9-a27d-4456-b889-b18322f5df54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:00.965337 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 17/36] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:00.965337 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b081d9-a27d-4456-b889-b18322f5df54 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:00.983288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8859e31-cee7-411f-b065-46c10e081acf None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:00.994251 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:01.021729 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65ab3d-ed25-493d-b9a8-7fbc1a62c3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:01.022436 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65ab3d-ed25-493d-b9a8-7fbc1a62c3c2 None admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:01.022717 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65ab3d-ed25-493d-b9a8-7fbc1a62c3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:01.022995 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65ab3d-ed25-493d-b9a8-7fbc1a62c3c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:01.024045 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65ab3d-ed25-493d-b9a8-7fbc1a62c3c2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:01.025835 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65ab3d-ed25-493d-b9a8-7fbc1a62c3c2 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:01.086005 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b081d9-a27d-4456-b889-b18322f5df54 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:01.121927 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0a994-700d-4e9e-be6b-66fa1c9878b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:01.122563 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0a994-700d-4e9e-be6b-66fa1c9878b3 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:01.122845 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0a994-700d-4e9e-be6b-66fa1c9878b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:01.123116 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0a994-700d-4e9e-be6b-66fa1c9878b3 None admin] PATH_INFO: `/v3/users/fc0da4248e9e4613a07fa1302193fe96` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:01.124615 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0a994-700d-4e9e-be6b-66fa1c9878b3 None admin] RBAC: Authorizing `identity:get_user(user_id=fc0da4248e9e4613a07fa1302193fe96)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:01.126085 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0a994-700d-4e9e-be6b-66fa1c9878b3 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:01.132259 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 18/37] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:00 2022] GET /identity/v3/users/fc0da4248e9e4613a07fa1302193fe96 => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:01.132259 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0a994-700d-4e9e-be6b-66fa1c9878b3 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:01.159954 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 20/38] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 7 10:41:00 2022] POST /identity/v3/projects => generated 301 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:41:01.160986 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65ab3d-ed25-493d-b9a8-7fbc1a62c3c2 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:01.195999 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:01.259018 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:01.267201 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0a994-700d-4e9e-be6b-66fa1c9878b3 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:01.283524 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65ab3d-ed25-493d-b9a8-7fbc1a62c3c2 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:01.304898 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d63d1-5eb4-4557-ab7b-2637e3d29a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:01.306072 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d63d1-5eb4-4557-ab7b-2637e3d29a68 None admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:01.306072 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d63d1-5eb4-4557-ab7b-2637e3d29a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:01.306072 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d63d1-5eb4-4557-ab7b-2637e3d29a68 None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:01.306818 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d63d1-5eb4-4557-ab7b-2637e3d29a68 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:01.308191 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d63d1-5eb4-4557-ab7b-2637e3d29a68 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:01.329359 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 19/39] 10.222.0.27 () {60 vars in 1131 bytes} [Sun Aug 7 10:41:01 2022] POST /identity/v3/roles => generated 223 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:41:01.329538 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f784dfb-7ba6-4cd3-a4b3-fdae0df8fe06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:01.329630 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d63d1-5eb4-4557-ab7b-2637e3d29a68 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:01.329727 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f784dfb-7ba6-4cd3-a4b3-fdae0df8fe06 None admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:01.329727 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f784dfb-7ba6-4cd3-a4b3-fdae0df8fe06 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:01.329727 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f784dfb-7ba6-4cd3-a4b3-fdae0df8fe06 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:01.329727 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f784dfb-7ba6-4cd3-a4b3-fdae0df8fe06 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:01.330603 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f784dfb-7ba6-4cd3-a4b3-fdae0df8fe06 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:01.352555 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 21/40] 10.222.0.27 () {60 vars in 1131 bytes} [Sun Aug 7 10:41:01 2022] POST /identity/v3/roles => generated 225 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:41:01.353882 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c80577-f30d-459e-95af-aac8f3c224dd None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:01.354130 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c80577-f30d-459e-95af-aac8f3c224dd None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:01.354403 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c80577-f30d-459e-95af-aac8f3c224dd None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:01.359905 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 22/41] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:01.362194 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220e316-1349-46a9-b6f4-31a206811518 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:01.362545 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220e316-1349-46a9-b6f4-31a206811518 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:01.362831 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220e316-1349-46a9-b6f4-31a206811518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:01.399285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-e220e316-1349-46a9-b6f4-31a206811518 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:01.401157 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-e220e316-1349-46a9-b6f4-31a206811518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:01.476545 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d63d1-5eb4-4557-ab7b-2637e3d29a68 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:01.497441 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 23/42] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 10:41:01.522148 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220e316-1349-46a9-b6f4-31a206811518 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:01.526126 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35dfeec-3c36-4f1e-b9cf-7853d7e05f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:01.526835 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35dfeec-3c36-4f1e-b9cf-7853d7e05f88 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:01.527119 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35dfeec-3c36-4f1e-b9cf-7853d7e05f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:01.527443 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35dfeec-3c36-4f1e-b9cf-7853d7e05f88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:01.528649 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35dfeec-3c36-4f1e-b9cf-7853d7e05f88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:01.530436 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35dfeec-3c36-4f1e-b9cf-7853d7e05f88 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:01.534416 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 20/43] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:41:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:01.540339 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35dfeec-3c36-4f1e-b9cf-7853d7e05f88 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:01.550246 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:01.574458 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:01.646020 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220e316-1349-46a9-b6f4-31a206811518 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:01.656366 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35dfeec-3c36-4f1e-b9cf-7853d7e05f88 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:01.679135 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0217f06-57b3-415c-abd3-4862184b0cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:01.679760 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0217f06-57b3-415c-abd3-4862184b0cae None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:01.680042 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0217f06-57b3-415c-abd3-4862184b0cae None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:01.680316 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0217f06-57b3-415c-abd3-4862184b0cae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:01.681465 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0217f06-57b3-415c-abd3-4862184b0cae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:01.682913 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0217f06-57b3-415c-abd3-4862184b0cae None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:01.684468 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 24/44] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:41:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:01.689365 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be9c4f-f88f-4509-accf-bbb9341bc343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:01.690019 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be9c4f-f88f-4509-accf-bbb9341bc343 None admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:01.690937 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be9c4f-f88f-4509-accf-bbb9341bc343 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:01.691212 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be9c4f-f88f-4509-accf-bbb9341bc343 None admin] PATH_INFO: `/v3/domains/default/users/fc0da4248e9e4613a07fa1302193fe96/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:01.691352 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0217f06-57b3-415c-abd3-4862184b0cae None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:01.693123 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be9c4f-f88f-4509-accf-bbb9341bc343 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=fc0da4248e9e4613a07fa1302193fe96, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:01.694594 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be9c4f-f88f-4509-accf-bbb9341bc343 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:01.708797 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 21/45] 10.222.0.27 () {58 vars in 1361 bytes} [Sun Aug 7 10:41:01 2022] PUT /identity/v3/domains/default/users/fc0da4248e9e4613a07fa1302193fe96/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 10:41:01.789361 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:01.802054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0217f06-57b3-415c-abd3-4862184b0cae None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:01.836765 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f4988-3320-4038-879c-e856c9bcf26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:01.837449 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f4988-3320-4038-879c-e856c9bcf26a None admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:01.837678 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f4988-3320-4038-879c-e856c9bcf26a None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:01.837948 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f4988-3320-4038-879c-e856c9bcf26a None admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:01.838601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f4988-3320-4038-879c-e856c9bcf26a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:01.840065 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f4988-3320-4038-879c-e856c9bcf26a None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:01.868585 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 25/46] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 7 10:41:01 2022] POST /identity/v3/projects => generated 312 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 10:41:03.682981 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec95786-4c38-4ec2-8ad5-2f32c1dd939a None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:03.683481 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec95786-4c38-4ec2-8ad5-2f32c1dd939a None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:03.683566 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec95786-4c38-4ec2-8ad5-2f32c1dd939a None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:03.684859 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 22/47] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:03.689886 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b445b10-3e14-4786-8b18-c230db1506a8 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:03.690783 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b445b10-3e14-4786-8b18-c230db1506a8 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:03.690968 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b445b10-3e14-4786-8b18-c230db1506a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:03.708760 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-8b445b10-3e14-4786-8b18-c230db1506a8 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:03.709952 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-8b445b10-3e14-4786-8b18-c230db1506a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:03.775408 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 26/48] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:03.797618 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec95786-4c38-4ec2-8ad5-2f32c1dd939a None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:03.865280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba3d38-e56a-4635-a623-d1b0856a6c5b None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:03.865601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba3d38-e56a-4635-a623-d1b0856a6c5b None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:03.865885 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba3d38-e56a-4635-a623-d1b0856a6c5b None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:03.867225 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 27/49] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 10:41:03.872127 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df252b-413e-4a17-a7bc-9179bfdbc935 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:03.872410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df252b-413e-4a17-a7bc-9179bfdbc935 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:03.872682 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df252b-413e-4a17-a7bc-9179bfdbc935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:03.880961 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:03.890861 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-74df252b-413e-4a17-a7bc-9179bfdbc935 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:03.892048 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-74df252b-413e-4a17-a7bc-9179bfdbc935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:03.901939 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec95786-4c38-4ec2-8ad5-2f32c1dd939a None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:03.935321 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed98acd-0b0f-4967-bbfc-feb8bbda4ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:03.935886 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed98acd-0b0f-4967-bbfc-feb8bbda4ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:03.936167 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed98acd-0b0f-4967-bbfc-feb8bbda4ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:03.936442 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed98acd-0b0f-4967-bbfc-feb8bbda4ed3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:03.948151 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed98acd-0b0f-4967-bbfc-feb8bbda4ed3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:03.953725 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:03.953957 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-9ed98acd-0b0f-4967-bbfc-feb8bbda4ed3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:41:03.953957 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:03.953957 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:03.953957 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:03.953957 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:03.953957 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:03.953957 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:03.953957 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:03.953957 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:03.953957 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:03.953957 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:03.953957 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:03.953957 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:03.953957 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:03.953957 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:03.953957 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:03.954952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:03.954952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:03.954952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:03.954952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:03.954952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:03.954952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:03.954952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:03.954952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:03.954952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:03.954952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:03.954952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:03.954952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:03.954952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:03.954952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:03.954952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:03.954952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:03.956216 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:03.956216 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:03.956216 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:03.956216 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:03.956216 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:03.956216 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:03.956216 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:03.956216 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:03.956216 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:03.956216 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:03.956216 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:41:03.956216 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:41:03.956216 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 23/50] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:41:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:03.960889 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 28/51] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 10:41:03.961341 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed98acd-0b0f-4967-bbfc-feb8bbda4ed3 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:03.988514 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df252b-413e-4a17-a7bc-9179bfdbc935 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:04.061608 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed98acd-0b0f-4967-bbfc-feb8bbda4ed3 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:04.085148 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df252b-413e-4a17-a7bc-9179bfdbc935 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:04.095603 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3382f27-37e4-4742-a28b-1d0c0df5c3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:04.096203 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3382f27-37e4-4742-a28b-1d0c0df5c3cc None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:04.096551 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3382f27-37e4-4742-a28b-1d0c0df5c3cc None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:04.096826 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3382f27-37e4-4742-a28b-1d0c0df5c3cc None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:04.097533 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3382f27-37e4-4742-a28b-1d0c0df5c3cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:04.097840 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3382f27-37e4-4742-a28b-1d0c0df5c3cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:04.099223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3382f27-37e4-4742-a28b-1d0c0df5c3cc None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:04.111010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 24/52] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:41:04.117082 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3382f27-37e4-4742-a28b-1d0c0df5c3cc None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:04.118655 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf7519-59e1-461a-98aa-57e0ac05a4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:04.119285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf7519-59e1-461a-98aa-57e0ac05a4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:04.119566 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf7519-59e1-461a-98aa-57e0ac05a4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:04.119838 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf7519-59e1-461a-98aa-57e0ac05a4f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:04.120957 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bf7519-59e1-461a-98aa-57e0ac05a4f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:04.121616 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:04.122526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bf7519-59e1-461a-98aa-57e0ac05a4f0 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:04.124240 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 29/53] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:41:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:41:04.130662 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf7519-59e1-461a-98aa-57e0ac05a4f0 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:04.197588 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:04.217212 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3382f27-37e4-4742-a28b-1d0c0df5c3cc None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:04.232643 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf7519-59e1-461a-98aa-57e0ac05a4f0 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:04.250368 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4e0d3-ec42-4be4-ab8b-2e8cb318ac19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:04.250991 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4e0d3-ec42-4be4-ab8b-2e8cb318ac19 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:04.251266 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4e0d3-ec42-4be4-ab8b-2e8cb318ac19 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:04.251535 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4e0d3-ec42-4be4-ab8b-2e8cb318ac19 None admin] PATH_INFO: `/v3/users/fc0da4248e9e4613a07fa1302193fe96` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:04.252690 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4e0d3-ec42-4be4-ab8b-2e8cb318ac19 None admin] RBAC: Authorizing `identity:get_user(user_id=fc0da4248e9e4613a07fa1302193fe96)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:04.254168 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4e0d3-ec42-4be4-ab8b-2e8cb318ac19 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:04.255757 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 25/54] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:04 2022] GET /identity/v3/users/fc0da4248e9e4613a07fa1302193fe96 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:41:04.261167 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4e0d3-ec42-4be4-ab8b-2e8cb318ac19 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:04.265928 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac3b7c-3379-49f6-a081-0822b90d6f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:04.266534 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac3b7c-3379-49f6-a081-0822b90d6f01 None admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:04.266815 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac3b7c-3379-49f6-a081-0822b90d6f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:04.267085 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac3b7c-3379-49f6-a081-0822b90d6f01 None admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:04.267722 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac3b7c-3379-49f6-a081-0822b90d6f01 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:04.269664 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac3b7c-3379-49f6-a081-0822b90d6f01 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:04.297638 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 30/55] 10.222.0.27 () {60 vars in 1140 bytes} [Sun Aug 7 10:41:04 2022] POST /identity/v3/projects => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:41:04.334316 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:04.367697 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4e0d3-ec42-4be4-ab8b-2e8cb318ac19 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:04.405641 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0b9b0-4d11-4932-9754-f84f6c6b80f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:04.406286 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0b9b0-4d11-4932-9754-f84f6c6b80f8 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:04.406568 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0b9b0-4d11-4932-9754-f84f6c6b80f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:04.406843 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0b9b0-4d11-4932-9754-f84f6c6b80f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:04.408004 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b0b9b0-4d11-4932-9754-f84f6c6b80f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:04.409533 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b0b9b0-4d11-4932-9754-f84f6c6b80f8 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:04.411206 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 26/56] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:41:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:41:04.417271 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac3b7c-3379-49f6-a081-0822b90d6f01 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:04.521033 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac3b7c-3379-49f6-a081-0822b90d6f01 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:04.540072 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:04.554758 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090992f-f14a-496f-96db-2d337bfa0008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:04.555366 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090992f-f14a-496f-96db-2d337bfa0008 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:04.555675 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090992f-f14a-496f-96db-2d337bfa0008 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:04.555949 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090992f-f14a-496f-96db-2d337bfa0008 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:04.556687 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090992f-f14a-496f-96db-2d337bfa0008 None admin] RBAC: Adding query filter params (role.id=9da6e501237c405ca021a9d9f6173caf, scope.domain.id=default, user.id=fc0da4248e9e4613a07fa1302193fe96) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:04.556996 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090992f-f14a-496f-96db-2d337bfa0008 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:04.558484 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090992f-f14a-496f-96db-2d337bfa0008 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:04.564152 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 31/57] 10.222.0.27 () {56 vars in 1322 bytes} [Sun Aug 7 10:41:04 2022] GET /identity/v3/role_assignments?user.id=fc0da4248e9e4613a07fa1302193fe96&scope.domain.id=default&role.id=9da6e501237c405ca021a9d9f6173caf => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:06.295688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb6988-b342-4f3e-954b-39b2a214897d None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:06.296198 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb6988-b342-4f3e-954b-39b2a214897d None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:06.296302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb6988-b342-4f3e-954b-39b2a214897d None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:06.297714 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 27/58] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:06.303202 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8143c-04f5-4a72-a78d-b467e0cc89e5 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:06.303603 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8143c-04f5-4a72-a78d-b467e0cc89e5 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:06.303757 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8143c-04f5-4a72-a78d-b467e0cc89e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:06.321938 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-05a8143c-04f5-4a72-a78d-b467e0cc89e5 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:06.323107 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-05a8143c-04f5-4a72-a78d-b467e0cc89e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:06.387604 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 32/59] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:06.411123 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb6988-b342-4f3e-954b-39b2a214897d None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:06.510188 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb6988-b342-4f3e-954b-39b2a214897d None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:06.542431 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e323d-b449-423f-bf06-1e38bb4c6a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:06.543063 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e323d-b449-423f-bf06-1e38bb4c6a61 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:06.543343 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e323d-b449-423f-bf06-1e38bb4c6a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:06.543614 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e323d-b449-423f-bf06-1e38bb4c6a61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:06.544721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8e323d-b449-423f-bf06-1e38bb4c6a61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:06.546236 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8e323d-b449-423f-bf06-1e38bb4c6a61 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:06.547720 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 28/60] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:41:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:06.553589 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8143c-04f5-4a72-a78d-b467e0cc89e5 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:06.647542 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8143c-04f5-4a72-a78d-b467e0cc89e5 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:06.662142 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:06.681559 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a18944-15e1-441d-8337-aefa83a34bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:06.682152 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a18944-15e1-441d-8337-aefa83a34bf5 None admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:06.682428 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a18944-15e1-441d-8337-aefa83a34bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:06.682697 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a18944-15e1-441d-8337-aefa83a34bf5 None admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:06.683334 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a18944-15e1-441d-8337-aefa83a34bf5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:06.684754 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a18944-15e1-441d-8337-aefa83a34bf5 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:06.710938 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 33/61] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 7 10:41:06 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:41:09.741971 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cae676-ff34-491b-b712-478e46660cba None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:09.742965 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cae676-ff34-491b-b712-478e46660cba None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:09.743692 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cae676-ff34-491b-b712-478e46660cba None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:09.745547 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 29/62] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:09.750529 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad106a-f248-44e6-b34c-c6388e9d4991 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:09.751307 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad106a-f248-44e6-b34c-c6388e9d4991 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:09.751779 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad106a-f248-44e6-b34c-c6388e9d4991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:09.782364 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-a0ad106a-f248-44e6-b34c-c6388e9d4991 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:09.784466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a0ad106a-f248-44e6-b34c-c6388e9d4991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:09.873269 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 34/63] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:09.914871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cae676-ff34-491b-b712-478e46660cba None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:09.926799 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a019d9-3b97-45b3-887f-b261a4761791 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:09.927370 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a019d9-3b97-45b3-887f-b261a4761791 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:09.927834 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a019d9-3b97-45b3-887f-b261a4761791 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:09.929410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 35/64] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:09.934589 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a78d46-d553-4f29-a4a0-44417d5fda3f None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:09.935080 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a78d46-d553-4f29-a4a0-44417d5fda3f None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:09.935603 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a78d46-d553-4f29-a4a0-44417d5fda3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:09.939320 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:09.955483 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-95a78d46-d553-4f29-a4a0-44417d5fda3f None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:09.957842 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-95a78d46-d553-4f29-a4a0-44417d5fda3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:10.078180 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 36/65] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 10:41:10.103352 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cae676-ff34-491b-b712-478e46660cba None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:10.128432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a78d46-d553-4f29-a4a0-44417d5fda3f None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:10.162787 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ae4ad-5fce-4d23-a85a-458b695d9fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:10.163948 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ae4ad-5fce-4d23-a85a-458b695d9fea None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:10.165114 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ae4ad-5fce-4d23-a85a-458b695d9fea None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:10.166202 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ae4ad-5fce-4d23-a85a-458b695d9fea None admin] PATH_INFO: `/v3/roles/member` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:10.180400 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:10.197436 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282ae4ad-5fce-4d23-a85a-458b695d9fea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:10.202646 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-282ae4ad-5fce-4d23-a85a-458b695d9fea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:10.202646 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:10.202646 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:10.202646 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:10.202646 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:10.202646 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:10.202646 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:10.202646 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:10.202646 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:10.202646 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:10.202646 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:10.202646 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:10.202646 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:10.202646 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:10.202646 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:10.202646 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:10.203477 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:10.203477 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:10.203477 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:10.203477 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:10.203477 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:10.203477 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:10.203477 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:10.203477 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:10.203477 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:10.203477 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:10.203477 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:10.203477 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:10.203477 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:10.203477 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:10.203477 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:10.203477 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:10.204223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:10.204223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:10.204223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:10.204223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:10.204223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:10.204223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:10.204223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:10.204223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:10.204223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:10.204223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:10.204223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:10.204223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:41:10.207219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 30/66] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:10.214097 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ae4ad-5fce-4d23-a85a-458b695d9fea None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:10.281872 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a78d46-d553-4f29-a4a0-44417d5fda3f None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:10.288013 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:10.318317 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae64cc9-f6e8-4435-af45-979b0802acb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:10.318950 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae64cc9-f6e8-4435-af45-979b0802acb4 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:10.319234 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae64cc9-f6e8-4435-af45-979b0802acb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:10.319510 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae64cc9-f6e8-4435-af45-979b0802acb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:10.325452 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ae4ad-5fce-4d23-a85a-458b695d9fea None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:10.329912 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae64cc9-f6e8-4435-af45-979b0802acb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:10.334965 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-3ae64cc9-f6e8-4435-af45-979b0802acb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:41:10.334965 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:10.334965 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:10.334965 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:10.334965 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:10.334965 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:10.334965 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:10.334965 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:10.334965 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:10.334965 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:10.334965 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:10.334965 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:10.334965 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:10.334965 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:10.334965 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:10.334965 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:10.336002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:10.336002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:10.336002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:10.336002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:10.336002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:10.336002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:10.336002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:10.336002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:10.336002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:10.336002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:10.336002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:10.336002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:10.336002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:10.336002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:10.336002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:10.336002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:10.336927 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:10.336927 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:10.336927 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:10.336927 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:10.336927 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:10.336927 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:10.336927 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:10.336927 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:10.336927 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:10.336927 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:10.336927 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:41:10.336927 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:41:10.336927 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 37/67] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:41:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:10.337744 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf3856-e993-4883-82cb-4db53baa1d11 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:10.338007 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf3856-e993-4883-82cb-4db53baa1d11 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:10.338443 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf3856-e993-4883-82cb-4db53baa1d11 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:10.339817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 38/68] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:10.345365 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be464f0-bf72-4075-93a0-bfccd58c44a4 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:10.345799 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be464f0-bf72-4075-93a0-bfccd58c44a4 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:10.346247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be464f0-bf72-4075-93a0-bfccd58c44a4 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:10.347686 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 39/69] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:10.349445 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be464f0-bf72-4075-93a0-bfccd58c44a4 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:10.379240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c275c-b3cf-4427-9ce2-f708e87e47ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:10.379904 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c275c-b3cf-4427-9ce2-f708e87e47ac None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:10.380183 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c275c-b3cf-4427-9ce2-f708e87e47ac None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:10.380452 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c275c-b3cf-4427-9ce2-f708e87e47ac None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:10.381122 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c275c-b3cf-4427-9ce2-f708e87e47ac None admin] RBAC: Adding query filter params (name=member) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:10.381451 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c275c-b3cf-4427-9ce2-f708e87e47ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:10.382820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c275c-b3cf-4427-9ce2-f708e87e47ac None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:10.392243 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 31/70] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 7 10:41:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:10.393828 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce2de8-b929-4aa2-9490-e0fe47c3f671 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:10.394248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce2de8-b929-4aa2-9490-e0fe47c3f671 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:10.394658 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce2de8-b929-4aa2-9490-e0fe47c3f671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:10.416456 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-c9ce2de8-b929-4aa2-9490-e0fe47c3f671 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:10.417850 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-c9ce2de8-b929-4aa2-9490-e0fe47c3f671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:10.449949 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:10.460712 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be464f0-bf72-4075-93a0-bfccd58c44a4 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:10.485725 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 32/71] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:10.495687 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13bfb8-bac8-4bfd-a92d-d73be8fa8a81 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:10.495687 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13bfb8-bac8-4bfd-a92d-d73be8fa8a81 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:10.495687 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13bfb8-bac8-4bfd-a92d-d73be8fa8a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:10.498816 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1a0a8-e504-4fa8-981b-17e651e78a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:10.499419 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1a0a8-e504-4fa8-981b-17e651e78a94 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:10.499700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1a0a8-e504-4fa8-981b-17e651e78a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:10.499966 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1a0a8-e504-4fa8-981b-17e651e78a94 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:10.500631 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff1a0a8-e504-4fa8-981b-17e651e78a94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:10.500959 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff1a0a8-e504-4fa8-981b-17e651e78a94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:10.502385 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff1a0a8-e504-4fa8-981b-17e651e78a94 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:10.512148 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 40/72] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:10.512998 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1a0a8-e504-4fa8-981b-17e651e78a94 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:10.517016 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-7f13bfb8-bac8-4bfd-a92d-d73be8fa8a81 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:10.518263 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-7f13bfb8-bac8-4bfd-a92d-d73be8fa8a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:10.573019 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:10.595850 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 33/73] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:10.595850 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f2351-7ff9-4b34-b73c-34aa05f93e87 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:10.595850 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f2351-7ff9-4b34-b73c-34aa05f93e87 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:10.595850 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f2351-7ff9-4b34-b73c-34aa05f93e87 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:10.595850 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 34/74] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:10.595850 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f2351-7ff9-4b34-b73c-34aa05f93e87 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:10.622322 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1a0a8-e504-4fa8-981b-17e651e78a94 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:10.655523 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3374c-b35e-4384-9ec5-8ddb3cbcf31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:10.656152 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3374c-b35e-4384-9ec5-8ddb3cbcf31c None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:10.656433 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3374c-b35e-4384-9ec5-8ddb3cbcf31c None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:10.656704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3374c-b35e-4384-9ec5-8ddb3cbcf31c None admin] PATH_INFO: `/v3/users/ccd3dc17c64b4e27b6022912d758a62d` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:10.669713 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a3374c-b35e-4384-9ec5-8ddb3cbcf31c None admin] RBAC: Authorizing `identity:get_user(user_id=ccd3dc17c64b4e27b6022912d758a62d)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:10.671181 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a3374c-b35e-4384-9ec5-8ddb3cbcf31c None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:10.672831 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 41/75] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:10 2022] GET /identity/v3/users/ccd3dc17c64b4e27b6022912d758a62d => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:10.678223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3374c-b35e-4384-9ec5-8ddb3cbcf31c None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:10.689417 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:10.695043 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f2351-7ff9-4b34-b73c-34aa05f93e87 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:10.728271 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350ea4a-c16e-4c3b-bf0f-cb28e7c4eb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:10.728897 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350ea4a-c16e-4c3b-bf0f-cb28e7c4eb3c None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:10.729179 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350ea4a-c16e-4c3b-bf0f-cb28e7c4eb3c None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:10.729493 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350ea4a-c16e-4c3b-bf0f-cb28e7c4eb3c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:10.739972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350ea4a-c16e-4c3b-bf0f-cb28e7c4eb3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:10.744995 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-d350ea4a-c16e-4c3b-bf0f-cb28e7c4eb3c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 10:41:10.744995 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:10.744995 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:10.744995 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:10.744995 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:10.744995 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:10.744995 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:10.744995 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:10.744995 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:10.744995 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:10.744995 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:10.744995 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:10.744995 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:10.744995 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:10.744995 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:10.744995 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:10.746316 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:10.746316 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:10.746316 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:10.746316 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:10.746316 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:10.746316 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:10.746316 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:10.746316 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:10.746316 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:10.746316 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:10.746316 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:10.746316 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:10.746316 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:10.746316 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:10.746316 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:10.746316 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:10.747067 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:10.747067 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:10.747067 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:10.747067 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:10.747067 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:10.747067 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:10.747067 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:10.747067 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:10.747067 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:10.747067 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:10.747067 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 10:41:10.747067 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:41:10.747067 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 35/76] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 7 10:41:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:10.747680 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea034d-403f-431b-a275-a4ef967bd375 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:10.747680 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea034d-403f-431b-a275-a4ef967bd375 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:10.747801 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea034d-403f-431b-a275-a4ef967bd375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:10.764860 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-5cea034d-403f-431b-a275-a4ef967bd375 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:10.766106 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-5cea034d-403f-431b-a275-a4ef967bd375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:10.780975 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3374c-b35e-4384-9ec5-8ddb3cbcf31c None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:10.816665 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:10.817229 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a04a2f-3afc-466f-a4d5-599b75e108eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:10.817896 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a04a2f-3afc-466f-a4d5-599b75e108eb None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:10.818175 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a04a2f-3afc-466f-a4d5-599b75e108eb None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:10.818519 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a04a2f-3afc-466f-a4d5-599b75e108eb None admin] PATH_INFO: `/v3/users/fc0da4248e9e4613a07fa1302193fe96` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:10.819682 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a04a2f-3afc-466f-a4d5-599b75e108eb None admin] RBAC: Authorizing `identity:get_user(user_id=fc0da4248e9e4613a07fa1302193fe96)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:10.821138 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a04a2f-3afc-466f-a4d5-599b75e108eb None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:10.822755 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 42/77] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:10 2022] GET /identity/v3/users/fc0da4248e9e4613a07fa1302193fe96 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:10.823517 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a04a2f-3afc-466f-a4d5-599b75e108eb None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:10.838261 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 36/78] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:10.839169 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea034d-403f-431b-a275-a4ef967bd375 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:10.906970 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:10.929189 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a04a2f-3afc-466f-a4d5-599b75e108eb None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:10.938471 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea034d-403f-431b-a275-a4ef967bd375 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:10.962939 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69469324-f8ae-48d7-90c5-752042fc16fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:10.963567 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69469324-f8ae-48d7-90c5-752042fc16fb None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:10.963856 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69469324-f8ae-48d7-90c5-752042fc16fb None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:10.964132 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69469324-f8ae-48d7-90c5-752042fc16fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:10.972873 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbff4fd-d8d7-4415-837a-a1c9d71398bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:10.973506 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbff4fd-d8d7-4415-837a-a1c9d71398bf None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:10.973793 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbff4fd-d8d7-4415-837a-a1c9d71398bf None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:10.974065 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbff4fd-d8d7-4415-837a-a1c9d71398bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:10.974633 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69469324-f8ae-48d7-90c5-752042fc16fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:10.979273 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-69469324-f8ae-48d7-90c5-752042fc16fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:10.979273 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:10.979273 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:10.979273 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:10.979273 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:10.979273 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:10.979273 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:10.979273 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:10.979273 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:10.979273 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:10.979273 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:10.979273 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:10.979273 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:10.979273 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:10.979273 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:10.979273 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:10.980205 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:10.980205 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:10.980205 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:10.980205 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:10.980205 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:10.980205 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:10.980205 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:10.980205 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:10.980205 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:10.980205 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:10.980205 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:10.980205 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:10.980205 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:10.980205 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:10.980205 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:10.980205 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:10.980952 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:10.980952 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:10.980952 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:10.980952 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:10.980952 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:10.980952 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:10.980952 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:10.980952 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:10.980952 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:10.980952 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:10.980952 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:10.980952 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:41:10.980952 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 43/79] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:10.981623 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69469324-f8ae-48d7-90c5-752042fc16fb None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:11.021968 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:11.041975 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbff4fd-d8d7-4415-837a-a1c9d71398bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:11.043441 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbff4fd-d8d7-4415-837a-a1c9d71398bf None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:11.079130 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69469324-f8ae-48d7-90c5-752042fc16fb None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:11.113819 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630b109-0582-4bd0-a255-c20c52c5259c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:11.114418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630b109-0582-4bd0-a255-c20c52c5259c None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:11.114704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630b109-0582-4bd0-a255-c20c52c5259c None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:11.114975 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630b109-0582-4bd0-a255-c20c52c5259c None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:11.115643 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630b109-0582-4bd0-a255-c20c52c5259c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:11.115946 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630b109-0582-4bd0-a255-c20c52c5259c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:11.117376 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630b109-0582-4bd0-a255-c20c52c5259c None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:11.122512 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:11.126011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 44/80] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:41:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:11.127693 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630b109-0582-4bd0-a255-c20c52c5259c None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:11.154246 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 37/81] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:41:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:41:11.155196 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbff4fd-d8d7-4415-837a-a1c9d71398bf None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:11.238466 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:11.240869 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630b109-0582-4bd0-a255-c20c52c5259c None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:11.257860 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbff4fd-d8d7-4415-837a-a1c9d71398bf None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:11.275666 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c24a2-58f4-452c-84cd-5fcc6d18d2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:11.276275 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c24a2-58f4-452c-84cd-5fcc6d18d2db None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:11.276556 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c24a2-58f4-452c-84cd-5fcc6d18d2db None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:11.276828 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c24a2-58f4-452c-84cd-5fcc6d18d2db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:11.291506 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55963608-6be4-46ef-b073-10b60252014d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:11.292128 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55963608-6be4-46ef-b073-10b60252014d None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:11.292407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55963608-6be4-46ef-b073-10b60252014d None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:11.292682 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55963608-6be4-46ef-b073-10b60252014d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:11.293836 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55963608-6be4-46ef-b073-10b60252014d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:11.295273 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55963608-6be4-46ef-b073-10b60252014d None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:11.296855 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 38/82] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:41:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:11.297643 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55963608-6be4-46ef-b073-10b60252014d None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:11.345911 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:11.348762 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c24a2-58f4-452c-84cd-5fcc6d18d2db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:11.350314 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c24a2-58f4-452c-84cd-5fcc6d18d2db None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:11.398913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55963608-6be4-46ef-b073-10b60252014d None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:11.431919 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058878c0-4b5d-4dee-9dc7-f7afc7b5b6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:11.432517 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058878c0-4b5d-4dee-9dc7-f7afc7b5b6be None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:11.432801 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058878c0-4b5d-4dee-9dc7-f7afc7b5b6be None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:11.433076 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058878c0-4b5d-4dee-9dc7-f7afc7b5b6be None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:11.433782 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058878c0-4b5d-4dee-9dc7-f7afc7b5b6be None admin] RBAC: Adding query filter params (name=member) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:11.434089 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058878c0-4b5d-4dee-9dc7-f7afc7b5b6be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:11.435441 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058878c0-4b5d-4dee-9dc7-f7afc7b5b6be None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:11.443182 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 39/83] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 7 10:41:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:11.443963 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058878c0-4b5d-4dee-9dc7-f7afc7b5b6be None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:11.448733 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 45/84] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:41:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:41:11.449682 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c24a2-58f4-452c-84cd-5fcc6d18d2db None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:11.457392 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:11.545696 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058878c0-4b5d-4dee-9dc7-f7afc7b5b6be None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:11.557478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:11.560662 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c24a2-58f4-452c-84cd-5fcc6d18d2db None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:11.580016 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39481b-aeee-4941-aef7-4a7017abbfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:11.580660 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39481b-aeee-4941-aef7-4a7017abbfca None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:11.580938 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39481b-aeee-4941-aef7-4a7017abbfca None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:11.581211 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39481b-aeee-4941-aef7-4a7017abbfca None admin] PATH_INFO: `/v3/users/ccd3dc17c64b4e27b6022912d758a62d` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:11.582388 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39481b-aeee-4941-aef7-4a7017abbfca None admin] RBAC: Authorizing `identity:get_user(user_id=ccd3dc17c64b4e27b6022912d758a62d)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:11.583814 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39481b-aeee-4941-aef7-4a7017abbfca None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:11.585417 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 40/85] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:11 2022] GET /identity/v3/users/ccd3dc17c64b4e27b6022912d758a62d => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:11.586153 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39481b-aeee-4941-aef7-4a7017abbfca None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:11.595970 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8050c-be66-4cd8-a5db-8e7dc7931174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:11.596626 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8050c-be66-4cd8-a5db-8e7dc7931174 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:11.596907 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8050c-be66-4cd8-a5db-8e7dc7931174 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:11.597181 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8050c-be66-4cd8-a5db-8e7dc7931174 None admin] PATH_INFO: `/v3/projects/aba7d21adf714e6ab286c14428bafa1b` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:11.598343 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e8050c-be66-4cd8-a5db-8e7dc7931174 None admin] RBAC: Authorizing `identity:get_project(project_id=aba7d21adf714e6ab286c14428bafa1b)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:11.599798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e8050c-be66-4cd8-a5db-8e7dc7931174 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:11.601587 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 46/86] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:11 2022] GET /identity/v3/projects/aba7d21adf714e6ab286c14428bafa1b => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:11.602218 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8050c-be66-4cd8-a5db-8e7dc7931174 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:11.663030 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:11.684573 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39481b-aeee-4941-aef7-4a7017abbfca None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:11.699826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8050c-be66-4cd8-a5db-8e7dc7931174 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:11.717289 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256ec0c-394a-4920-9e84-f568276f9f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:11.717913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256ec0c-394a-4920-9e84-f568276f9f75 None admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:11.718190 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256ec0c-394a-4920-9e84-f568276f9f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:11.718461 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256ec0c-394a-4920-9e84-f568276f9f75 None admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:11.719101 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4256ec0c-394a-4920-9e84-f568276f9f75 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:11.720542 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4256ec0c-394a-4920-9e84-f568276f9f75 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:11.732255 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550067c5-a8fe-4cc8-91fd-649ed429f0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:11.732879 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550067c5-a8fe-4cc8-91fd-649ed429f0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:11.733159 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550067c5-a8fe-4cc8-91fd-649ed429f0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:11.733465 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550067c5-a8fe-4cc8-91fd-649ed429f0f9 None admin] PATH_INFO: `/v3/users/ccd3dc17c64b4e27b6022912d758a62d` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:11.734598 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550067c5-a8fe-4cc8-91fd-649ed429f0f9 None admin] RBAC: Authorizing `identity:get_user(user_id=ccd3dc17c64b4e27b6022912d758a62d)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:11.736021 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550067c5-a8fe-4cc8-91fd-649ed429f0f9 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:11.738198 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 47/87] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:11 2022] GET /identity/v3/users/ccd3dc17c64b4e27b6022912d758a62d => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:11.738198 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550067c5-a8fe-4cc8-91fd-649ed429f0f9 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:11.749332 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 41/88] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 7 10:41:11 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:41:11.749332 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256ec0c-394a-4920-9e84-f568276f9f75 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:11.792089 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:11.867771 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550067c5-a8fe-4cc8-91fd-649ed429f0f9 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:11.869771 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256ec0c-394a-4920-9e84-f568276f9f75 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:11.909622 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c22cf1-3cb5-480d-b696-9f3343709253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:11.910010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868c4c1-4da3-43b6-8f3d-6fe7f44f1f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:11.910122 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c22cf1-3cb5-480d-b696-9f3343709253 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:11.910281 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c22cf1-3cb5-480d-b696-9f3343709253 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:11.910557 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c22cf1-3cb5-480d-b696-9f3343709253 None admin] PATH_INFO: `/v3/projects/aba7d21adf714e6ab286c14428bafa1b` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:11.910648 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868c4c1-4da3-43b6-8f3d-6fe7f44f1f16 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:11.910889 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868c4c1-4da3-43b6-8f3d-6fe7f44f1f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:11.911163 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868c4c1-4da3-43b6-8f3d-6fe7f44f1f16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:11.912097 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c22cf1-3cb5-480d-b696-9f3343709253 None admin] RBAC: Authorizing `identity:get_project(project_id=aba7d21adf714e6ab286c14428bafa1b)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:11.913266 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c22cf1-3cb5-480d-b696-9f3343709253 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:11.914530 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:11.916307 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 48/89] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:11 2022] GET /identity/v3/projects/aba7d21adf714e6ab286c14428bafa1b => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:11.917423 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c22cf1-3cb5-480d-b696-9f3343709253 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:12.000354 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868c4c1-4da3-43b6-8f3d-6fe7f44f1f16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:12.003490 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868c4c1-4da3-43b6-8f3d-6fe7f44f1f16 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:12.038061 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c22cf1-3cb5-480d-b696-9f3343709253 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:12.042564 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:12.081483 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7e2af-f08b-4867-ac91-b65cf0f1eaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:12.082101 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7e2af-f08b-4867-ac91-b65cf0f1eaef None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:12.082380 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7e2af-f08b-4867-ac91-b65cf0f1eaef None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:12.082653 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7e2af-f08b-4867-ac91-b65cf0f1eaef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:12.083397 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7e2af-f08b-4867-ac91-b65cf0f1eaef None admin] RBAC: Adding query filter params (role.id=28e65a5027f7406cac824e6ff6474bb2, scope.project.id=aba7d21adf714e6ab286c14428bafa1b, user.id=ccd3dc17c64b4e27b6022912d758a62d) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:12.083839 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7e2af-f08b-4867-ac91-b65cf0f1eaef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:12.085517 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7e2af-f08b-4867-ac91-b65cf0f1eaef None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:12.091906 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 49/90] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:41:11 2022] GET /identity/v3/role_assignments?user.id=ccd3dc17c64b4e27b6022912d758a62d&scope.project.id=aba7d21adf714e6ab286c14428bafa1b&role.id=28e65a5027f7406cac824e6ff6474bb2 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:12.092609 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7e2af-f08b-4867-ac91-b65cf0f1eaef None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:12.140247 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 42/91] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:41:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:41:12.141507 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868c4c1-4da3-43b6-8f3d-6fe7f44f1f16 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:12.181465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:12.259873 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868c4c1-4da3-43b6-8f3d-6fe7f44f1f16 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:12.300341 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fd30e-3eb4-408d-8d09-0caccdb2eca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:12.300952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fd30e-3eb4-408d-8d09-0caccdb2eca8 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:12.301228 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fd30e-3eb4-408d-8d09-0caccdb2eca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:12.301528 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fd30e-3eb4-408d-8d09-0caccdb2eca8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:12.302262 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fd30e-3eb4-408d-8d09-0caccdb2eca8 None admin] RBAC: Adding query filter params (role.id=9da6e501237c405ca021a9d9f6173caf, scope.project.id=aba7d21adf714e6ab286c14428bafa1b, user.id=fc0da4248e9e4613a07fa1302193fe96) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:12.302563 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fd30e-3eb4-408d-8d09-0caccdb2eca8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:12.304005 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fd30e-3eb4-408d-8d09-0caccdb2eca8 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:12.321425 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 43/92] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:41:12 2022] GET /identity/v3/role_assignments?user.id=fc0da4248e9e4613a07fa1302193fe96&scope.project.id=aba7d21adf714e6ab286c14428bafa1b&role.id=9da6e501237c405ca021a9d9f6173caf => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:12.321425 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fd30e-3eb4-408d-8d09-0caccdb2eca8 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:12.327457 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7e2af-f08b-4867-ac91-b65cf0f1eaef None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:12.397138 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112dbbd-60e7-46ec-ad18-8aad6eee922c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:12.398179 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112dbbd-60e7-46ec-ad18-8aad6eee922c None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:12.400589 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112dbbd-60e7-46ec-ad18-8aad6eee922c None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:12.401018 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112dbbd-60e7-46ec-ad18-8aad6eee922c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:12.476105 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:12.515121 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112dbbd-60e7-46ec-ad18-8aad6eee922c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:12.519056 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112dbbd-60e7-46ec-ad18-8aad6eee922c None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:12.530447 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:12.538557 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fd30e-3eb4-408d-8d09-0caccdb2eca8 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:12.599610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb781da-64cd-4dec-837c-3c647be2d2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:12.600491 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb781da-64cd-4dec-837c-3c647be2d2dd None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:12.600933 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb781da-64cd-4dec-837c-3c647be2d2dd None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:12.601389 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb781da-64cd-4dec-837c-3c647be2d2dd None admin] PATH_INFO: `/v3/projects/aba7d21adf714e6ab286c14428bafa1b` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:12.605472 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb781da-64cd-4dec-837c-3c647be2d2dd None admin] RBAC: Authorizing `identity:get_project(project_id=aba7d21adf714e6ab286c14428bafa1b)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:12.607336 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb781da-64cd-4dec-837c-3c647be2d2dd None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:12.609416 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 44/93] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:12 2022] GET /identity/v3/projects/aba7d21adf714e6ab286c14428bafa1b => generated 298 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:12.615437 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb781da-64cd-4dec-837c-3c647be2d2dd None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:12.627998 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 50/94] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:41:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:41:12.634605 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112dbbd-60e7-46ec-ad18-8aad6eee922c None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:12.708251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:12.744207 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112dbbd-60e7-46ec-ad18-8aad6eee922c None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:12.775373 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb781da-64cd-4dec-837c-3c647be2d2dd None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:12.790694 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf03833-973e-430a-b6f8-87603ca65f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:12.791341 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf03833-973e-430a-b6f8-87603ca65f92 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:12.791621 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf03833-973e-430a-b6f8-87603ca65f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:12.791895 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf03833-973e-430a-b6f8-87603ca65f92 None admin] PATH_INFO: `/v3/projects/e38cfbae518841b8ad956c7c16403c5c` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:12.793081 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf03833-973e-430a-b6f8-87603ca65f92 None admin] RBAC: Authorizing `identity:get_project(project_id=e38cfbae518841b8ad956c7c16403c5c)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:12.796595 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf03833-973e-430a-b6f8-87603ca65f92 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:12.798432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 51/95] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:12 2022] GET /identity/v3/projects/e38cfbae518841b8ad956c7c16403c5c => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:12.804409 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf03833-973e-430a-b6f8-87603ca65f92 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:12.851262 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9b7f4-e7ee-478e-abf9-16a6f35ad590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:12.852279 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9b7f4-e7ee-478e-abf9-16a6f35ad590 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:12.852773 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9b7f4-e7ee-478e-abf9-16a6f35ad590 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:12.853526 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9b7f4-e7ee-478e-abf9-16a6f35ad590 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:12.854272 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9b7f4-e7ee-478e-abf9-16a6f35ad590 None admin] RBAC: Adding query filter params (role.id=4269d6d5c6c048728859af681b3610fb, scope.project.id=aba7d21adf714e6ab286c14428bafa1b, user.id=ccd3dc17c64b4e27b6022912d758a62d) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:12.854579 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9b7f4-e7ee-478e-abf9-16a6f35ad590 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:12.856030 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9b7f4-e7ee-478e-abf9-16a6f35ad590 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:12.875612 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 45/96] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:41:12 2022] GET /identity/v3/role_assignments?user.id=ccd3dc17c64b4e27b6022912d758a62d&scope.project.id=aba7d21adf714e6ab286c14428bafa1b&role.id=4269d6d5c6c048728859af681b3610fb => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:41:12.939449 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf03833-973e-430a-b6f8-87603ca65f92 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:12.975773 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590dd70c-40da-4020-a0ba-80cfd542cce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:12.976307 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590dd70c-40da-4020-a0ba-80cfd542cce1 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:12.976587 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590dd70c-40da-4020-a0ba-80cfd542cce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:12.976859 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590dd70c-40da-4020-a0ba-80cfd542cce1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:12.977711 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590dd70c-40da-4020-a0ba-80cfd542cce1 None admin] RBAC: Adding query filter params (role.id=28e65a5027f7406cac824e6ff6474bb2, scope.project.id=e38cfbae518841b8ad956c7c16403c5c, user.id=ccd3dc17c64b4e27b6022912d758a62d) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:12.978018 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590dd70c-40da-4020-a0ba-80cfd542cce1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:12.979493 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590dd70c-40da-4020-a0ba-80cfd542cce1 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:12.983100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:12.989695 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 52/97] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:41:12 2022] GET /identity/v3/role_assignments?user.id=ccd3dc17c64b4e27b6022912d758a62d&scope.project.id=e38cfbae518841b8ad956c7c16403c5c&role.id=28e65a5027f7406cac824e6ff6474bb2 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:14.307700 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415d7d1-4371-4b7c-aa39-8db2ec94647a None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:14.308205 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415d7d1-4371-4b7c-aa39-8db2ec94647a None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:14.308276 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415d7d1-4371-4b7c-aa39-8db2ec94647a None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:14.309644 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 46/98] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:14.315765 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01ccae-7fcd-4cf6-9eeb-86bc74077621 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:14.316190 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01ccae-7fcd-4cf6-9eeb-86bc74077621 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:14.316379 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01ccae-7fcd-4cf6-9eeb-86bc74077621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:14.345485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-2b01ccae-7fcd-4cf6-9eeb-86bc74077621 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:14.347249 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-2b01ccae-7fcd-4cf6-9eeb-86bc74077621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:14.435934 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 53/99] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:14.476881 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415d7d1-4371-4b7c-aa39-8db2ec94647a None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:14.510444 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:14.603165 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415d7d1-4371-4b7c-aa39-8db2ec94647a None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:14.638420 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e18847-c5ab-4f27-91a4-4fdc8ac196cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:14.639041 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e18847-c5ab-4f27-91a4-4fdc8ac196cf None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:14.639325 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e18847-c5ab-4f27-91a4-4fdc8ac196cf None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:14.639592 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e18847-c5ab-4f27-91a4-4fdc8ac196cf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:14.651005 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e18847-c5ab-4f27-91a4-4fdc8ac196cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:14.655740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-37e18847-c5ab-4f27-91a4-4fdc8ac196cf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 10:41:14.655740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:14.655740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:14.655740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:14.655740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:14.655740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:14.655740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:14.655740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:14.655740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:14.655740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:14.655740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:14.655740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:14.655740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:14.655740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:14.655740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:14.655740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:14.656591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:14.656591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:14.656591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:14.656591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:14.656591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:14.656591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:14.656591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:14.656591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:14.656591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:14.656591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:14.656591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:14.656591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:14.656591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:14.656591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:14.656591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:14.656591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:14.657554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:14.657554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:14.657554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:14.657554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:14.657554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:14.657554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:14.657554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:14.657554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:14.657554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:14.657554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:14.657554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 10:41:14.657554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:41:14.657554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 47/100] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:14.663263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01ccae-7fcd-4cf6-9eeb-86bc74077621 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:14.834868 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36800f-9a4b-4bea-9968-53a920a1406b None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:14.835300 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36800f-9a4b-4bea-9968-53a920a1406b None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:14.835686 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36800f-9a4b-4bea-9968-53a920a1406b None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:14.837118 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 48/101] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:14.855646 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212ed5e-4b01-4251-b1cd-9f58c41f8425 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:14.855869 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212ed5e-4b01-4251-b1cd-9f58c41f8425 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:14.856117 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212ed5e-4b01-4251-b1cd-9f58c41f8425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:14.856693 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01ccae-7fcd-4cf6-9eeb-86bc74077621 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:14.887816 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-c212ed5e-4b01-4251-b1cd-9f58c41f8425 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:14.889074 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-c212ed5e-4b01-4251-b1cd-9f58c41f8425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:14.918909 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:14.929861 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251e13f-250a-4c4f-b747-0b7de6cb9d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:14.930474 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251e13f-250a-4c4f-b747-0b7de6cb9d72 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:14.930755 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251e13f-250a-4c4f-b747-0b7de6cb9d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:14.931035 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251e13f-250a-4c4f-b747-0b7de6cb9d72 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:14.931763 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251e13f-250a-4c4f-b747-0b7de6cb9d72 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:14.932071 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251e13f-250a-4c4f-b747-0b7de6cb9d72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:14.933472 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251e13f-250a-4c4f-b747-0b7de6cb9d72 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:14.950585 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 54/102] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 7 10:41:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:14.956801 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251e13f-250a-4c4f-b747-0b7de6cb9d72 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:14.982930 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 49/103] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:15.024077 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212ed5e-4b01-4251-b1cd-9f58c41f8425 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:15.066337 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:15.150380 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212ed5e-4b01-4251-b1cd-9f58c41f8425 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:15.190969 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac866805-66f7-4757-9b9d-aa6758a91016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:15.191728 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac866805-66f7-4757-9b9d-aa6758a91016 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:15.192014 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac866805-66f7-4757-9b9d-aa6758a91016 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:15.192293 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac866805-66f7-4757-9b9d-aa6758a91016 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:15.193567 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac866805-66f7-4757-9b9d-aa6758a91016 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:15.195016 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac866805-66f7-4757-9b9d-aa6758a91016 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:15.197012 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 50/104] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:41:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:15.206521 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac866805-66f7-4757-9b9d-aa6758a91016 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:15.215263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251e13f-250a-4c4f-b747-0b7de6cb9d72 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:15.288696 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53914160-25ca-4c5e-9ea1-160c9c870165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:15.289407 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53914160-25ca-4c5e-9ea1-160c9c870165 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:15.289697 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53914160-25ca-4c5e-9ea1-160c9c870165 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:15.289967 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53914160-25ca-4c5e-9ea1-160c9c870165 None admin] PATH_INFO: `/v3/users/c473e6b736f44ac0abbcdbe14efc4dd7` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:15.321297 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53914160-25ca-4c5e-9ea1-160c9c870165 None admin] RBAC: Authorizing `identity:get_user(user_id=c473e6b736f44ac0abbcdbe14efc4dd7)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:15.322810 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53914160-25ca-4c5e-9ea1-160c9c870165 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:15.329912 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 55/105] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:14 2022] GET /identity/v3/users/c473e6b736f44ac0abbcdbe14efc4dd7 => generated 289 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:15.332269 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53914160-25ca-4c5e-9ea1-160c9c870165 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:15.378854 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:15.400294 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac866805-66f7-4757-9b9d-aa6758a91016 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:15.457439 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:15.491756 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8c4ce-ac89-4140-8267-45ac37693c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:15.492798 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8c4ce-ac89-4140-8267-45ac37693c91 None admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:15.493089 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8c4ce-ac89-4140-8267-45ac37693c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:15.493399 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8c4ce-ac89-4140-8267-45ac37693c91 None admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:15.494323 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e8c4ce-ac89-4140-8267-45ac37693c91 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:15.496879 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e8c4ce-ac89-4140-8267-45ac37693c91 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:15.556297 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 51/106] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 7 10:41:15 2022] POST /identity/v3/projects => generated 302 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:41:15.559732 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef54574-eb95-4bb6-b608-540782555382 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:15.559732 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef54574-eb95-4bb6-b608-540782555382 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:15.559732 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef54574-eb95-4bb6-b608-540782555382 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:15.559732 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 52/107] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:15.568177 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67463d-5e29-48c4-bd30-0c3b6a2f3707 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:15.568462 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67463d-5e29-48c4-bd30-0c3b6a2f3707 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:15.568747 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67463d-5e29-48c4-bd30-0c3b6a2f3707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:15.585350 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53914160-25ca-4c5e-9ea1-160c9c870165 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:15.615380 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-1b67463d-5e29-48c4-bd30-0c3b6a2f3707 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:15.616601 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-1b67463d-5e29-48c4-bd30-0c3b6a2f3707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:15.653346 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d6a16-4005-436c-aaa8-52b4b306b05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:15.653346 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d6a16-4005-436c-aaa8-52b4b306b05c None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:15.653346 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d6a16-4005-436c-aaa8-52b4b306b05c None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:15.653346 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d6a16-4005-436c-aaa8-52b4b306b05c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:15.766860 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 53/108] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:15.768800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44f3f6-303a-4ac0-8117-d3ac1c5fff2d None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:15.768800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44f3f6-303a-4ac0-8117-d3ac1c5fff2d None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:15.768956 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44f3f6-303a-4ac0-8117-d3ac1c5fff2d None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:15.772998 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 54/109] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:15.785340 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8048c07-5830-41af-bab1-f8c7ef7f148f None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:15.785340 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8048c07-5830-41af-bab1-f8c7ef7f148f None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:15.785340 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8048c07-5830-41af-bab1-f8c7ef7f148f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:15.813289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d6a16-4005-436c-aaa8-52b4b306b05c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:15.825554 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d6a16-4005-436c-aaa8-52b4b306b05c None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:15.831324 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-a8048c07-5830-41af-bab1-f8c7ef7f148f None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:15.832532 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-a8048c07-5830-41af-bab1-f8c7ef7f148f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:15.916807 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:15.928258 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:15.933960 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 55/110] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:15.935018 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8048c07-5830-41af-bab1-f8c7ef7f148f None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:16.016642 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 56/111] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:41:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:41:16.018849 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cf58d-d895-49f1-ab1b-959df551e5ee None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:16.019719 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cf58d-d895-49f1-ab1b-959df551e5ee None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:16.019998 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cf58d-d895-49f1-ab1b-959df551e5ee None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:16.021413 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 57/112] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:16.024133 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cf58d-d895-49f1-ab1b-959df551e5ee None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:16.059330 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8048c07-5830-41af-bab1-f8c7ef7f148f None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:16.098554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e621042-7838-48ce-8edf-bca6a649d0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:16.099650 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e621042-7838-48ce-8edf-bca6a649d0f5 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:16.100129 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e621042-7838-48ce-8edf-bca6a649d0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:16.100621 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e621042-7838-48ce-8edf-bca6a649d0f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:16.122045 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e621042-7838-48ce-8edf-bca6a649d0f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:16.126847 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-9e621042-7838-48ce-8edf-bca6a649d0f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:16.126847 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:16.126847 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:16.126847 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:16.126847 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:16.126847 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:16.126847 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:16.126847 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:16.126847 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:16.126847 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:16.126847 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:16.126847 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:16.126847 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:16.126847 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:16.126847 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:16.126847 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:16.127745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:16.127745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:16.127745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:16.127745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:16.127745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:16.127745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:16.127745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:16.127745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:16.127745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:16.127745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:16.127745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:16.127745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:16.127745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:16.127745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:16.127745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:16.127745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:16.128549 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:16.128549 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:16.128549 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:16.128549 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:16.128549 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:16.128549 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:16.128549 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:16.128549 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:16.128549 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:16.128549 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:16.128549 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:16.128549 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:41:16.128549 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 56/113] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:16.142684 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24a03d-ac18-43e0-9a48-a65543e8f1e8 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:16.143499 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24a03d-ac18-43e0-9a48-a65543e8f1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:16.143781 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24a03d-ac18-43e0-9a48-a65543e8f1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:16.165914 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cf58d-d895-49f1-ab1b-959df551e5ee None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:16.190214 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-de24a03d-ac18-43e0-9a48-a65543e8f1e8 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:16.191862 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-de24a03d-ac18-43e0-9a48-a65543e8f1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:16.213132 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c344a-4a7f-434e-846f-47e2e1ab968c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:16.214079 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c344a-4a7f-434e-846f-47e2e1ab968c None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:16.214433 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c344a-4a7f-434e-846f-47e2e1ab968c None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:16.214723 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c344a-4a7f-434e-846f-47e2e1ab968c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:16.226058 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c344a-4a7f-434e-846f-47e2e1ab968c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:16.230817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-d36c344a-4a7f-434e-846f-47e2e1ab968c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:41:16.230817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:16.230817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:16.230817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:16.230817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:16.230817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:16.230817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:16.230817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:16.230817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:16.230817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:16.230817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:16.230817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:16.230817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:16.230817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:16.230817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:16.230817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:16.231653 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:16.231653 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:16.231653 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:16.231653 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:16.231653 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:16.231653 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:16.231653 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:16.231653 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:16.231653 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:16.231653 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:16.231653 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:16.231653 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:16.231653 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:16.231653 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:16.231653 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:16.231653 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:16.232412 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:16.232412 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:16.232412 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:16.232412 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:16.232412 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:16.232412 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:16.232412 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:16.232412 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:16.232412 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:16.232412 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:16.232412 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:41:16.232412 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:41:16.232412 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 58/114] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:41:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:16.233037 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c344a-4a7f-434e-846f-47e2e1ab968c None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:16.250797 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:16.265441 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:16.289407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 57/115] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:16.289407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24a03d-ac18-43e0-9a48-a65543e8f1e8 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:16.363157 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c344a-4a7f-434e-846f-47e2e1ab968c None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:16.395803 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24a03d-ac18-43e0-9a48-a65543e8f1e8 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:16.399617 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5638e6-056e-4614-b77d-228652fcd942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:16.400242 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5638e6-056e-4614-b77d-228652fcd942 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:16.400520 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5638e6-056e-4614-b77d-228652fcd942 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:16.400793 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5638e6-056e-4614-b77d-228652fcd942 None admin] PATH_INFO: `/v3/projects/aba7d21adf714e6ab286c14428bafa1b` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:16.401949 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5638e6-056e-4614-b77d-228652fcd942 None admin] RBAC: Authorizing `identity:get_project(project_id=aba7d21adf714e6ab286c14428bafa1b)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:16.403416 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5638e6-056e-4614-b77d-228652fcd942 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:16.405061 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 59/116] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:16 2022] GET /identity/v3/projects/aba7d21adf714e6ab286c14428bafa1b => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:16.406207 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6ab02-e137-4400-af62-1807ac0430e0 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:16.406490 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6ab02-e137-4400-af62-1807ac0430e0 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:16.406762 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6ab02-e137-4400-af62-1807ac0430e0 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:16.412430 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 60/117] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:16.412430 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6ab02-e137-4400-af62-1807ac0430e0 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:16.438492 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42aee9-2f8c-4569-bc7d-2bb8a8d11fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:16.439198 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42aee9-2f8c-4569-bc7d-2bb8a8d11fcc None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:16.439485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42aee9-2f8c-4569-bc7d-2bb8a8d11fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:16.440277 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42aee9-2f8c-4569-bc7d-2bb8a8d11fcc None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:16.440984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42aee9-2f8c-4569-bc7d-2bb8a8d11fcc None admin] RBAC: Adding query filter params (name=member) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:16.441261 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42aee9-2f8c-4569-bc7d-2bb8a8d11fcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:16.442722 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42aee9-2f8c-4569-bc7d-2bb8a8d11fcc None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:16.452856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 58/118] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 7 10:41:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:16.457384 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42aee9-2f8c-4569-bc7d-2bb8a8d11fcc None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:16.509803 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:16.521446 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:16.536296 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6ab02-e137-4400-af62-1807ac0430e0 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:16.569216 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42aee9-2f8c-4569-bc7d-2bb8a8d11fcc None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:16.571056 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba5f72-b9c4-4bbb-9552-4e37aa20e9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:16.571771 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba5f72-b9c4-4bbb-9552-4e37aa20e9aa None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:16.572050 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba5f72-b9c4-4bbb-9552-4e37aa20e9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:16.572319 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba5f72-b9c4-4bbb-9552-4e37aa20e9aa None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:16.572979 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba5f72-b9c4-4bbb-9552-4e37aa20e9aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:16.573279 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba5f72-b9c4-4bbb-9552-4e37aa20e9aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:16.574700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba5f72-b9c4-4bbb-9552-4e37aa20e9aa None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:16.587591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 61/119] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:16.587591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba5f72-b9c4-4bbb-9552-4e37aa20e9aa None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:16.608408 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164948bd-c10f-4041-9e56-a914e04a250c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:16.609032 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164948bd-c10f-4041-9e56-a914e04a250c None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:16.609334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164948bd-c10f-4041-9e56-a914e04a250c None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:16.609659 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164948bd-c10f-4041-9e56-a914e04a250c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:16.620768 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164948bd-c10f-4041-9e56-a914e04a250c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:16.625508 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-164948bd-c10f-4041-9e56-a914e04a250c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 10:41:16.625508 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:16.625508 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:16.625508 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:16.625508 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:16.625508 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:16.625508 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:16.625508 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:16.625508 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:16.625508 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:16.625508 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:16.625508 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:16.625508 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:16.625508 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:16.625508 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:16.625508 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:16.626390 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:16.626390 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:16.626390 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:16.626390 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:16.626390 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:16.626390 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:16.626390 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:16.626390 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:16.626390 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:16.626390 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:16.626390 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:16.626390 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:16.626390 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:16.626390 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:16.626390 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:16.626390 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:16.628109 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:16.628109 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:16.628109 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:16.628109 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:16.628109 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:16.628109 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:16.628109 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:16.628109 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:16.628109 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:16.628109 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:16.628109 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 10:41:16.628109 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:41:16.628109 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 59/120] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 7 10:41:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:16.632956 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af81f77-2f79-466f-8110-770053f47d9f None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:16.633214 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af81f77-2f79-466f-8110-770053f47d9f None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:16.633514 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af81f77-2f79-466f-8110-770053f47d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:16.651214 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-2af81f77-2f79-466f-8110-770053f47d9f None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:16.652391 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-2af81f77-2f79-466f-8110-770053f47d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:16.691696 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba5f72-b9c4-4bbb-9552-4e37aa20e9aa None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:16.725353 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 60/121] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:16.725353 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af81f77-2f79-466f-8110-770053f47d9f None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:16.731554 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e518c-5a91-49a1-8e83-8eafa04cb134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:16.732203 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e518c-5a91-49a1-8e83-8eafa04cb134 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:16.732485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e518c-5a91-49a1-8e83-8eafa04cb134 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:16.732758 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e518c-5a91-49a1-8e83-8eafa04cb134 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:16.733570 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e518c-5a91-49a1-8e83-8eafa04cb134 None admin] RBAC: Adding query filter params (role.id=e9b673af6fc14dfe8c0762885c21da92, scope.project.id=aba7d21adf714e6ab286c14428bafa1b, user.id=c473e6b736f44ac0abbcdbe14efc4dd7) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:16.733876 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e518c-5a91-49a1-8e83-8eafa04cb134 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:16.735411 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e518c-5a91-49a1-8e83-8eafa04cb134 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:16.749016 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 62/122] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:41:16 2022] GET /identity/v3/role_assignments?user.id=c473e6b736f44ac0abbcdbe14efc4dd7&scope.project.id=aba7d21adf714e6ab286c14428bafa1b&role.id=e9b673af6fc14dfe8c0762885c21da92 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:16.749016 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e518c-5a91-49a1-8e83-8eafa04cb134 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:16.751136 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:16.788904 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:16.870544 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af81f77-2f79-466f-8110-770053f47d9f None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:16.884244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e518c-5a91-49a1-8e83-8eafa04cb134 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:16.922125 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e46f6d-76b1-4338-b7fa-df1511e8411c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:16.922796 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e46f6d-76b1-4338-b7fa-df1511e8411c None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:16.923077 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e46f6d-76b1-4338-b7fa-df1511e8411c None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:16.923352 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e46f6d-76b1-4338-b7fa-df1511e8411c None admin] PATH_INFO: `/v3/users/ccd3dc17c64b4e27b6022912d758a62d` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:16.925494 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e46f6d-76b1-4338-b7fa-df1511e8411c None admin] RBAC: Authorizing `identity:get_user(user_id=ccd3dc17c64b4e27b6022912d758a62d)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:16.926966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e46f6d-76b1-4338-b7fa-df1511e8411c None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:16.928586 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 61/123] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:16 2022] GET /identity/v3/users/ccd3dc17c64b4e27b6022912d758a62d => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:16.928947 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4ac08-25c0-4f4b-9945-ef489d4859bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:16.929374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e46f6d-76b1-4338-b7fa-df1511e8411c None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:16.930220 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4ac08-25c0-4f4b-9945-ef489d4859bb None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:16.930701 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4ac08-25c0-4f4b-9945-ef489d4859bb None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:16.931218 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4ac08-25c0-4f4b-9945-ef489d4859bb None admin] PATH_INFO: `/v3/users/fc0da4248e9e4613a07fa1302193fe96` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:16.932782 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf4ac08-25c0-4f4b-9945-ef489d4859bb None admin] RBAC: Authorizing `identity:get_user(user_id=fc0da4248e9e4613a07fa1302193fe96)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:16.935008 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf4ac08-25c0-4f4b-9945-ef489d4859bb None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:16.936731 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 63/124] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:16 2022] GET /identity/v3/users/fc0da4248e9e4613a07fa1302193fe96 => generated 247 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:16.937389 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4ac08-25c0-4f4b-9945-ef489d4859bb None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:17.020782 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:17.054181 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4ac08-25c0-4f4b-9945-ef489d4859bb None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:17.068704 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e46f6d-76b1-4338-b7fa-df1511e8411c None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:17.082838 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:17.093840 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0628dc-dc61-42df-8a4b-879355365fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:17.094844 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0628dc-dc61-42df-8a4b-879355365fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:17.095313 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0628dc-dc61-42df-8a4b-879355365fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:17.095912 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0628dc-dc61-42df-8a4b-879355365fa4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:17.107979 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0628dc-dc61-42df-8a4b-879355365fa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:17.111329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8077bf-7e14-4ed7-8a9b-25b063dca701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:17.112025 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8077bf-7e14-4ed7-8a9b-25b063dca701 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:17.112302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8077bf-7e14-4ed7-8a9b-25b063dca701 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:17.112570 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8077bf-7e14-4ed7-8a9b-25b063dca701 None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:17.113234 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8077bf-7e14-4ed7-8a9b-25b063dca701 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:17.113564 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8077bf-7e14-4ed7-8a9b-25b063dca701 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:17.114923 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8077bf-7e14-4ed7-8a9b-25b063dca701 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:17.115669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-2b0628dc-dc61-42df-8a4b-879355365fa4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:17.115669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:17.115669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:17.115669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:17.115669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:17.115669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:17.115669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:17.115669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:17.115669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:17.115669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:17.115669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:17.115669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:17.115669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:17.115669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:17.115669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:17.115669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:17.116480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:17.116480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:17.116480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:17.116480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:17.116480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:17.116480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:17.116480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:17.116480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:17.116480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:17.116480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:17.116480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:17.116480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:17.116480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:17.116480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:17.116480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:17.116480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:17.117247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:17.117247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:17.117247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:17.117247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:17.117247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:17.117247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:17.117247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:17.117247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:17.117247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:17.117247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:17.117247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:17.117247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:41:17.125006 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 62/125] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:41:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:17.125006 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8077bf-7e14-4ed7-8a9b-25b063dca701 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:17.125600 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 64/126] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:17.126839 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0628dc-dc61-42df-8a4b-879355365fa4 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:17.253974 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8077bf-7e14-4ed7-8a9b-25b063dca701 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:17.257418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0628dc-dc61-42df-8a4b-879355365fa4 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:17.290135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505ad3d-5fb3-4716-8c48-c541bd52ff0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:17.291089 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505ad3d-5fb3-4716-8c48-c541bd52ff0f None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:17.291584 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505ad3d-5fb3-4716-8c48-c541bd52ff0f None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:17.292053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505ad3d-5fb3-4716-8c48-c541bd52ff0f None admin] PATH_INFO: `/v3/projects/aba7d21adf714e6ab286c14428bafa1b` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:17.293443 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505ad3d-5fb3-4716-8c48-c541bd52ff0f None admin] RBAC: Authorizing `identity:get_project(project_id=aba7d21adf714e6ab286c14428bafa1b)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:17.294237 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:17.295826 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505ad3d-5fb3-4716-8c48-c541bd52ff0f None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:17.298589 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 63/127] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:17 2022] GET /identity/v3/projects/aba7d21adf714e6ab286c14428bafa1b => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:17.300207 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505ad3d-5fb3-4716-8c48-c541bd52ff0f None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:17.307348 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1d10e-cd11-4776-940d-0597fe803003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:17.307993 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1d10e-cd11-4776-940d-0597fe803003 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:17.308273 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1d10e-cd11-4776-940d-0597fe803003 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:17.308544 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1d10e-cd11-4776-940d-0597fe803003 None admin] PATH_INFO: `/v3/projects/aba7d21adf714e6ab286c14428bafa1b` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:17.309715 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead1d10e-cd11-4776-940d-0597fe803003 None admin] RBAC: Authorizing `identity:get_project(project_id=aba7d21adf714e6ab286c14428bafa1b)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:17.311175 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead1d10e-cd11-4776-940d-0597fe803003 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:17.317424 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 65/128] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:17 2022] GET /identity/v3/projects/aba7d21adf714e6ab286c14428bafa1b => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:17.318447 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1d10e-cd11-4776-940d-0597fe803003 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:17.360915 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:17.436197 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1d10e-cd11-4776-940d-0597fe803003 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:17.442044 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505ad3d-5fb3-4716-8c48-c541bd52ff0f None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:17.474273 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b4f9c-7deb-4f98-8ce0-b19a2f9712b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:17.475331 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b4f9c-7deb-4f98-8ce0-b19a2f9712b3 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:17.475800 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b4f9c-7deb-4f98-8ce0-b19a2f9712b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:17.476261 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b4f9c-7deb-4f98-8ce0-b19a2f9712b3 None admin] PATH_INFO: `/v3/users/ccd3dc17c64b4e27b6022912d758a62d` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:17.477724 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b4f9c-7deb-4f98-8ce0-b19a2f9712b3 None admin] RBAC: Authorizing `identity:get_user(user_id=ccd3dc17c64b4e27b6022912d758a62d)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:17.479442 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b4f9c-7deb-4f98-8ce0-b19a2f9712b3 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:17.481552 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 66/129] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:17 2022] GET /identity/v3/users/ccd3dc17c64b4e27b6022912d758a62d => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:17.487515 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b4f9c-7deb-4f98-8ce0-b19a2f9712b3 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:17.489652 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902f42e-bb66-4c92-a565-bb0ee4be29eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:17.490318 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902f42e-bb66-4c92-a565-bb0ee4be29eb None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:17.490598 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902f42e-bb66-4c92-a565-bb0ee4be29eb None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:17.490924 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902f42e-bb66-4c92-a565-bb0ee4be29eb None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:17.491918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902f42e-bb66-4c92-a565-bb0ee4be29eb None admin] RBAC: Adding query filter params (name=member) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:17.492221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902f42e-bb66-4c92-a565-bb0ee4be29eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:17.494702 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902f42e-bb66-4c92-a565-bb0ee4be29eb None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:17.509357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 64/130] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 7 10:41:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:17.514991 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902f42e-bb66-4c92-a565-bb0ee4be29eb None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:17.564277 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:17.602573 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b4f9c-7deb-4f98-8ce0-b19a2f9712b3 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:17.639549 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699724b1-af00-4e86-b5b5-9a96469b3437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:17.640181 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699724b1-af00-4e86-b5b5-9a96469b3437 None admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:17.640460 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699724b1-af00-4e86-b5b5-9a96469b3437 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:17.640733 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699724b1-af00-4e86-b5b5-9a96469b3437 None admin] PATH_INFO: `/v3/projects/aba7d21adf714e6ab286c14428bafa1b/users/ccd3dc17c64b4e27b6022912d758a62d/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:17.642703 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699724b1-af00-4e86-b5b5-9a96469b3437 None admin] RBAC: Authorizing `identity:create_grant(project_id=aba7d21adf714e6ab286c14428bafa1b, user_id=ccd3dc17c64b4e27b6022912d758a62d, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:17.644816 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699724b1-af00-4e86-b5b5-9a96469b3437 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:17.659525 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902f42e-bb66-4c92-a565-bb0ee4be29eb None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:17.661663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:17.669351 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 67/131] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 7 10:41:17 2022] PUT /identity/v3/projects/aba7d21adf714e6ab286c14428bafa1b/users/ccd3dc17c64b4e27b6022912d758a62d/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:41:17.669351 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699724b1-af00-4e86-b5b5-9a96469b3437 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:17.734092 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75728544-557c-4660-a784-bf7ef6ee30dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:17.735084 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75728544-557c-4660-a784-bf7ef6ee30dc None admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:17.735603 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75728544-557c-4660-a784-bf7ef6ee30dc None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:17.736082 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75728544-557c-4660-a784-bf7ef6ee30dc None admin] PATH_INFO: `/v3/projects/aba7d21adf714e6ab286c14428bafa1b/users/fc0da4248e9e4613a07fa1302193fe96/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:17.740998 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75728544-557c-4660-a784-bf7ef6ee30dc None admin] RBAC: Authorizing `identity:create_grant(project_id=aba7d21adf714e6ab286c14428bafa1b, user_id=fc0da4248e9e4613a07fa1302193fe96, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:17.742713 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75728544-557c-4660-a784-bf7ef6ee30dc None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:17.780990 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 65/132] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 7 10:41:17 2022] PUT /identity/v3/projects/aba7d21adf714e6ab286c14428bafa1b/users/fc0da4248e9e4613a07fa1302193fe96/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:41:17.782346 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75728544-557c-4660-a784-bf7ef6ee30dc None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:17.794962 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699724b1-af00-4e86-b5b5-9a96469b3437 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:17.844713 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:17.848992 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf931d-284c-43e5-8043-42c001fe4c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:17.849901 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf931d-284c-43e5-8043-42c001fe4c6b None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:17.850287 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf931d-284c-43e5-8043-42c001fe4c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:17.850717 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf931d-284c-43e5-8043-42c001fe4c6b None admin] PATH_INFO: `/v3/projects/aba7d21adf714e6ab286c14428bafa1b` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:17.852460 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf931d-284c-43e5-8043-42c001fe4c6b None admin] RBAC: Authorizing `identity:get_project(project_id=aba7d21adf714e6ab286c14428bafa1b)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:17.856230 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf931d-284c-43e5-8043-42c001fe4c6b None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:17.862919 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 68/133] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:17 2022] GET /identity/v3/projects/aba7d21adf714e6ab286c14428bafa1b => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:17.864431 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294a48b-1918-4107-a626-7bf80b2e4560 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:17.864722 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294a48b-1918-4107-a626-7bf80b2e4560 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:17.866203 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294a48b-1918-4107-a626-7bf80b2e4560 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:17.872671 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 69/134] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:17.873301 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294a48b-1918-4107-a626-7bf80b2e4560 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:17.983368 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75728544-557c-4660-a784-bf7ef6ee30dc None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:18.027592 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd138485-8477-4ab3-8328-51084b6e94e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:18.028640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd138485-8477-4ab3-8328-51084b6e94e0 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:18.029029 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd138485-8477-4ab3-8328-51084b6e94e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:18.029306 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd138485-8477-4ab3-8328-51084b6e94e0 None admin] PATH_INFO: `/v3/users/ccd3dc17c64b4e27b6022912d758a62d` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:18.030542 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd138485-8477-4ab3-8328-51084b6e94e0 None admin] RBAC: Authorizing `identity:get_user(user_id=ccd3dc17c64b4e27b6022912d758a62d)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:18.032197 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd138485-8477-4ab3-8328-51084b6e94e0 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:18.034620 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 66/135] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:17 2022] GET /identity/v3/users/ccd3dc17c64b4e27b6022912d758a62d => generated 275 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:18.035892 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae647bb-2e8a-4f6b-8c59-3e9db166d4cc None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:18.036177 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae647bb-2e8a-4f6b-8c59-3e9db166d4cc None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:18.036451 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae647bb-2e8a-4f6b-8c59-3e9db166d4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:18.040318 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294a48b-1918-4107-a626-7bf80b2e4560 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:18.055450 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-8ae647bb-2e8a-4f6b-8c59-3e9db166d4cc None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:18.056718 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-8ae647bb-2e8a-4f6b-8c59-3e9db166d4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:18.082854 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:18.084055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee7af3-afd7-4456-a60d-e8585289d70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:18.085158 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee7af3-afd7-4456-a60d-e8585289d70c None admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:18.085690 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee7af3-afd7-4456-a60d-e8585289d70c None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:18.086131 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee7af3-afd7-4456-a60d-e8585289d70c None admin] PATH_INFO: `/v3/projects/aba7d21adf714e6ab286c14428bafa1b/users/ccd3dc17c64b4e27b6022912d758a62d/roles/4269d6d5c6c048728859af681b3610fb` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:18.090228 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee7af3-afd7-4456-a60d-e8585289d70c None admin] RBAC: Authorizing `identity:create_grant(project_id=aba7d21adf714e6ab286c14428bafa1b, user_id=ccd3dc17c64b4e27b6022912d758a62d, role_id=4269d6d5c6c048728859af681b3610fb)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:18.091896 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee7af3-afd7-4456-a60d-e8585289d70c None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:18.107943 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 70/136] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 7 10:41:17 2022] PUT /identity/v3/projects/aba7d21adf714e6ab286c14428bafa1b/users/ccd3dc17c64b4e27b6022912d758a62d/roles/4269d6d5c6c048728859af681b3610fb => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:41:18.109141 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee7af3-afd7-4456-a60d-e8585289d70c None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:18.173285 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 67/137] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:18.218827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae647bb-2e8a-4f6b-8c59-3e9db166d4cc None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:18.229580 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:18.303093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee7af3-afd7-4456-a60d-e8585289d70c None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:18.346191 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5524a-e832-4356-a2ca-89caf2ff39c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:18.346866 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5524a-e832-4356-a2ca-89caf2ff39c9 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:18.347142 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5524a-e832-4356-a2ca-89caf2ff39c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:18.347428 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5524a-e832-4356-a2ca-89caf2ff39c9 None admin] PATH_INFO: `/v3/projects/e38cfbae518841b8ad956c7c16403c5c` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:18.348592 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5524a-e832-4356-a2ca-89caf2ff39c9 None admin] RBAC: Authorizing `identity:get_project(project_id=e38cfbae518841b8ad956c7c16403c5c)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:18.350103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5524a-e832-4356-a2ca-89caf2ff39c9 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:18.351752 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 71/138] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:18 2022] GET /identity/v3/projects/e38cfbae518841b8ad956c7c16403c5c => generated 312 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:18.357461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5524a-e832-4356-a2ca-89caf2ff39c9 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:18.414652 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae647bb-2e8a-4f6b-8c59-3e9db166d4cc None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:18.502306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5524a-e832-4356-a2ca-89caf2ff39c9 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:18.502816 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81587c0b-8a07-40c2-b5f0-f64f6d59dec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:18.503305 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81587c0b-8a07-40c2-b5f0-f64f6d59dec5 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:18.503576 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81587c0b-8a07-40c2-b5f0-f64f6d59dec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:18.503844 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81587c0b-8a07-40c2-b5f0-f64f6d59dec5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:18.510011 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81587c0b-8a07-40c2-b5f0-f64f6d59dec5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:18.511476 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81587c0b-8a07-40c2-b5f0-f64f6d59dec5 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:18.513089 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 68/139] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:41:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:41:18.522833 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81587c0b-8a07-40c2-b5f0-f64f6d59dec5 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:18.550729 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:18.577998 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:18.579316 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfb6445-b847-4735-aca0-e58d2c158de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:18.580002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb6445-b847-4735-aca0-e58d2c158de2 None admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:18.580280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb6445-b847-4735-aca0-e58d2c158de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:18.580802 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfb6445-b847-4735-aca0-e58d2c158de2 None admin] PATH_INFO: `/v3/projects/e38cfbae518841b8ad956c7c16403c5c/users/ccd3dc17c64b4e27b6022912d758a62d/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:18.583503 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfb6445-b847-4735-aca0-e58d2c158de2 None admin] RBAC: Authorizing `identity:create_grant(project_id=e38cfbae518841b8ad956c7c16403c5c, user_id=ccd3dc17c64b4e27b6022912d758a62d, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:18.585097 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfb6445-b847-4735-aca0-e58d2c158de2 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:18.607546 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 72/140] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 7 10:41:18 2022] PUT /identity/v3/projects/e38cfbae518841b8ad956c7c16403c5c/users/ccd3dc17c64b4e27b6022912d758a62d/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:41:18.709936 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81587c0b-8a07-40c2-b5f0-f64f6d59dec5 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:18.748974 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06db596-c9be-49ec-bc1e-6f83d72611ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:18.750136 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06db596-c9be-49ec-bc1e-6f83d72611ea None admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:18.750610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06db596-c9be-49ec-bc1e-6f83d72611ea None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:18.751089 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06db596-c9be-49ec-bc1e-6f83d72611ea None admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:18.751972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06db596-c9be-49ec-bc1e-6f83d72611ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:18.754364 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06db596-c9be-49ec-bc1e-6f83d72611ea None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:18.785380 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 69/141] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 7 10:41:18 2022] POST /identity/v3/users => generated 283 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 10:41:19.251880 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6aabc-057d-4862-bf7f-35f34420f617 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:19.252382 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6aabc-057d-4862-bf7f-35f34420f617 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:19.252550 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6aabc-057d-4862-bf7f-35f34420f617 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:19.254053 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 73/142] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:19.259111 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50703dbc-a3f0-49b8-b609-2db2fd918118 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:19.259624 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50703dbc-a3f0-49b8-b609-2db2fd918118 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:19.260087 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50703dbc-a3f0-49b8-b609-2db2fd918118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:19.286545 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-50703dbc-a3f0-49b8-b609-2db2fd918118 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:19.288207 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-50703dbc-a3f0-49b8-b609-2db2fd918118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:19.375498 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 70/143] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:19.401227 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6aabc-057d-4862-bf7f-35f34420f617 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:19.523638 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6aabc-057d-4862-bf7f-35f34420f617 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:19.563510 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131558ce-5f08-4736-9996-452fbfce364a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:19.564138 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131558ce-5f08-4736-9996-452fbfce364a None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:19.564413 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131558ce-5f08-4736-9996-452fbfce364a None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:19.565215 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131558ce-5f08-4736-9996-452fbfce364a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:19.582181 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131558ce-5f08-4736-9996-452fbfce364a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:19.587480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-131558ce-5f08-4736-9996-452fbfce364a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 10:41:19.587480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:19.587480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:19.587480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:19.587480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:19.587480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:19.587480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:19.587480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:19.587480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:19.587480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:19.587480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:19.587480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:19.587480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:19.587480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:19.587480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:19.587480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:19.588332 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:19.588332 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:19.588332 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:19.588332 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:19.588332 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:19.588332 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:19.588332 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:19.588332 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:19.588332 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:19.588332 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:19.588332 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:19.588332 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:19.588332 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:19.588332 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:19.588332 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:19.588332 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:19.589085 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:19.589085 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:19.589085 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:19.589085 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:19.589085 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:19.589085 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:19.589085 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:19.589085 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:19.589085 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:19.589085 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:19.589085 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 10:41:19.589085 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:41:19.589085 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 74/144] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:19.594445 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50703dbc-a3f0-49b8-b609-2db2fd918118 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:19.626810 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:19.731459 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50703dbc-a3f0-49b8-b609-2db2fd918118 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:19.772023 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43cf49-41f0-400b-9572-3118e2bfd2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:19.772631 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43cf49-41f0-400b-9572-3118e2bfd2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:19.772904 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43cf49-41f0-400b-9572-3118e2bfd2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:19.773172 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43cf49-41f0-400b-9572-3118e2bfd2a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:19.773936 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43cf49-41f0-400b-9572-3118e2bfd2a3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:19.774185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43cf49-41f0-400b-9572-3118e2bfd2a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:19.775530 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43cf49-41f0-400b-9572-3118e2bfd2a3 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:19.784010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 71/145] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 7 10:41:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:19.790221 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131558ce-5f08-4736-9996-452fbfce364a None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:19.841994 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:19.908571 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131558ce-5f08-4736-9996-452fbfce364a None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:19.944874 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04e89d-d0e1-4032-a0ee-ad109193e79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:19.945546 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04e89d-d0e1-4032-a0ee-ad109193e79b None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:19.945830 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04e89d-d0e1-4032-a0ee-ad109193e79b None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:19.946104 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04e89d-d0e1-4032-a0ee-ad109193e79b None admin] PATH_INFO: `/v3/users/c473e6b736f44ac0abbcdbe14efc4dd7` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:19.947257 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04e89d-d0e1-4032-a0ee-ad109193e79b None admin] RBAC: Authorizing `identity:get_user(user_id=c473e6b736f44ac0abbcdbe14efc4dd7)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:19.948725 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04e89d-d0e1-4032-a0ee-ad109193e79b None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:19.950341 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 75/146] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:19 2022] GET /identity/v3/users/c473e6b736f44ac0abbcdbe14efc4dd7 => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:19.956614 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43cf49-41f0-400b-9572-3118e2bfd2a3 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:20.045569 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:20.075264 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43cf49-41f0-400b-9572-3118e2bfd2a3 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:20.117598 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e8e82-bd86-4d6c-9b74-965d8f6b9440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:20.118238 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e8e82-bd86-4d6c-9b74-965d8f6b9440 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:20.118523 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e8e82-bd86-4d6c-9b74-965d8f6b9440 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:20.119055 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e8e82-bd86-4d6c-9b74-965d8f6b9440 None admin] PATH_INFO: `/v3/projects/aba7d21adf714e6ab286c14428bafa1b` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:20.120292 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e8e82-bd86-4d6c-9b74-965d8f6b9440 None admin] RBAC: Authorizing `identity:get_project(project_id=aba7d21adf714e6ab286c14428bafa1b)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:20.121769 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e8e82-bd86-4d6c-9b74-965d8f6b9440 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:20.123426 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 72/147] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:19 2022] GET /identity/v3/projects/aba7d21adf714e6ab286c14428bafa1b => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:20.130062 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04e89d-d0e1-4032-a0ee-ad109193e79b None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:20.257363 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04e89d-d0e1-4032-a0ee-ad109193e79b None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:20.273790 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:20.304495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149fab5-8384-4612-98b4-26d8ada61b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:20.305518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149fab5-8384-4612-98b4-26d8ada61b45 None admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:20.305995 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149fab5-8384-4612-98b4-26d8ada61b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:20.306460 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149fab5-8384-4612-98b4-26d8ada61b45 None admin] PATH_INFO: `/v3/projects/aba7d21adf714e6ab286c14428bafa1b/users/c473e6b736f44ac0abbcdbe14efc4dd7/roles/e9b673af6fc14dfe8c0762885c21da92` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:20.308622 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149fab5-8384-4612-98b4-26d8ada61b45 None admin] RBAC: Authorizing `identity:create_grant(project_id=aba7d21adf714e6ab286c14428bafa1b, user_id=c473e6b736f44ac0abbcdbe14efc4dd7, role_id=e9b673af6fc14dfe8c0762885c21da92)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:20.310301 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149fab5-8384-4612-98b4-26d8ada61b45 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:20.338178 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 76/148] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 7 10:41:20 2022] PUT /identity/v3/projects/aba7d21adf714e6ab286c14428bafa1b/users/c473e6b736f44ac0abbcdbe14efc4dd7/roles/e9b673af6fc14dfe8c0762885c21da92 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:41:20.448752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3493f-57de-4286-a526-047b5ebb306a None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:20.449040 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3493f-57de-4286-a526-047b5ebb306a None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:20.449655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3493f-57de-4286-a526-047b5ebb306a None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:20.451430 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 73/149] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:20.459128 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b974ded-1727-4371-b17f-8c60a057e875 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:20.459457 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b974ded-1727-4371-b17f-8c60a057e875 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:20.459679 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b974ded-1727-4371-b17f-8c60a057e875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:20.486536 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-6b974ded-1727-4371-b17f-8c60a057e875 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:20.488530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-6b974ded-1727-4371-b17f-8c60a057e875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:20.578012 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 77/150] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:20.610795 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3493f-57de-4286-a526-047b5ebb306a None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:20.692365 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a91531-676c-4d71-9556-02a31fef9439 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:20.692679 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a91531-676c-4d71-9556-02a31fef9439 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:20.692913 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a91531-676c-4d71-9556-02a31fef9439 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:20.694546 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 78/151] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:20.704242 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c5a00-ff52-4759-85c9-d98f09072f96 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:20.704520 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c5a00-ff52-4759-85c9-d98f09072f96 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:20.704794 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c5a00-ff52-4759-85c9-d98f09072f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:20.742347 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-c40c5a00-ff52-4759-85c9-d98f09072f96 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:20.743788 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-c40c5a00-ff52-4759-85c9-d98f09072f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:20.765832 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3493f-57de-4286-a526-047b5ebb306a None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:20.828187 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80dc2f-2f54-48ea-b9bc-f8fd32a62adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:20.829262 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80dc2f-2f54-48ea-b9bc-f8fd32a62adc None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:20.829789 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80dc2f-2f54-48ea-b9bc-f8fd32a62adc None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:20.830260 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80dc2f-2f54-48ea-b9bc-f8fd32a62adc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:20.854649 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 79/152] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 07 10:41:20.856324 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80dc2f-2f54-48ea-b9bc-f8fd32a62adc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:20.862054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-ef80dc2f-2f54-48ea-b9bc-f8fd32a62adc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:20.862054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:20.862054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:20.862054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:20.862054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:20.862054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:20.862054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:20.862054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:20.862054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:20.862054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:20.862054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:20.862054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:20.862054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:20.862054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:20.862054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:20.862054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:20.862918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:20.862918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:20.862918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:20.862918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:20.862918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:20.862918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:20.862918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:20.862918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:20.862918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:20.862918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:20.862918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:20.862918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:20.862918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:20.862918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:20.862918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:20.862918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:20.863684 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:20.863684 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:20.863684 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:20.863684 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:20.863684 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:20.863684 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:20.863684 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:20.863684 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:20.863684 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:20.863684 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:20.863684 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:20.863684 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:41:20.871249 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 74/153] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:20.879010 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c5a00-ff52-4759-85c9-d98f09072f96 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:20.901642 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80dc2f-2f54-48ea-b9bc-f8fd32a62adc None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:20.907292 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:20.921726 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:21.026103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c5a00-ff52-4759-85c9-d98f09072f96 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:21.078291 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a9214-5a98-43e4-910a-1786891ad4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:21.078832 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a9214-5a98-43e4-910a-1786891ad4c2 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:21.079109 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a9214-5a98-43e4-910a-1786891ad4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:21.079379 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a9214-5a98-43e4-910a-1786891ad4c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:21.080064 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a9214-5a98-43e4-910a-1786891ad4c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:21.080425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a9214-5a98-43e4-910a-1786891ad4c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:21.088835 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a9214-5a98-43e4-910a-1786891ad4c2 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:21.107692 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 80/154] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 7 10:41:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:21.113706 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a9214-5a98-43e4-910a-1786891ad4c2 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:21.136648 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80dc2f-2f54-48ea-b9bc-f8fd32a62adc None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:21.265771 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:21.277741 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a9214-5a98-43e4-910a-1786891ad4c2 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:21.278567 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904881a-d458-43ed-abf7-6bf404fbdcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:21.279453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904881a-d458-43ed-abf7-6bf404fbdcf2 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:21.279929 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904881a-d458-43ed-abf7-6bf404fbdcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:21.280452 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5904881a-d458-43ed-abf7-6bf404fbdcf2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:21.306305 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5904881a-d458-43ed-abf7-6bf404fbdcf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:21.311813 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-5904881a-d458-43ed-abf7-6bf404fbdcf2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:41:21.311813 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:21.311813 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:21.311813 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:21.311813 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:21.311813 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:21.311813 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:21.311813 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:21.311813 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:21.311813 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:21.311813 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:21.311813 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:21.311813 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:21.311813 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:21.311813 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:21.311813 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:21.312653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:21.312653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:21.312653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:21.312653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:21.312653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:21.312653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:21.312653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:21.312653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:21.312653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:21.312653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:21.312653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:21.312653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:21.312653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:21.312653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:21.312653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:21.312653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:21.313662 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:21.313662 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:21.313662 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:21.313662 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:21.313662 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:21.313662 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:21.313662 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:21.313662 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:21.313662 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:21.313662 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:21.313662 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:41:21.313662 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:41:21.316021 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 75/155] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:41:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 415 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:41:21.322411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904881a-d458-43ed-abf7-6bf404fbdcf2 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:21.326191 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53769c88-f510-4857-b35a-6a5b22394826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:21.326843 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53769c88-f510-4857-b35a-6a5b22394826 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:21.327123 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53769c88-f510-4857-b35a-6a5b22394826 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:21.327395 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53769c88-f510-4857-b35a-6a5b22394826 None admin] PATH_INFO: `/v3/users/ccd3dc17c64b4e27b6022912d758a62d` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:21.329513 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53769c88-f510-4857-b35a-6a5b22394826 None admin] RBAC: Authorizing `identity:get_user(user_id=ccd3dc17c64b4e27b6022912d758a62d)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:21.331553 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53769c88-f510-4857-b35a-6a5b22394826 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:21.333155 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 81/156] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:21 2022] GET /identity/v3/users/ccd3dc17c64b4e27b6022912d758a62d => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:41:21.346774 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53769c88-f510-4857-b35a-6a5b22394826 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:21.499488 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53769c88-f510-4857-b35a-6a5b22394826 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:21.545689 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:21.549573 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d0985-a233-46a0-adf3-e729c391718d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:21.550252 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d0985-a233-46a0-adf3-e729c391718d None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:21.550471 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d0985-a233-46a0-adf3-e729c391718d None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:21.550744 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d0985-a233-46a0-adf3-e729c391718d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:21.597844 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:21.654999 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d0985-a233-46a0-adf3-e729c391718d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:21.656691 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d0985-a233-46a0-adf3-e729c391718d None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:21.657940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5904881a-d458-43ed-abf7-6bf404fbdcf2 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:21.706061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1991a-7c4f-4803-aa72-de8565322a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:21.706858 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1991a-7c4f-4803-aa72-de8565322a30 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:21.707229 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1991a-7c4f-4803-aa72-de8565322a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:21.707718 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1991a-7c4f-4803-aa72-de8565322a30 None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:21.708619 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1991a-7c4f-4803-aa72-de8565322a30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:21.709119 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1991a-7c4f-4803-aa72-de8565322a30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:21.710720 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1991a-7c4f-4803-aa72-de8565322a30 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:21.719440 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 76/157] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:41:21.725653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf05c4-8715-407f-9aa6-e0a46cace9e1 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:21.726180 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf05c4-8715-407f-9aa6-e0a46cace9e1 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:21.726650 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf05c4-8715-407f-9aa6-e0a46cace9e1 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:21.728126 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 77/158] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:21.729064 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf05c4-8715-407f-9aa6-e0a46cace9e1 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:21.816571 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 82/159] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:41:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:41:21.818119 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9cb99-d2d3-4d5d-bebd-08ad90cd47cd None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:21.818544 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9cb99-d2d3-4d5d-bebd-08ad90cd47cd None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:21.818994 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9cb99-d2d3-4d5d-bebd-08ad90cd47cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:21.850195 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-50a9cb99-d2d3-4d5d-bebd-08ad90cd47cd None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:21.851660 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-50a9cb99-d2d3-4d5d-bebd-08ad90cd47cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:21.876165 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf05c4-8715-407f-9aa6-e0a46cace9e1 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:21.909503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:21.921413 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8f694-2ac5-4f25-95aa-0a2e4afb052e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:21.922056 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8f694-2ac5-4f25-95aa-0a2e4afb052e None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:21.922333 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8f694-2ac5-4f25-95aa-0a2e4afb052e None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:21.922602 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8f694-2ac5-4f25-95aa-0a2e4afb052e None admin] PATH_INFO: `/v3/users/fc0da4248e9e4613a07fa1302193fe96` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:21.923808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8f694-2ac5-4f25-95aa-0a2e4afb052e None admin] RBAC: Authorizing `identity:get_user(user_id=fc0da4248e9e4613a07fa1302193fe96)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:21.925817 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8f694-2ac5-4f25-95aa-0a2e4afb052e None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:21.927434 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 78/160] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:21 2022] GET /identity/v3/users/fc0da4248e9e4613a07fa1302193fe96 => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:21.931048 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8f694-2ac5-4f25-95aa-0a2e4afb052e None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:21.954164 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:21.977024 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 83/161] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:21.978289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9cb99-d2d3-4d5d-bebd-08ad90cd47cd None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:22.137038 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8f694-2ac5-4f25-95aa-0a2e4afb052e None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:22.143507 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9cb99-d2d3-4d5d-bebd-08ad90cd47cd None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:22.182885 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5061077-fb30-4ef1-9254-f2e245fbf4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:22.183493 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5061077-fb30-4ef1-9254-f2e245fbf4cf None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:22.183773 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5061077-fb30-4ef1-9254-f2e245fbf4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:22.184046 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5061077-fb30-4ef1-9254-f2e245fbf4cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:22.218237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856e009-dd38-474a-9bc5-bdebba91ad10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:22.218869 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856e009-dd38-474a-9bc5-bdebba91ad10 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:22.219146 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856e009-dd38-474a-9bc5-bdebba91ad10 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:22.219415 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856e009-dd38-474a-9bc5-bdebba91ad10 None admin] PATH_INFO: `/v3/projects/aba7d21adf714e6ab286c14428bafa1b` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:22.221430 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856e009-dd38-474a-9bc5-bdebba91ad10 None admin] RBAC: Authorizing `identity:get_project(project_id=aba7d21adf714e6ab286c14428bafa1b)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:22.224890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856e009-dd38-474a-9bc5-bdebba91ad10 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:22.229496 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 79/162] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:21 2022] GET /identity/v3/projects/aba7d21adf714e6ab286c14428bafa1b => generated 298 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:22.234890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856e009-dd38-474a-9bc5-bdebba91ad10 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:22.285629 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:22.305280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5061077-fb30-4ef1-9254-f2e245fbf4cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:22.307716 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5061077-fb30-4ef1-9254-f2e245fbf4cf None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:22.352644 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:22.401361 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856e009-dd38-474a-9bc5-bdebba91ad10 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:22.441665 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8822386-c034-4566-9b6f-21121f1e560b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:22.442354 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8822386-c034-4566-9b6f-21121f1e560b None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:22.442641 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8822386-c034-4566-9b6f-21121f1e560b None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:22.442916 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8822386-c034-4566-9b6f-21121f1e560b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:22.461697 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8822386-c034-4566-9b6f-21121f1e560b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:22.466945 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-c8822386-c034-4566-9b6f-21121f1e560b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 10:41:22.466945 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:22.466945 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:22.466945 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:22.466945 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:22.466945 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:22.466945 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:22.466945 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:22.466945 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:22.466945 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:22.466945 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:22.466945 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:22.466945 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:22.466945 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:22.466945 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:22.466945 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:22.467840 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:22.467840 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:22.467840 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:22.467840 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:22.467840 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:22.467840 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:22.467840 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:22.467840 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:22.467840 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:22.467840 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:22.467840 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:22.467840 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:22.467840 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:22.467840 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:22.467840 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:22.467840 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:22.468653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:22.468653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:22.468653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:22.468653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:22.468653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:22.468653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:22.468653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:22.468653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:22.468653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:22.468653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:22.468653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 10:41:22.468653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:41:22.468653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 80/163] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 7 10:41:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:22.474086 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8822386-c034-4566-9b6f-21121f1e560b None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:22.541995 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 84/164] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:41:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:41:22.546280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5061077-fb30-4ef1-9254-f2e245fbf4cf None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:22.681059 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8822386-c034-4566-9b6f-21121f1e560b None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:22.725858 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:22.730262 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:22.742554 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5061077-fb30-4ef1-9254-f2e245fbf4cf None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:22.755100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11f5ef-5f60-4ae9-893b-cb55ca0a28d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:22.755714 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11f5ef-5f60-4ae9-893b-cb55ca0a28d4 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:22.755991 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11f5ef-5f60-4ae9-893b-cb55ca0a28d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:22.756264 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11f5ef-5f60-4ae9-893b-cb55ca0a28d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:22.757001 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11f5ef-5f60-4ae9-893b-cb55ca0a28d4 None admin] RBAC: Adding query filter params (role.id=28e65a5027f7406cac824e6ff6474bb2, scope.project.id=aba7d21adf714e6ab286c14428bafa1b, user.id=ccd3dc17c64b4e27b6022912d758a62d) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:22.757307 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11f5ef-5f60-4ae9-893b-cb55ca0a28d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:22.758773 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11f5ef-5f60-4ae9-893b-cb55ca0a28d4 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:22.770080 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 81/165] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:41:22 2022] GET /identity/v3/role_assignments?user.id=ccd3dc17c64b4e27b6022912d758a62d&scope.project.id=aba7d21adf714e6ab286c14428bafa1b&role.id=28e65a5027f7406cac824e6ff6474bb2 => generated 608 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:22.778356 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11f5ef-5f60-4ae9-893b-cb55ca0a28d4 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:22.828951 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a522e-7d87-4f24-b052-4b6e17e781cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:22.829598 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a522e-7d87-4f24-b052-4b6e17e781cc None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:22.829943 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a522e-7d87-4f24-b052-4b6e17e781cc None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:22.830882 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a522e-7d87-4f24-b052-4b6e17e781cc None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:22.831604 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a522e-7d87-4f24-b052-4b6e17e781cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:22.831911 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a522e-7d87-4f24-b052-4b6e17e781cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:22.833293 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a522e-7d87-4f24-b052-4b6e17e781cc None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:22.852176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 85/166] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:41:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:22.852176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f726220-7b9d-4f65-81ae-f00019044e34 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:22.852176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f726220-7b9d-4f65-81ae-f00019044e34 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:22.852176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f726220-7b9d-4f65-81ae-f00019044e34 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:22.853426 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 86/167] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:22.854402 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f726220-7b9d-4f65-81ae-f00019044e34 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:23.076221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11f5ef-5f60-4ae9-893b-cb55ca0a28d4 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:23.092864 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f726220-7b9d-4f65-81ae-f00019044e34 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:23.124740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af06e1-15ab-45cf-9e06-e6a61638487b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:23.125395 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af06e1-15ab-45cf-9e06-e6a61638487b None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:23.125673 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af06e1-15ab-45cf-9e06-e6a61638487b None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:23.125941 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af06e1-15ab-45cf-9e06-e6a61638487b None admin] PATH_INFO: `/v3/projects/aba7d21adf714e6ab286c14428bafa1b` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:23.128264 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af06e1-15ab-45cf-9e06-e6a61638487b None admin] RBAC: Authorizing `identity:get_project(project_id=aba7d21adf714e6ab286c14428bafa1b)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:23.129824 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af06e1-15ab-45cf-9e06-e6a61638487b None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:23.132007 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 82/168] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:22 2022] GET /identity/v3/projects/aba7d21adf714e6ab286c14428bafa1b => generated 298 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:23.132993 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202daae0-6246-4064-92d8-5b4e272162bc None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:23.133379 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202daae0-6246-4064-92d8-5b4e272162bc None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:23.133560 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202daae0-6246-4064-92d8-5b4e272162bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:23.157235 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e1372-7557-4ee7-9e77-001572566e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:23.157944 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e1372-7557-4ee7-9e77-001572566e6e None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:23.158221 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e1372-7557-4ee7-9e77-001572566e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:23.159049 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e1372-7557-4ee7-9e77-001572566e6e None admin] PATH_INFO: `/v3/users/ccd3dc17c64b4e27b6022912d758a62d` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:23.160915 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e1372-7557-4ee7-9e77-001572566e6e None admin] RBAC: Authorizing `identity:get_user(user_id=ccd3dc17c64b4e27b6022912d758a62d)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:23.162677 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e1372-7557-4ee7-9e77-001572566e6e None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:23.164260 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 87/169] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:22 2022] GET /identity/v3/users/ccd3dc17c64b4e27b6022912d758a62d => generated 275 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:23.165092 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e1372-7557-4ee7-9e77-001572566e6e None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:23.167425 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-202daae0-6246-4064-92d8-5b4e272162bc None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:23.168838 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-202daae0-6246-4064-92d8-5b4e272162bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:23.204877 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:23.265338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:23.293668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 83/170] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:23.295885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202daae0-6246-4064-92d8-5b4e272162bc None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:23.309156 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e1372-7557-4ee7-9e77-001572566e6e None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:23.388698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111bf2b-4516-4931-8a1f-c4c232860c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:23.389421 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111bf2b-4516-4931-8a1f-c4c232860c13 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:23.389722 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111bf2b-4516-4931-8a1f-c4c232860c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:23.389973 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111bf2b-4516-4931-8a1f-c4c232860c13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:23.390714 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111bf2b-4516-4931-8a1f-c4c232860c13 None admin] RBAC: Adding query filter params (role.id=9da6e501237c405ca021a9d9f6173caf, scope.project.id=aba7d21adf714e6ab286c14428bafa1b, user.id=fc0da4248e9e4613a07fa1302193fe96) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:23.391020 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111bf2b-4516-4931-8a1f-c4c232860c13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:23.392630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111bf2b-4516-4931-8a1f-c4c232860c13 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:23.401108 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 88/171] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:41:23 2022] GET /identity/v3/role_assignments?user.id=fc0da4248e9e4613a07fa1302193fe96&scope.project.id=aba7d21adf714e6ab286c14428bafa1b&role.id=9da6e501237c405ca021a9d9f6173caf => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:23.406385 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111bf2b-4516-4931-8a1f-c4c232860c13 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:23.533608 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202daae0-6246-4064-92d8-5b4e272162bc None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:23.556090 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:23.581134 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111bf2b-4516-4931-8a1f-c4c232860c13 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:23.618397 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940740f-47c2-44f3-bbbb-591c70c7a0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:23.619292 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940740f-47c2-44f3-bbbb-591c70c7a0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:23.619566 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940740f-47c2-44f3-bbbb-591c70c7a0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:23.619834 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940740f-47c2-44f3-bbbb-591c70c7a0a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:23.650932 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9895a12-e4e0-41b3-8955-2a0478c5a182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:23.651603 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9895a12-e4e0-41b3-8955-2a0478c5a182 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:23.651891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9895a12-e4e0-41b3-8955-2a0478c5a182 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:23.652163 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9895a12-e4e0-41b3-8955-2a0478c5a182 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:23.670070 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9895a12-e4e0-41b3-8955-2a0478c5a182 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:23.675820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-f9895a12-e4e0-41b3-8955-2a0478c5a182 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:23.675820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:23.675820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:23.675820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:23.675820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:23.675820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:23.675820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:23.675820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:23.675820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:23.675820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:23.675820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:23.675820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:23.675820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:23.675820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:23.675820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:23.675820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:23.676764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:23.676764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:23.676764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:23.676764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:23.676764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:23.676764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:23.676764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:23.676764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:23.676764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:23.676764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:23.676764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:23.676764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:23.676764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:23.676764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:23.676764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:23.676764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:23.677581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:23.677581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:23.677581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:23.677581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:23.677581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:23.677581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:23.677581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:23.677581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:23.677581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:23.677581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:23.677581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:23.677581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:41:23.677581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 89/172] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:23.682668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd30a6f-26b3-43b5-b638-f3dfcd12e65a None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:23.682947 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd30a6f-26b3-43b5-b638-f3dfcd12e65a None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:23.683268 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd30a6f-26b3-43b5-b638-f3dfcd12e65a None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:23.684786 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 90/173] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:23.690518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd30a6f-26b3-43b5-b638-f3dfcd12e65a None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:23.741864 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:23.766655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940740f-47c2-44f3-bbbb-591c70c7a0a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:23.768707 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940740f-47c2-44f3-bbbb-591c70c7a0a3 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:23.901060 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd30a6f-26b3-43b5-b638-f3dfcd12e65a None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:23.945843 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 84/174] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:41:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:41:23.946926 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2552d9-d0c1-4896-9d3b-356f30868604 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:23.947206 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2552d9-d0c1-4896-9d3b-356f30868604 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:23.947553 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2552d9-d0c1-4896-9d3b-356f30868604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:23.961870 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b1d2d-7b68-4cdb-a88a-74f09fae7ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:23.962841 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b1d2d-7b68-4cdb-a88a-74f09fae7ade None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:23.963321 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b1d2d-7b68-4cdb-a88a-74f09fae7ade None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:23.963795 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b1d2d-7b68-4cdb-a88a-74f09fae7ade None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:23.964763 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b1d2d-7b68-4cdb-a88a-74f09fae7ade None admin] RBAC: Adding query filter params (name=member) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:23.965265 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b1d2d-7b68-4cdb-a88a-74f09fae7ade None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:23.966944 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b1d2d-7b68-4cdb-a88a-74f09fae7ade None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:23.972641 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-ea2552d9-d0c1-4896-9d3b-356f30868604 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:23.974709 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-ea2552d9-d0c1-4896-9d3b-356f30868604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:23.977664 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 91/175] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 7 10:41:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:23.984517 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b1d2d-7b68-4cdb-a88a-74f09fae7ade None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:24.008008 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:24.067016 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 85/176] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:24.068947 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f93caf-d8c9-4966-9ae9-4c0c4317bb56 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:24.069644 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f93caf-d8c9-4966-9ae9-4c0c4317bb56 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:24.070118 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f93caf-d8c9-4966-9ae9-4c0c4317bb56 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:24.072493 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 86/177] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:24.077930 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f93caf-d8c9-4966-9ae9-4c0c4317bb56 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:24.099291 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:24.108765 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b1d2d-7b68-4cdb-a88a-74f09fae7ade None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:24.148156 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18fb781-526e-4ee6-be87-7d43b756ed4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:24.148777 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fb781-526e-4ee6-be87-7d43b756ed4f None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:24.149057 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fb781-526e-4ee6-be87-7d43b756ed4f None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:24.149354 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fb781-526e-4ee6-be87-7d43b756ed4f None admin] PATH_INFO: `/v3/projects/aba7d21adf714e6ab286c14428bafa1b` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:24.150486 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18fb781-526e-4ee6-be87-7d43b756ed4f None admin] RBAC: Authorizing `identity:get_project(project_id=aba7d21adf714e6ab286c14428bafa1b)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:24.151977 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18fb781-526e-4ee6-be87-7d43b756ed4f None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:24.153581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 92/178] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:23 2022] GET /identity/v3/projects/aba7d21adf714e6ab286c14428bafa1b => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:24.154675 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f46db-89a0-4236-b6db-b1eca1b85c71 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:24.154952 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f46db-89a0-4236-b6db-b1eca1b85c71 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:24.155220 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f46db-89a0-4236-b6db-b1eca1b85c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:24.173685 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-ef4f46db-89a0-4236-b6db-b1eca1b85c71 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:24.175580 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ef4f46db-89a0-4236-b6db-b1eca1b85c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:24.205983 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f93caf-d8c9-4966-9ae9-4c0c4317bb56 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:24.241182 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7110450-9c1b-4ae9-b757-81b786230cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:24.241843 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7110450-9c1b-4ae9-b757-81b786230cbd None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:24.242113 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7110450-9c1b-4ae9-b757-81b786230cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:24.242381 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7110450-9c1b-4ae9-b757-81b786230cbd None admin] PATH_INFO: `/v3/users/ccd3dc17c64b4e27b6022912d758a62d` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:24.243494 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7110450-9c1b-4ae9-b757-81b786230cbd None admin] RBAC: Authorizing `identity:get_user(user_id=ccd3dc17c64b4e27b6022912d758a62d)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:24.245182 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7110450-9c1b-4ae9-b757-81b786230cbd None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:24.246490 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 93/179] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:24.247569 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788744e4-7688-4b07-a916-5e8ce0eefe63 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:24.247852 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788744e4-7688-4b07-a916-5e8ce0eefe63 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:24.248120 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788744e4-7688-4b07-a916-5e8ce0eefe63 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:24.253549 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 94/180] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:24.253549 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788744e4-7688-4b07-a916-5e8ce0eefe63 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:24.253737 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 87/181] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:24 2022] GET /identity/v3/users/ccd3dc17c64b4e27b6022912d758a62d => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:24.258413 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7110450-9c1b-4ae9-b757-81b786230cbd None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:24.264940 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:24.351865 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:24.367692 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788744e4-7688-4b07-a916-5e8ce0eefe63 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:24.371228 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7110450-9c1b-4ae9-b757-81b786230cbd None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:24.407313 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38899bf4-b833-4a05-b9aa-c098dd29e4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:24.407856 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38899bf4-b833-4a05-b9aa-c098dd29e4d5 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:24.408134 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38899bf4-b833-4a05-b9aa-c098dd29e4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:24.408404 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38899bf4-b833-4a05-b9aa-c098dd29e4d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:24.412640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57d269-42b6-4106-8fab-f89fbe45a088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:24.413233 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57d269-42b6-4106-8fab-f89fbe45a088 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:24.413542 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57d269-42b6-4106-8fab-f89fbe45a088 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:24.413792 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57d269-42b6-4106-8fab-f89fbe45a088 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:24.414509 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a57d269-42b6-4106-8fab-f89fbe45a088 None admin] RBAC: Adding query filter params (role.id=4269d6d5c6c048728859af681b3610fb, scope.project.id=aba7d21adf714e6ab286c14428bafa1b, user.id=ccd3dc17c64b4e27b6022912d758a62d) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:24.414806 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a57d269-42b6-4106-8fab-f89fbe45a088 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:24.416312 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a57d269-42b6-4106-8fab-f89fbe45a088 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:24.418684 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38899bf4-b833-4a05-b9aa-c098dd29e4d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:24.422270 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 88/182] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:41:24 2022] GET /identity/v3/role_assignments?user.id=ccd3dc17c64b4e27b6022912d758a62d&scope.project.id=aba7d21adf714e6ab286c14428bafa1b&role.id=4269d6d5c6c048728859af681b3610fb => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:24.423362 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a6c19-42a2-4633-9731-edc2d2d853cc None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:24.423457 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-38899bf4-b833-4a05-b9aa-c098dd29e4d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:41:24.423457 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:24.423457 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:24.423457 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:24.423457 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:24.423457 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:24.423457 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:24.423457 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:24.423457 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:24.423457 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:24.423457 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:24.423457 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:24.423457 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:24.423457 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:24.423457 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:24.423457 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:24.424780 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:24.424780 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:24.424780 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:24.424780 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:24.424780 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:24.424780 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:24.424780 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:24.424780 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:24.424780 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:24.424780 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:24.424780 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:24.424780 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:24.424780 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:24.424780 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:24.424780 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:24.424780 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:24.425946 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:24.425946 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:24.425946 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:24.425946 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:24.425946 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:24.425946 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:24.425946 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:24.425946 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:24.425946 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:24.425946 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:24.425946 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:41:24.425946 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:41:24.426554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a6c19-42a2-4633-9731-edc2d2d853cc None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:24.426554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a6c19-42a2-4633-9731-edc2d2d853cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:24.426688 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 95/183] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:41:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:24.426755 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38899bf4-b833-4a05-b9aa-c098dd29e4d5 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:24.451491 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-fb1a6c19-42a2-4633-9731-edc2d2d853cc None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:24.452762 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-fb1a6c19-42a2-4633-9731-edc2d2d853cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:24.514436 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:24.532157 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 89/184] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:24.532837 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a6c19-42a2-4633-9731-edc2d2d853cc None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:24.566126 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38899bf4-b833-4a05-b9aa-c098dd29e4d5 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:24.604518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4adf53-ac1d-4537-b382-47b5a1150e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:24.605105 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4adf53-ac1d-4537-b382-47b5a1150e55 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:24.605506 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4adf53-ac1d-4537-b382-47b5a1150e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:24.605776 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4adf53-ac1d-4537-b382-47b5a1150e55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:24.638848 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:24.664746 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a6c19-42a2-4633-9731-edc2d2d853cc None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:24.681031 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4adf53-ac1d-4537-b382-47b5a1150e55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:24.682574 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4adf53-ac1d-4537-b382-47b5a1150e55 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:24.699516 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6806f1-128b-47a2-a273-6bd9fecb1382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:24.700274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6806f1-128b-47a2-a273-6bd9fecb1382 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:24.700417 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6806f1-128b-47a2-a273-6bd9fecb1382 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:24.700689 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6806f1-128b-47a2-a273-6bd9fecb1382 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:24.711258 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6806f1-128b-47a2-a273-6bd9fecb1382 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:24.715901 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-7b6806f1-128b-47a2-a273-6bd9fecb1382 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 10:41:24.715901 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:24.715901 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:24.715901 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:24.715901 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:24.715901 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:24.715901 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:24.715901 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:24.715901 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:24.715901 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:24.715901 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:24.715901 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:24.715901 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:24.715901 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:24.715901 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:24.715901 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:24.716768 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:24.716768 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:24.716768 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:24.716768 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:24.716768 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:24.716768 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:24.716768 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:24.716768 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:24.716768 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:24.716768 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:24.716768 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:24.716768 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:24.716768 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:24.716768 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:24.716768 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:24.716768 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:24.717605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:24.717605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:24.717605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:24.717605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:24.717605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:24.717605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:24.717605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:24.717605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:24.717605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:24.717605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:24.717605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 10:41:24.717605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:41:24.717605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 90/185] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 7 10:41:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:24.719334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92c458-d781-4e8a-a97c-77d335c095e9 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:24.719621 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92c458-d781-4e8a-a97c-77d335c095e9 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:24.719900 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92c458-d781-4e8a-a97c-77d335c095e9 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:24.721374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 91/186] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:24.721942 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92c458-d781-4e8a-a97c-77d335c095e9 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:24.762487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:24.802211 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 96/187] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:41:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:41:24.803056 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4adf53-ac1d-4537-b382-47b5a1150e55 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:24.829748 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92c458-d781-4e8a-a97c-77d335c095e9 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:24.864678 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05378df6-c4ff-4966-8b61-36366d22f4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:24.865273 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05378df6-c4ff-4966-8b61-36366d22f4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:24.865574 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05378df6-c4ff-4966-8b61-36366d22f4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:24.865845 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05378df6-c4ff-4966-8b61-36366d22f4d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:24.866503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05378df6-c4ff-4966-8b61-36366d22f4d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:24.866797 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05378df6-c4ff-4966-8b61-36366d22f4d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:24.868172 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05378df6-c4ff-4966-8b61-36366d22f4d1 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:24.870519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:24.878592 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 92/188] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:24.878592 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05378df6-c4ff-4966-8b61-36366d22f4d1 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:24.902785 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4adf53-ac1d-4537-b382-47b5a1150e55 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:24.937798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85cb9d-fa41-4216-8365-28c6bb79e139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:24.938350 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85cb9d-fa41-4216-8365-28c6bb79e139 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:24.938623 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85cb9d-fa41-4216-8365-28c6bb79e139 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:24.938931 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85cb9d-fa41-4216-8365-28c6bb79e139 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:24.940594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85cb9d-fa41-4216-8365-28c6bb79e139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:24.942134 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85cb9d-fa41-4216-8365-28c6bb79e139 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:24.943742 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 97/189] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:41:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:24.944912 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5289e4e-0624-42df-8d6d-e8f15911e547 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:24.945115 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5289e4e-0624-42df-8d6d-e8f15911e547 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:24.945396 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5289e4e-0624-42df-8d6d-e8f15911e547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:24.962153 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-c5289e4e-0624-42df-8d6d-e8f15911e547 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:24.963322 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-c5289e4e-0624-42df-8d6d-e8f15911e547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:24.980410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05378df6-c4ff-4966-8b61-36366d22f4d1 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:24.989823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:25.014403 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51808857-3df9-49ab-ab5f-9c1cded987fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:25.015005 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51808857-3df9-49ab-ab5f-9c1cded987fc None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:25.015282 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51808857-3df9-49ab-ab5f-9c1cded987fc None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:25.015552 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51808857-3df9-49ab-ab5f-9c1cded987fc None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:25.016222 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51808857-3df9-49ab-ab5f-9c1cded987fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:25.016526 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51808857-3df9-49ab-ab5f-9c1cded987fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:25.018468 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51808857-3df9-49ab-ab5f-9c1cded987fc None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:25.026727 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 93/190] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:41:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:25.027314 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51808857-3df9-49ab-ab5f-9c1cded987fc None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:25.045334 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 98/191] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:25.045334 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5289e4e-0624-42df-8d6d-e8f15911e547 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:25.094138 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:25.134427 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5289e4e-0624-42df-8d6d-e8f15911e547 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:25.134600 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51808857-3df9-49ab-ab5f-9c1cded987fc None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:25.166531 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77cc515-1bcd-4558-ab3d-3e64c250805b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:25.167005 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04ee60-0c00-4850-913e-c3b09f353a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:25.167145 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cc515-1bcd-4558-ab3d-3e64c250805b None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:25.167418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cc515-1bcd-4558-ab3d-3e64c250805b None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:25.167624 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04ee60-0c00-4850-913e-c3b09f353a9d None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:25.167721 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cc515-1bcd-4558-ab3d-3e64c250805b None admin] PATH_INFO: `/v3/users/d736d6b0cbbc48bf9b8f135aa1ddfe1c` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:25.167906 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04ee60-0c00-4850-913e-c3b09f353a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:25.168188 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04ee60-0c00-4850-913e-c3b09f353a9d None admin] PATH_INFO: `/v3/projects/e38cfbae518841b8ad956c7c16403c5c` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:25.169361 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04ee60-0c00-4850-913e-c3b09f353a9d None admin] RBAC: Authorizing `identity:get_project(project_id=e38cfbae518841b8ad956c7c16403c5c)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:25.170796 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04ee60-0c00-4850-913e-c3b09f353a9d None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:25.172598 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 94/192] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:25 2022] GET /identity/v3/projects/e38cfbae518841b8ad956c7c16403c5c => generated 312 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:25.173178 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04ee60-0c00-4850-913e-c3b09f353a9d None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:25.183815 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77cc515-1bcd-4558-ab3d-3e64c250805b None admin] RBAC: Authorizing `identity:get_user(user_id=d736d6b0cbbc48bf9b8f135aa1ddfe1c)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:25.185262 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77cc515-1bcd-4558-ab3d-3e64c250805b None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:25.186947 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 99/193] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:25 2022] GET /identity/v3/users/d736d6b0cbbc48bf9b8f135aa1ddfe1c => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:25.187704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77cc515-1bcd-4558-ab3d-3e64c250805b None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:25.211269 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:25.272495 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04ee60-0c00-4850-913e-c3b09f353a9d None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:25.286694 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77cc515-1bcd-4558-ab3d-3e64c250805b None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:25.297710 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:25.305743 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546805ff-7742-49d7-b535-d70709188473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:25.306374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546805ff-7742-49d7-b535-d70709188473 None admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:25.306657 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546805ff-7742-49d7-b535-d70709188473 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:25.306925 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546805ff-7742-49d7-b535-d70709188473 None admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:25.307565 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546805ff-7742-49d7-b535-d70709188473 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:25.308988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546805ff-7742-49d7-b535-d70709188473 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:25.319845 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf01e43-386d-4485-ba90-8023e24ea56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:25.320435 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf01e43-386d-4485-ba90-8023e24ea56d None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:25.320708 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf01e43-386d-4485-ba90-8023e24ea56d None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:25.320971 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf01e43-386d-4485-ba90-8023e24ea56d None admin] PATH_INFO: `/v3/users/d736d6b0cbbc48bf9b8f135aa1ddfe1c` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:25.322162 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf01e43-386d-4485-ba90-8023e24ea56d None admin] RBAC: Authorizing `identity:get_user(user_id=d736d6b0cbbc48bf9b8f135aa1ddfe1c)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:25.323609 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf01e43-386d-4485-ba90-8023e24ea56d None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:25.325166 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 100/194] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:25 2022] GET /identity/v3/users/d736d6b0cbbc48bf9b8f135aa1ddfe1c => generated 283 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:25.339354 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 95/195] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 7 10:41:25 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:41:25.339354 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546805ff-7742-49d7-b535-d70709188473 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:25.339663 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf01e43-386d-4485-ba90-8023e24ea56d None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:25.439535 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:25.447794 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546805ff-7742-49d7-b535-d70709188473 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:25.451950 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf01e43-386d-4485-ba90-8023e24ea56d None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:25.486918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e3a46-b625-49de-bd6a-d84fb8a019e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:25.487761 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e3a46-b625-49de-bd6a-d84fb8a019e2 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:25.487883 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e3a46-b625-49de-bd6a-d84fb8a019e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:25.488218 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e3a46-b625-49de-bd6a-d84fb8a019e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:25.489041 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e3a46-b625-49de-bd6a-d84fb8a019e2 None admin] RBAC: Adding query filter params (role.id=28e65a5027f7406cac824e6ff6474bb2, scope.project.id=e38cfbae518841b8ad956c7c16403c5c, user.id=ccd3dc17c64b4e27b6022912d758a62d) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:25.489486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e3a46-b625-49de-bd6a-d84fb8a019e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:25.490988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e3a46-b625-49de-bd6a-d84fb8a019e2 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:25.492619 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39c2ac-3e99-4281-813c-545e1e2e8571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:25.493503 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39c2ac-3e99-4281-813c-545e1e2e8571 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:25.494095 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39c2ac-3e99-4281-813c-545e1e2e8571 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:25.494927 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39c2ac-3e99-4281-813c-545e1e2e8571 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:25.497637 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 96/196] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:41:25 2022] GET /identity/v3/role_assignments?user.id=ccd3dc17c64b4e27b6022912d758a62d&scope.project.id=e38cfbae518841b8ad956c7c16403c5c&role.id=28e65a5027f7406cac824e6ff6474bb2 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:25.498506 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e3a46-b625-49de-bd6a-d84fb8a019e2 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:25.518589 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39c2ac-3e99-4281-813c-545e1e2e8571 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:25.525431 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-cb39c2ac-3e99-4281-813c-545e1e2e8571 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 10:41:25.525431 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:25.525431 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:25.525431 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:25.525431 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:25.525431 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:25.525431 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:25.525431 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:25.525431 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:25.525431 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:25.525431 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:25.525431 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:25.525431 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:25.525431 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:25.525431 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:25.525431 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:25.526577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:25.526577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:25.526577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:25.526577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:25.526577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:25.526577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:25.526577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:25.526577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:25.526577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:25.526577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:25.526577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:25.526577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:25.526577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:25.526577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:25.526577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:25.526577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:25.527492 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:25.527492 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:25.527492 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:25.527492 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:25.527492 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:25.527492 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:25.527492 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:25.527492 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:25.527492 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:25.527492 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:25.527492 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 10:41:25.527492 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:41:25.527492 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 101/197] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:25.527492 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39c2ac-3e99-4281-813c-545e1e2e8571 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:25.575972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:25.669167 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e3a46-b625-49de-bd6a-d84fb8a019e2 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:25.670446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39c2ac-3e99-4281-813c-545e1e2e8571 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:25.709940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63cb4e6-5bb1-49dc-9053-ffe73103046b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:25.710557 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cb4e6-5bb1-49dc-9053-ffe73103046b None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:25.710834 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cb4e6-5bb1-49dc-9053-ffe73103046b None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:25.711103 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cb4e6-5bb1-49dc-9053-ffe73103046b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:25.712062 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71228153-051a-46ac-ad9c-441819e62999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:25.712885 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71228153-051a-46ac-ad9c-441819e62999 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:25.713384 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71228153-051a-46ac-ad9c-441819e62999 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:25.714002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71228153-051a-46ac-ad9c-441819e62999 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:25.740629 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:25.793654 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63cb4e6-5bb1-49dc-9053-ffe73103046b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:25.795179 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63cb4e6-5bb1-49dc-9053-ffe73103046b None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:25.796097 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71228153-051a-46ac-ad9c-441819e62999 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:25.797802 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71228153-051a-46ac-ad9c-441819e62999 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:25.855586 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:25.905217 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 102/198] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:41:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:41:25.906869 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71228153-051a-46ac-ad9c-441819e62999 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:25.925282 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 97/199] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:41:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:41:25.925282 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63cb4e6-5bb1-49dc-9053-ffe73103046b None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:25.970318 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:26.036044 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71228153-051a-46ac-ad9c-441819e62999 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:26.046780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63cb4e6-5bb1-49dc-9053-ffe73103046b None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:26.079548 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd103c06-c4a1-4360-81d2-8426a91bdc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:26.080781 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd103c06-c4a1-4360-81d2-8426a91bdc65 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:26.081251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd103c06-c4a1-4360-81d2-8426a91bdc65 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:26.081743 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd103c06-c4a1-4360-81d2-8426a91bdc65 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:26.082599 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd103c06-c4a1-4360-81d2-8426a91bdc65 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:26.083103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd103c06-c4a1-4360-81d2-8426a91bdc65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:26.084888 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd103c06-c4a1-4360-81d2-8426a91bdc65 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:26.090022 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0cfe1-115b-4411-b8e0-7a65bf6a1854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:26.091223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0cfe1-115b-4411-b8e0-7a65bf6a1854 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:26.091506 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0cfe1-115b-4411-b8e0-7a65bf6a1854 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:26.091778 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0cfe1-115b-4411-b8e0-7a65bf6a1854 None admin] PATH_INFO: `/v3/projects/712e604258e7461484f5bd25d19f0cf0` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:26.093196 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b0cfe1-115b-4411-b8e0-7a65bf6a1854 None admin] RBAC: Authorizing `identity:get_project(project_id=712e604258e7461484f5bd25d19f0cf0)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:26.094693 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b0cfe1-115b-4411-b8e0-7a65bf6a1854 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:26.095770 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 103/200] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 7 10:41:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:26.097109 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 98/201] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:25 2022] GET /identity/v3/projects/712e604258e7461484f5bd25d19f0cf0 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:26.097750 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd103c06-c4a1-4360-81d2-8426a91bdc65 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:26.101353 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0cfe1-115b-4411-b8e0-7a65bf6a1854 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:26.126315 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:26.218142 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0cfe1-115b-4411-b8e0-7a65bf6a1854 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:26.227832 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd103c06-c4a1-4360-81d2-8426a91bdc65 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:26.245107 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:26.256448 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921960cc-821c-403e-9722-05ffdd56c49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:26.257452 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921960cc-821c-403e-9722-05ffdd56c49e None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:26.257920 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921960cc-821c-403e-9722-05ffdd56c49e None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:26.258375 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921960cc-821c-403e-9722-05ffdd56c49e None admin] PATH_INFO: `/v3/users/c473e6b736f44ac0abbcdbe14efc4dd7` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:26.260008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921960cc-821c-403e-9722-05ffdd56c49e None admin] RBAC: Authorizing `identity:get_user(user_id=c473e6b736f44ac0abbcdbe14efc4dd7)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:26.261681 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921960cc-821c-403e-9722-05ffdd56c49e None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:26.263814 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 99/202] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:26 2022] GET /identity/v3/users/c473e6b736f44ac0abbcdbe14efc4dd7 => generated 289 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:26.264870 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921960cc-821c-403e-9722-05ffdd56c49e None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:26.273042 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04888a79-6473-4e71-9c11-2bb2e699822c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:26.273734 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04888a79-6473-4e71-9c11-2bb2e699822c None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:26.274015 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04888a79-6473-4e71-9c11-2bb2e699822c None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:26.274287 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04888a79-6473-4e71-9c11-2bb2e699822c None admin] PATH_INFO: `/v3/projects/712e604258e7461484f5bd25d19f0cf0` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:26.275438 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04888a79-6473-4e71-9c11-2bb2e699822c None admin] RBAC: Authorizing `identity:get_project(project_id=712e604258e7461484f5bd25d19f0cf0)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:26.276902 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04888a79-6473-4e71-9c11-2bb2e699822c None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:26.278609 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 104/203] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:26 2022] GET /identity/v3/projects/712e604258e7461484f5bd25d19f0cf0 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:26.279377 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04888a79-6473-4e71-9c11-2bb2e699822c None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:26.375832 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:26.398226 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921960cc-821c-403e-9722-05ffdd56c49e None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:26.408556 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04888a79-6473-4e71-9c11-2bb2e699822c None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:26.444679 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90cdec-2d6b-40f6-a392-ba588b7d5b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:26.445276 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90cdec-2d6b-40f6-a392-ba588b7d5b2c None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:26.445629 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90cdec-2d6b-40f6-a392-ba588b7d5b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:26.445839 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90cdec-2d6b-40f6-a392-ba588b7d5b2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:26.451143 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201ab15-240a-46c6-9b66-c0fa664398b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:26.451988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201ab15-240a-46c6-9b66-c0fa664398b5 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:26.452460 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201ab15-240a-46c6-9b66-c0fa664398b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:26.452926 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201ab15-240a-46c6-9b66-c0fa664398b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:26.453913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2201ab15-240a-46c6-9b66-c0fa664398b5 None admin] RBAC: Adding query filter params (role.id=4269d6d5c6c048728859af681b3610fb, scope.project.id=712e604258e7461484f5bd25d19f0cf0, user.id=d736d6b0cbbc48bf9b8f135aa1ddfe1c) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:26.454431 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2201ab15-240a-46c6-9b66-c0fa664398b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:26.457911 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2201ab15-240a-46c6-9b66-c0fa664398b5 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:26.468374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 100/204] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:41:26 2022] GET /identity/v3/role_assignments?user.id=d736d6b0cbbc48bf9b8f135aa1ddfe1c&scope.project.id=712e604258e7461484f5bd25d19f0cf0&role.id=4269d6d5c6c048728859af681b3610fb => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:26.469441 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201ab15-240a-46c6-9b66-c0fa664398b5 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:26.535401 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:26.583395 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90cdec-2d6b-40f6-a392-ba588b7d5b2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:26.584904 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90cdec-2d6b-40f6-a392-ba588b7d5b2c None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:26.597969 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201ab15-240a-46c6-9b66-c0fa664398b5 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:26.641750 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e49fe7-4473-4a68-884e-4c164ef6ccfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:26.643562 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e49fe7-4473-4a68-884e-4c164ef6ccfd None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:26.644041 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e49fe7-4473-4a68-884e-4c164ef6ccfd None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:26.644524 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e49fe7-4473-4a68-884e-4c164ef6ccfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:26.645521 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e49fe7-4473-4a68-884e-4c164ef6ccfd None admin] RBAC: Adding query filter params (role.id=9da6e501237c405ca021a9d9f6173caf, scope.project.id=712e604258e7461484f5bd25d19f0cf0, user.id=d736d6b0cbbc48bf9b8f135aa1ddfe1c) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:26.646038 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e49fe7-4473-4a68-884e-4c164ef6ccfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:26.648388 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e49fe7-4473-4a68-884e-4c164ef6ccfd None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:26.656247 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 101/205] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:41:26 2022] GET /identity/v3/role_assignments?user.id=d736d6b0cbbc48bf9b8f135aa1ddfe1c&scope.project.id=712e604258e7461484f5bd25d19f0cf0&role.id=9da6e501237c405ca021a9d9f6173caf => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:26.741927 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 105/206] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:41:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:41:26.748468 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e49fe7-4473-4a68-884e-4c164ef6ccfd None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:26.767195 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:26.869129 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e49fe7-4473-4a68-884e-4c164ef6ccfd None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:26.905779 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36858dd9-4973-4dd6-96f6-0b94e7975be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:26.906745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36858dd9-4973-4dd6-96f6-0b94e7975be3 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:26.907317 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36858dd9-4973-4dd6-96f6-0b94e7975be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:26.907796 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36858dd9-4973-4dd6-96f6-0b94e7975be3 None admin] PATH_INFO: `/v3/projects/aba7d21adf714e6ab286c14428bafa1b` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:26.909809 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36858dd9-4973-4dd6-96f6-0b94e7975be3 None admin] RBAC: Authorizing `identity:get_project(project_id=aba7d21adf714e6ab286c14428bafa1b)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:26.911512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36858dd9-4973-4dd6-96f6-0b94e7975be3 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:26.913498 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 102/207] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:26 2022] GET /identity/v3/projects/aba7d21adf714e6ab286c14428bafa1b => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:26.931323 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90cdec-2d6b-40f6-a392-ba588b7d5b2c None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:27.033953 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:27.054771 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90cdec-2d6b-40f6-a392-ba588b7d5b2c None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:27.094991 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d351e-6265-4acc-b2f7-b59699ffa072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:27.096542 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d351e-6265-4acc-b2f7-b59699ffa072 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:27.097049 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d351e-6265-4acc-b2f7-b59699ffa072 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:27.097592 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d351e-6265-4acc-b2f7-b59699ffa072 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:27.098527 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d351e-6265-4acc-b2f7-b59699ffa072 None admin] RBAC: Adding query filter params (role.id=e9b673af6fc14dfe8c0762885c21da92, scope.project.id=aba7d21adf714e6ab286c14428bafa1b, user.id=c473e6b736f44ac0abbcdbe14efc4dd7) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:27.099128 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d351e-6265-4acc-b2f7-b59699ffa072 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:27.100862 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d351e-6265-4acc-b2f7-b59699ffa072 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:27.107944 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 106/208] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:41:26 2022] GET /identity/v3/role_assignments?user.id=c473e6b736f44ac0abbcdbe14efc4dd7&scope.project.id=aba7d21adf714e6ab286c14428bafa1b&role.id=e9b673af6fc14dfe8c0762885c21da92 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:27.681983 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ec88a-0a6a-4a3b-b5f2-ddcf8f960e27 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:27.682663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ec88a-0a6a-4a3b-b5f2-ddcf8f960e27 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:27.683160 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ec88a-0a6a-4a3b-b5f2-ddcf8f960e27 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:27.684788 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 103/209] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:27.690713 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460b71e-7cae-476a-a44f-3d34a8b2fa63 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:27.691254 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460b71e-7cae-476a-a44f-3d34a8b2fa63 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:27.691723 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460b71e-7cae-476a-a44f-3d34a8b2fa63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:27.721898 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-7460b71e-7cae-476a-a44f-3d34a8b2fa63 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:27.723441 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-7460b71e-7cae-476a-a44f-3d34a8b2fa63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:27.786572 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfecc0b-f672-4b02-8a50-867e151cff9a None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:27.786912 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfecc0b-f672-4b02-8a50-867e151cff9a None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:27.787125 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfecc0b-f672-4b02-8a50-867e151cff9a None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:27.788477 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 104/210] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 10:41:27.793123 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8ee2a-2093-420e-9733-d155fa4cb133 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:27.793429 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8ee2a-2093-420e-9733-d155fa4cb133 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:27.793708 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8ee2a-2093-420e-9733-d155fa4cb133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:27.800592 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 107/211] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:27.816260 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-00d8ee2a-2093-420e-9733-d155fa4cb133 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:27.817791 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-00d8ee2a-2093-420e-9733-d155fa4cb133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:27.823221 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460b71e-7cae-476a-a44f-3d34a8b2fa63 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:27.904860 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 105/212] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 10:41:27.917030 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:27.929713 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8ee2a-2093-420e-9733-d155fa4cb133 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:27.944916 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:27.948344 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460b71e-7cae-476a-a44f-3d34a8b2fa63 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:27.988335 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1639e6-cacf-43a9-811e-88e3a537f8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:27.989349 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1639e6-cacf-43a9-811e-88e3a537f8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:27.989803 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1639e6-cacf-43a9-811e-88e3a537f8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:27.990276 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1639e6-cacf-43a9-811e-88e3a537f8d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:28.002325 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1639e6-cacf-43a9-811e-88e3a537f8d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:28.007864 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-ad1639e6-cacf-43a9-811e-88e3a537f8d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:28.007864 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:28.007864 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:28.007864 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:28.007864 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:28.007864 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:28.007864 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:28.007864 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:28.007864 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:28.007864 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:28.007864 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:28.007864 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:28.007864 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:28.007864 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:28.007864 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:28.007864 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:28.008715 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:28.008715 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:28.008715 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:28.008715 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:28.008715 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:28.008715 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:28.008715 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:28.008715 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:28.008715 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:28.008715 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:28.008715 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:28.008715 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:28.008715 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:28.008715 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:28.008715 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:28.008715 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:28.009545 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:28.009545 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:28.009545 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:28.009545 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:28.009545 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:28.009545 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:28.009545 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:28.009545 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:28.009545 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:28.009545 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:28.009545 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:28.009545 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:41:28.016366 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 108/213] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:41:28.017579 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1639e6-cacf-43a9-811e-88e3a537f8d8 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:28.055801 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8ee2a-2093-420e-9733-d155fa4cb133 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:28.098518 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d457a1-50ce-4f7a-9f86-013be695deca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:28.099307 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d457a1-50ce-4f7a-9f86-013be695deca None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:28.099695 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d457a1-50ce-4f7a-9f86-013be695deca None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:28.100150 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d457a1-50ce-4f7a-9f86-013be695deca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:28.101686 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d457a1-50ce-4f7a-9f86-013be695deca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:28.103086 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d457a1-50ce-4f7a-9f86-013be695deca None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:28.105026 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 106/214] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:41:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:41:28.111232 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d457a1-50ce-4f7a-9f86-013be695deca None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:28.141776 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1639e6-cacf-43a9-811e-88e3a537f8d8 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:28.187601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88ec5c-829e-4cc0-a30f-fd4e749bd2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:28.188402 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88ec5c-829e-4cc0-a30f-fd4e749bd2a1 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:28.188842 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88ec5c-829e-4cc0-a30f-fd4e749bd2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:28.189346 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88ec5c-829e-4cc0-a30f-fd4e749bd2a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:28.190094 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88ec5c-829e-4cc0-a30f-fd4e749bd2a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:28.190484 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88ec5c-829e-4cc0-a30f-fd4e749bd2a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:28.191952 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88ec5c-829e-4cc0-a30f-fd4e749bd2a1 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:28.193401 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:28.202799 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 109/215] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 7 10:41:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:28.203681 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:28.209859 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88ec5c-829e-4cc0-a30f-fd4e749bd2a1 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:28.231070 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d457a1-50ce-4f7a-9f86-013be695deca None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:28.277008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f134e-6d3f-4784-8699-f387075afe09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:28.277871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f134e-6d3f-4784-8699-f387075afe09 None admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:28.278448 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f134e-6d3f-4784-8699-f387075afe09 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:28.278863 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f134e-6d3f-4784-8699-f387075afe09 None admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:28.280135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f134e-6d3f-4784-8699-f387075afe09 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:28.282053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f134e-6d3f-4784-8699-f387075afe09 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:28.309457 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 107/216] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 7 10:41:28 2022] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:41:28.327917 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88ec5c-829e-4cc0-a30f-fd4e749bd2a1 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:28.367152 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d16893-b446-4a3b-9517-08501d684584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:28.367811 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d16893-b446-4a3b-9517-08501d684584 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:28.368140 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d16893-b446-4a3b-9517-08501d684584 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:28.368415 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d16893-b446-4a3b-9517-08501d684584 None admin] PATH_INFO: `/v3/users/cfc288302e164ff59f59dce8f17b4133` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:28.385212 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d16893-b446-4a3b-9517-08501d684584 None admin] RBAC: Authorizing `identity:get_user(user_id=cfc288302e164ff59f59dce8f17b4133)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:28.386846 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d16893-b446-4a3b-9517-08501d684584 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:28.389041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 110/217] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:28 2022] GET /identity/v3/users/cfc288302e164ff59f59dce8f17b4133 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:28.395014 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f134e-6d3f-4784-8699-f387075afe09 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:28.519435 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f134e-6d3f-4784-8699-f387075afe09 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:28.555339 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8101edb-9c0f-4cb7-9c93-4b3112aeae5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:28.555951 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8101edb-9c0f-4cb7-9c93-4b3112aeae5d None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:28.556224 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8101edb-9c0f-4cb7-9c93-4b3112aeae5d None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:28.556490 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8101edb-9c0f-4cb7-9c93-4b3112aeae5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:28.569605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:28.629986 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8101edb-9c0f-4cb7-9c93-4b3112aeae5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:28.631498 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8101edb-9c0f-4cb7-9c93-4b3112aeae5d None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:28.737483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 108/218] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:41:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:41:28.739594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d16893-b446-4a3b-9517-08501d684584 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:28.801091 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:28.854664 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d16893-b446-4a3b-9517-08501d684584 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:28.904148 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf3788-25d0-4d80-9e66-52a1eeab1f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:28.904835 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf3788-25d0-4d80-9e66-52a1eeab1f2d None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:28.905120 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf3788-25d0-4d80-9e66-52a1eeab1f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:28.905399 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf3788-25d0-4d80-9e66-52a1eeab1f2d None admin] PATH_INFO: `/v3/projects/712e604258e7461484f5bd25d19f0cf0` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:28.906586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf3788-25d0-4d80-9e66-52a1eeab1f2d None admin] RBAC: Authorizing `identity:get_project(project_id=712e604258e7461484f5bd25d19f0cf0)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:28.908022 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf3788-25d0-4d80-9e66-52a1eeab1f2d None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:28.910650 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 111/219] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:28 2022] GET /identity/v3/projects/712e604258e7461484f5bd25d19f0cf0 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:28.914342 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ac98d-1d51-46c1-ba94-fe3156ed8ab5 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:28.914342 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ac98d-1d51-46c1-ba94-fe3156ed8ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:28.914342 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ac98d-1d51-46c1-ba94-fe3156ed8ab5 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:28.915191 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 109/220] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:28.919884 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf3788-25d0-4d80-9e66-52a1eeab1f2d None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:28.920257 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067ccc6-68d5-4b82-a78b-b0e6c3e61c77 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:28.920543 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067ccc6-68d5-4b82-a78b-b0e6c3e61c77 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:28.920818 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067ccc6-68d5-4b82-a78b-b0e6c3e61c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:28.960000 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-e067ccc6-68d5-4b82-a78b-b0e6c3e61c77 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:28.961201 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-e067ccc6-68d5-4b82-a78b-b0e6c3e61c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:29.013124 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:29.037682 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf3788-25d0-4d80-9e66-52a1eeab1f2d None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:29.063041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:29.071410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 110/221] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:29.077464 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7645b-b2e8-4693-afde-f77e9e161f5f None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:29.077464 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7645b-b2e8-4693-afde-f77e9e161f5f None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:29.077464 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7645b-b2e8-4693-afde-f77e9e161f5f None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:29.077464 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 111/222] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:29.079632 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ca61e-4a8e-4fe4-bafa-e4d451ca0fa8 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:29.079902 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ca61e-4a8e-4fe4-bafa-e4d451ca0fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:29.080287 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ca61e-4a8e-4fe4-bafa-e4d451ca0fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:29.085766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3f304-bf5d-4080-b7fd-c256c9c1ecaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:29.086424 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3f304-bf5d-4080-b7fd-c256c9c1ecaf None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:29.086698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3f304-bf5d-4080-b7fd-c256c9c1ecaf None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:29.086963 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3f304-bf5d-4080-b7fd-c256c9c1ecaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:29.087699 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3f304-bf5d-4080-b7fd-c256c9c1ecaf None admin] RBAC: Adding query filter params (role.id=28e65a5027f7406cac824e6ff6474bb2, scope.project.id=712e604258e7461484f5bd25d19f0cf0, user.id=cfc288302e164ff59f59dce8f17b4133) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:29.087997 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3f304-bf5d-4080-b7fd-c256c9c1ecaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:29.089579 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3f304-bf5d-4080-b7fd-c256c9c1ecaf None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:29.100998 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 112/223] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:41:28 2022] GET /identity/v3/role_assignments?user.id=cfc288302e164ff59f59dce8f17b4133&scope.project.id=712e604258e7461484f5bd25d19f0cf0&role.id=28e65a5027f7406cac824e6ff6474bb2 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:29.102409 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3f304-bf5d-4080-b7fd-c256c9c1ecaf None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:29.110837 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-9f9ca61e-4a8e-4fe4-bafa-e4d451ca0fa8 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:29.112101 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-9f9ca61e-4a8e-4fe4-bafa-e4d451ca0fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:29.236065 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 112/224] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:29.263782 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3f304-bf5d-4080-b7fd-c256c9c1ecaf None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:29.275444 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ca61e-4a8e-4fe4-bafa-e4d451ca0fa8 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:29.306634 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10b719-22c2-4cb8-861c-64ea4a2870df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:29.307274 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10b719-22c2-4cb8-861c-64ea4a2870df None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:29.307555 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10b719-22c2-4cb8-861c-64ea4a2870df None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:29.307825 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10b719-22c2-4cb8-861c-64ea4a2870df None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:29.335391 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10b719-22c2-4cb8-861c-64ea4a2870df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:29.353955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-9b10b719-22c2-4cb8-861c-64ea4a2870df None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 10:41:29.353955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:29.353955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:29.353955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:29.353955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:29.353955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:29.353955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:29.353955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:29.353955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:29.353955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:29.353955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:29.353955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:29.353955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:29.353955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:29.353955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:29.353955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:29.354786 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:29.354786 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:29.354786 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:29.354786 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:29.354786 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:29.354786 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:29.354786 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:29.354786 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:29.354786 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:29.354786 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:29.354786 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:29.354786 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:29.354786 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:29.354786 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:29.354786 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:29.354786 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:29.355573 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:29.355573 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:29.355573 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:29.355573 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:29.355573 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:29.355573 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:29.355573 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:29.355573 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:29.355573 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:29.355573 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:29.355573 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 10:41:29.355573 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:41:29.355573 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 113/225] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 7 10:41:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:29.357434 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10b719-22c2-4cb8-861c-64ea4a2870df None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:29.449732 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:29.505824 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:29.519981 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10b719-22c2-4cb8-861c-64ea4a2870df None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:29.539261 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ca61e-4a8e-4fe4-bafa-e4d451ca0fa8 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:29.566303 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18be4cc-9307-4495-b653-2b058896bc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:29.566913 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18be4cc-9307-4495-b653-2b058896bc00 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:29.567186 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18be4cc-9307-4495-b653-2b058896bc00 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:29.567454 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18be4cc-9307-4495-b653-2b058896bc00 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:29.568124 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18be4cc-9307-4495-b653-2b058896bc00 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:29.568421 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18be4cc-9307-4495-b653-2b058896bc00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:29.569828 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18be4cc-9307-4495-b653-2b058896bc00 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:29.578485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 114/226] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:41:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:41:29.590323 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18be4cc-9307-4495-b653-2b058896bc00 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:29.596460 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ddb46-49b6-4a6d-a306-548032204f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:29.597097 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ddb46-49b6-4a6d-a306-548032204f60 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:29.597407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ddb46-49b6-4a6d-a306-548032204f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:29.597679 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ddb46-49b6-4a6d-a306-548032204f60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:29.608350 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ddb46-49b6-4a6d-a306-548032204f60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:29.613659 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-327ddb46-49b6-4a6d-a306-548032204f60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:41:29.613659 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:29.613659 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:29.613659 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:29.613659 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:29.613659 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:29.613659 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:29.613659 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:29.613659 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:29.613659 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:29.613659 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:29.613659 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:29.613659 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:29.613659 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:29.613659 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:29.613659 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:29.615653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:29.615653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:29.615653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:29.615653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:29.615653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:29.615653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:29.615653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:29.615653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:29.615653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:29.615653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:29.615653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:29.615653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:29.615653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:29.615653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:29.615653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:29.615653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:29.617583 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:29.617583 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:29.617583 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:29.617583 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:29.617583 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:29.617583 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:29.617583 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:29.617583 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:29.617583 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:29.617583 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:29.617583 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:41:29.617583 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:41:29.617583 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 113/227] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:41:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:41:29.626470 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ddb46-49b6-4a6d-a306-548032204f60 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:29.739223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18be4cc-9307-4495-b653-2b058896bc00 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:29.755690 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:29.759632 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ddb46-49b6-4a6d-a306-548032204f60 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:29.799886 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9617a-4eb3-4a8c-a74b-e93eb9e09b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:29.800559 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9617a-4eb3-4a8c-a74b-e93eb9e09b68 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:29.800841 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9617a-4eb3-4a8c-a74b-e93eb9e09b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:29.801112 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9617a-4eb3-4a8c-a74b-e93eb9e09b68 None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:29.801896 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9617a-4eb3-4a8c-a74b-e93eb9e09b68 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:29.802858 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9617a-4eb3-4a8c-a74b-e93eb9e09b68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:29.804634 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9617a-4eb3-4a8c-a74b-e93eb9e09b68 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:29.815918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 114/228] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:41:29.821659 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9617a-4eb3-4a8c-a74b-e93eb9e09b68 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:29.842889 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:29.843232 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116f321-0370-4ee1-8297-88ccfa7943fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:29.843877 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116f321-0370-4ee1-8297-88ccfa7943fb None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:29.844151 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116f321-0370-4ee1-8297-88ccfa7943fb None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:29.844422 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116f321-0370-4ee1-8297-88ccfa7943fb None admin] PATH_INFO: `/v3/users/d736d6b0cbbc48bf9b8f135aa1ddfe1c` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:29.848620 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116f321-0370-4ee1-8297-88ccfa7943fb None admin] RBAC: Authorizing `identity:get_user(user_id=d736d6b0cbbc48bf9b8f135aa1ddfe1c)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:29.850121 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116f321-0370-4ee1-8297-88ccfa7943fb None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:29.855941 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 115/229] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:29 2022] GET /identity/v3/users/d736d6b0cbbc48bf9b8f135aa1ddfe1c => generated 283 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:29.861994 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116f321-0370-4ee1-8297-88ccfa7943fb None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:30.010180 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9617a-4eb3-4a8c-a74b-e93eb9e09b68 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:30.069538 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116f321-0370-4ee1-8297-88ccfa7943fb None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:30.076197 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a94a13-f7aa-4bf5-adaa-27c42daa57f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:30.076829 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a94a13-f7aa-4bf5-adaa-27c42daa57f4 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:30.077108 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a94a13-f7aa-4bf5-adaa-27c42daa57f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:30.077405 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a94a13-f7aa-4bf5-adaa-27c42daa57f4 None admin] PATH_INFO: `/v3/users/d736d6b0cbbc48bf9b8f135aa1ddfe1c` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:30.083367 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a94a13-f7aa-4bf5-adaa-27c42daa57f4 None admin] RBAC: Authorizing `identity:get_user(user_id=d736d6b0cbbc48bf9b8f135aa1ddfe1c)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:30.084886 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a94a13-f7aa-4bf5-adaa-27c42daa57f4 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:30.097530 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 115/230] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:29 2022] GET /identity/v3/users/d736d6b0cbbc48bf9b8f135aa1ddfe1c => generated 283 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:30.104606 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a94a13-f7aa-4bf5-adaa-27c42daa57f4 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:30.121292 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f38a0b-e38c-4c8a-8567-94334d31db5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:30.122054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f38a0b-e38c-4c8a-8567-94334d31db5f None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:30.122341 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f38a0b-e38c-4c8a-8567-94334d31db5f None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:30.122610 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f38a0b-e38c-4c8a-8567-94334d31db5f None admin] PATH_INFO: `/v3/projects/712e604258e7461484f5bd25d19f0cf0` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:30.123757 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f38a0b-e38c-4c8a-8567-94334d31db5f None admin] RBAC: Authorizing `identity:get_project(project_id=712e604258e7461484f5bd25d19f0cf0)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:30.125188 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f38a0b-e38c-4c8a-8567-94334d31db5f None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:30.127274 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 116/231] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:29 2022] GET /identity/v3/projects/712e604258e7461484f5bd25d19f0cf0 => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:30.132999 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f38a0b-e38c-4c8a-8567-94334d31db5f None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:30.181138 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:30.243043 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f38a0b-e38c-4c8a-8567-94334d31db5f None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:30.280279 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0ba2b-3f2f-4ee1-8a4f-5001669c052d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:30.280944 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0ba2b-3f2f-4ee1-8a4f-5001669c052d None admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:30.281223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0ba2b-3f2f-4ee1-8a4f-5001669c052d None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:30.281526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0ba2b-3f2f-4ee1-8a4f-5001669c052d None admin] PATH_INFO: `/v3/projects/712e604258e7461484f5bd25d19f0cf0/users/d736d6b0cbbc48bf9b8f135aa1ddfe1c/roles/4269d6d5c6c048728859af681b3610fb` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:30.283839 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0ba2b-3f2f-4ee1-8a4f-5001669c052d None admin] RBAC: Authorizing `identity:create_grant(project_id=712e604258e7461484f5bd25d19f0cf0, user_id=d736d6b0cbbc48bf9b8f135aa1ddfe1c, role_id=4269d6d5c6c048728859af681b3610fb)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:30.285453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0ba2b-3f2f-4ee1-8a4f-5001669c052d None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:30.302066 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 117/232] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 7 10:41:30 2022] PUT /identity/v3/projects/712e604258e7461484f5bd25d19f0cf0/users/d736d6b0cbbc48bf9b8f135aa1ddfe1c/roles/4269d6d5c6c048728859af681b3610fb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 10:41:30.336733 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:30.375360 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a94a13-f7aa-4bf5-adaa-27c42daa57f4 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:30.430991 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ef385-f087-4d05-805a-1a176c5225d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:30.431872 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ef385-f087-4d05-805a-1a176c5225d6 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:30.432291 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ef385-f087-4d05-805a-1a176c5225d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:30.432704 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ef385-f087-4d05-805a-1a176c5225d6 None admin] PATH_INFO: `/v3/projects/712e604258e7461484f5bd25d19f0cf0` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:30.434030 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ef385-f087-4d05-805a-1a176c5225d6 None admin] RBAC: Authorizing `identity:get_project(project_id=712e604258e7461484f5bd25d19f0cf0)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:30.435634 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ef385-f087-4d05-805a-1a176c5225d6 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:30.437447 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 116/233] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:30 2022] GET /identity/v3/projects/712e604258e7461484f5bd25d19f0cf0 => generated 302 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:41:30.445562 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0ba2b-3f2f-4ee1-8a4f-5001669c052d None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:30.565124 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0ba2b-3f2f-4ee1-8a4f-5001669c052d None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:30.567587 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:30.601658 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ba905-0940-4a4e-9603-8b9c0e1d3154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:30.602325 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ba905-0940-4a4e-9603-8b9c0e1d3154 None admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:30.602607 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ba905-0940-4a4e-9603-8b9c0e1d3154 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:30.602885 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ba905-0940-4a4e-9603-8b9c0e1d3154 None admin] PATH_INFO: `/v3/projects/712e604258e7461484f5bd25d19f0cf0/users/d736d6b0cbbc48bf9b8f135aa1ddfe1c/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:30.604985 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ba905-0940-4a4e-9603-8b9c0e1d3154 None admin] RBAC: Authorizing `identity:create_grant(project_id=712e604258e7461484f5bd25d19f0cf0, user_id=d736d6b0cbbc48bf9b8f135aa1ddfe1c, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:30.606456 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ba905-0940-4a4e-9603-8b9c0e1d3154 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:30.623734 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 118/234] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 7 10:41:30 2022] PUT /identity/v3/projects/712e604258e7461484f5bd25d19f0cf0/users/d736d6b0cbbc48bf9b8f135aa1ddfe1c/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:41:30.838719 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc525639-ad2f-4061-a8bb-0f16167375df None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:30.839272 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc525639-ad2f-4061-a8bb-0f16167375df None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:30.839548 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc525639-ad2f-4061-a8bb-0f16167375df None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:30.841044 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 117/235] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:30.846651 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbcb50-70f2-4fb7-85b0-2efda6c14673 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:30.846938 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbcb50-70f2-4fb7-85b0-2efda6c14673 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:30.847281 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbcb50-70f2-4fb7-85b0-2efda6c14673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:30.867813 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-31bbcb50-70f2-4fb7-85b0-2efda6c14673 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:30.869281 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-31bbcb50-70f2-4fb7-85b0-2efda6c14673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:30.959079 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 119/236] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:30.966357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff130c-9e5f-4958-9df6-9a0c7d508df2 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:30.966931 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff130c-9e5f-4958-9df6-9a0c7d508df2 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:30.967403 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff130c-9e5f-4958-9df6-9a0c7d508df2 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:30.969182 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 118/237] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:30.974822 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e456949-ed94-4652-9c7d-2d726645fd7f None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:30.975112 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e456949-ed94-4652-9c7d-2d726645fd7f None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:30.975390 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e456949-ed94-4652-9c7d-2d726645fd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:31.002520 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-0e456949-ed94-4652-9c7d-2d726645fd7f None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:31.003785 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-0e456949-ed94-4652-9c7d-2d726645fd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:31.004761 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff130c-9e5f-4958-9df6-9a0c7d508df2 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:31.111912 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 120/238] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 10:41:31.135723 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e456949-ed94-4652-9c7d-2d726645fd7f None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:31.164231 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff130c-9e5f-4958-9df6-9a0c7d508df2 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:31.193603 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:31.200585 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae67b8c-911c-4bcc-967c-e2cdb1e94983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:31.201453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae67b8c-911c-4bcc-967c-e2cdb1e94983 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:31.201866 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae67b8c-911c-4bcc-967c-e2cdb1e94983 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:31.202271 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae67b8c-911c-4bcc-967c-e2cdb1e94983 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:31.216007 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae67b8c-911c-4bcc-967c-e2cdb1e94983 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:31.222102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-8ae67b8c-911c-4bcc-967c-e2cdb1e94983 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 10:41:31.222102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:31.222102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:31.222102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:31.222102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:31.222102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:31.222102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:31.222102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:31.222102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:31.222102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:31.222102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:31.222102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:31.222102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:31.222102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:31.222102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:31.222102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:31.223107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:31.223107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:31.223107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:31.223107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:31.223107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:31.223107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:31.223107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:31.223107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:31.223107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:31.223107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:31.223107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:31.223107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:31.223107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:31.223107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:31.223107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:31.223107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:31.223902 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:31.223902 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:31.223902 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:31.223902 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:31.223902 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:31.223902 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:31.223902 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:31.223902 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:31.223902 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:31.223902 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:31.223902 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 10:41:31.223902 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:41:31.226160 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 119/239] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:41:31.238312 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae67b8c-911c-4bcc-967c-e2cdb1e94983 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:31.285240 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e456949-ed94-4652-9c7d-2d726645fd7f None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:31.287220 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:31.343196 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445aab3-17dd-4452-9d74-af975e524a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:31.344078 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445aab3-17dd-4452-9d74-af975e524a7e None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:31.344499 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445aab3-17dd-4452-9d74-af975e524a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:31.344914 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445aab3-17dd-4452-9d74-af975e524a7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:31.347121 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3445aab3-17dd-4452-9d74-af975e524a7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:31.348806 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3445aab3-17dd-4452-9d74-af975e524a7e None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:31.353411 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 121/240] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:41:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:31.357398 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445aab3-17dd-4452-9d74-af975e524a7e None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:31.465757 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:31.475540 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445aab3-17dd-4452-9d74-af975e524a7e None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:31.495620 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae67b8c-911c-4bcc-967c-e2cdb1e94983 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:31.544298 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69263b69-77dc-4e36-bab1-9be0382f73e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:31.544915 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69263b69-77dc-4e36-bab1-9be0382f73e2 None admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:31.545194 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69263b69-77dc-4e36-bab1-9be0382f73e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:31.545495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69263b69-77dc-4e36-bab1-9be0382f73e2 None admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:31.546169 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69263b69-77dc-4e36-bab1-9be0382f73e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:31.547619 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69263b69-77dc-4e36-bab1-9be0382f73e2 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:31.556864 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b09a5e-a71e-4180-b27d-45c5bdef2d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:31.557808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b09a5e-a71e-4180-b27d-45c5bdef2d35 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:31.558300 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b09a5e-a71e-4180-b27d-45c5bdef2d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:31.558762 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b09a5e-a71e-4180-b27d-45c5bdef2d35 None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:31.559622 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b09a5e-a71e-4180-b27d-45c5bdef2d35 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:31.560166 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b09a5e-a71e-4180-b27d-45c5bdef2d35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:31.561874 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b09a5e-a71e-4180-b27d-45c5bdef2d35 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:31.571977 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 120/241] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 7 10:41:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:31.573443 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf07528-51fb-4ae9-bf74-599dec27972b None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:31.573961 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf07528-51fb-4ae9-bf74-599dec27972b None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:31.574544 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf07528-51fb-4ae9-bf74-599dec27972b None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:31.579986 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 122/243] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 7 10:41:31 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:41:31.579986 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69263b69-77dc-4e36-bab1-9be0382f73e2 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:31.580395 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 121/243] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:31.581852 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b7f24-899d-498b-80fd-fc8d083753ba None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:31.582387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b7f24-899d-498b-80fd-fc8d083753ba None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:31.582851 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b7f24-899d-498b-80fd-fc8d083753ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:31.611389 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-603b7f24-899d-498b-80fd-fc8d083753ba None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:31.613631 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-603b7f24-899d-498b-80fd-fc8d083753ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:31.704890 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69263b69-77dc-4e36-bab1-9be0382f73e2 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:31.747046 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0330caa-65bc-426a-a472-6c60c97ea42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:31.747953 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0330caa-65bc-426a-a472-6c60c97ea42a None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:31.748460 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0330caa-65bc-426a-a472-6c60c97ea42a None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:31.750214 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0330caa-65bc-426a-a472-6c60c97ea42a None admin] PATH_INFO: `/v3/users/9a15a778dcee4d21b55905ccd3f228ab` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:31.767721 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0330caa-65bc-426a-a472-6c60c97ea42a None admin] RBAC: Authorizing `identity:get_user(user_id=9a15a778dcee4d21b55905ccd3f228ab)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:31.769568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0330caa-65bc-426a-a472-6c60c97ea42a None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:31.771828 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 123/244] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:31 2022] GET /identity/v3/users/9a15a778dcee4d21b55905ccd3f228ab => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:31.777343 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0330caa-65bc-426a-a472-6c60c97ea42a None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:31.789725 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:31.796609 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 122/245] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:31.834371 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b7f24-899d-498b-80fd-fc8d083753ba None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:31.837382 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:31.891589 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0330caa-65bc-426a-a472-6c60c97ea42a None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:31.941419 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07cd08-bd33-44a7-bea2-490c4ba9ba13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:31.942620 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07cd08-bd33-44a7-bea2-490c4ba9ba13 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:31.943388 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07cd08-bd33-44a7-bea2-490c4ba9ba13 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:31.944166 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07cd08-bd33-44a7-bea2-490c4ba9ba13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:32.011769 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b7f24-899d-498b-80fd-fc8d083753ba None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:32.047920 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07cd08-bd33-44a7-bea2-490c4ba9ba13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:32.051005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07cd08-bd33-44a7-bea2-490c4ba9ba13 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:32.054443 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a6970-e3cf-4b3a-a958-33b2184e5908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:32.055183 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a6970-e3cf-4b3a-a958-33b2184e5908 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:32.055462 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a6970-e3cf-4b3a-a958-33b2184e5908 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:32.055734 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a6970-e3cf-4b3a-a958-33b2184e5908 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:32.064381 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:32.074043 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a6970-e3cf-4b3a-a958-33b2184e5908 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:32.080856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-120a6970-e3cf-4b3a-a958-33b2184e5908 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:32.080856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:32.080856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:32.080856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:32.080856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:32.080856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:32.080856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:32.080856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:32.080856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:32.080856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:32.080856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:32.080856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:32.080856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:32.080856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:32.080856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:32.080856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:32.081894 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:32.081894 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:32.081894 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:32.081894 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:32.081894 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:32.081894 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:32.081894 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:32.081894 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:32.081894 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:32.081894 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:32.081894 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:32.081894 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:32.081894 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:32.081894 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:32.081894 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:32.081894 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:32.082702 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:32.082702 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:32.082702 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:32.082702 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:32.082702 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:32.082702 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:32.082702 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:32.082702 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:32.082702 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:32.082702 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:32.082702 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:32.082702 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:41:32.083304 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 123/246] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:32.091477 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a6970-e3cf-4b3a-a958-33b2184e5908 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:32.174195 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:32.195613 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 124/247] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:41:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 10:41:32.201036 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07cd08-bd33-44a7-bea2-490c4ba9ba13 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:32.219669 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a6970-e3cf-4b3a-a958-33b2184e5908 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:32.257564 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b554e5-0242-4957-ab3a-5fa2ed04f576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:32.258623 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b554e5-0242-4957-ab3a-5fa2ed04f576 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:32.259116 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b554e5-0242-4957-ab3a-5fa2ed04f576 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:32.259596 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b554e5-0242-4957-ab3a-5fa2ed04f576 None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:32.260453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b554e5-0242-4957-ab3a-5fa2ed04f576 None admin] RBAC: Adding query filter params (name=member) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:32.260979 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b554e5-0242-4957-ab3a-5fa2ed04f576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:32.262673 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b554e5-0242-4957-ab3a-5fa2ed04f576 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:32.273559 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 124/248] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 7 10:41:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:41:32.284167 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b554e5-0242-4957-ab3a-5fa2ed04f576 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:32.355000 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07cd08-bd33-44a7-bea2-490c4ba9ba13 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:32.365049 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:32.434051 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea2ba8-605a-4486-8692-917c1d8a586d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:32.434698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea2ba8-605a-4486-8692-917c1d8a586d None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:32.434976 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea2ba8-605a-4486-8692-917c1d8a586d None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:32.435251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea2ba8-605a-4486-8692-917c1d8a586d None admin] PATH_INFO: `/v3/projects/712e604258e7461484f5bd25d19f0cf0` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:32.436446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea2ba8-605a-4486-8692-917c1d8a586d None admin] RBAC: Authorizing `identity:get_project(project_id=712e604258e7461484f5bd25d19f0cf0)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:32.437942 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea2ba8-605a-4486-8692-917c1d8a586d None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:32.439982 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 125/249] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:32 2022] GET /identity/v3/projects/712e604258e7461484f5bd25d19f0cf0 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:41:32.447176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea2ba8-605a-4486-8692-917c1d8a586d None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:32.448023 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b554e5-0242-4957-ab3a-5fa2ed04f576 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:32.493694 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:32.509683 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf821696-0ee4-4039-b93f-deaa2af3450f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:32.510361 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf821696-0ee4-4039-b93f-deaa2af3450f None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:32.510643 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf821696-0ee4-4039-b93f-deaa2af3450f None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:32.510916 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf821696-0ee4-4039-b93f-deaa2af3450f None admin] PATH_INFO: `/v3/users/cfc288302e164ff59f59dce8f17b4133` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:32.512191 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf821696-0ee4-4039-b93f-deaa2af3450f None admin] RBAC: Authorizing `identity:get_user(user_id=cfc288302e164ff59f59dce8f17b4133)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:32.513788 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf821696-0ee4-4039-b93f-deaa2af3450f None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:32.515738 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 125/250] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:32 2022] GET /identity/v3/users/cfc288302e164ff59f59dce8f17b4133 => generated 297 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:32.521780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf821696-0ee4-4039-b93f-deaa2af3450f None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:32.620352 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea2ba8-605a-4486-8692-917c1d8a586d None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:32.683413 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21ff50-b0aa-4588-a0df-8ecf73bfca3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:32.684030 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21ff50-b0aa-4588-a0df-8ecf73bfca3a None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:32.684306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21ff50-b0aa-4588-a0df-8ecf73bfca3a None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:32.684573 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21ff50-b0aa-4588-a0df-8ecf73bfca3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:32.685331 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21ff50-b0aa-4588-a0df-8ecf73bfca3a None admin] RBAC: Adding query filter params (role.id=e9b673af6fc14dfe8c0762885c21da92, scope.project.id=712e604258e7461484f5bd25d19f0cf0, user.id=9a15a778dcee4d21b55905ccd3f228ab) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:32.685655 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21ff50-b0aa-4588-a0df-8ecf73bfca3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:32.687092 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21ff50-b0aa-4588-a0df-8ecf73bfca3a None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:32.699420 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 126/251] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:41:32 2022] GET /identity/v3/role_assignments?user.id=9a15a778dcee4d21b55905ccd3f228ab&scope.project.id=712e604258e7461484f5bd25d19f0cf0&role.id=e9b673af6fc14dfe8c0762885c21da92 => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:32.748387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf821696-0ee4-4039-b93f-deaa2af3450f None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:32.787301 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ba43f-885b-43e8-bf33-9c185480f12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:32.787854 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ba43f-885b-43e8-bf33-9c185480f12d None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:32.788127 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ba43f-885b-43e8-bf33-9c185480f12d None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:32.788395 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ba43f-885b-43e8-bf33-9c185480f12d None admin] PATH_INFO: `/v3/projects/712e604258e7461484f5bd25d19f0cf0` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:32.789575 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ba43f-885b-43e8-bf33-9c185480f12d None admin] RBAC: Authorizing `identity:get_project(project_id=712e604258e7461484f5bd25d19f0cf0)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:32.791008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ba43f-885b-43e8-bf33-9c185480f12d None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:32.793107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 126/252] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:32 2022] GET /identity/v3/projects/712e604258e7461484f5bd25d19f0cf0 => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:32.799086 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21ff50-b0aa-4588-a0df-8ecf73bfca3a None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:32.866409 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:32.945345 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21ff50-b0aa-4588-a0df-8ecf73bfca3a None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:32.980700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbd11c-88f4-4acc-8153-ffaae3cf775f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:32.981440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbd11c-88f4-4acc-8153-ffaae3cf775f None admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:32.981722 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbd11c-88f4-4acc-8153-ffaae3cf775f None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:32.981996 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbd11c-88f4-4acc-8153-ffaae3cf775f None admin] PATH_INFO: `/v3/projects/712e604258e7461484f5bd25d19f0cf0/users/cfc288302e164ff59f59dce8f17b4133/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:32.983999 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbd11c-88f4-4acc-8153-ffaae3cf775f None admin] RBAC: Authorizing `identity:create_grant(project_id=712e604258e7461484f5bd25d19f0cf0, user_id=cfc288302e164ff59f59dce8f17b4133, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:32.985458 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbd11c-88f4-4acc-8153-ffaae3cf775f None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:33.000880 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 127/253] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 7 10:41:32 2022] PUT /identity/v3/projects/712e604258e7461484f5bd25d19f0cf0/users/cfc288302e164ff59f59dce8f17b4133/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:41:33.175100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc1c87-15a2-4adf-a80f-be5ba321f01f None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:33.175614 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc1c87-15a2-4adf-a80f-be5ba321f01f None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:33.175614 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc1c87-15a2-4adf-a80f-be5ba321f01f None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:33.177301 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 127/254] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:33.182554 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f40a6-3756-4bea-8c0a-5c421b87e6ea None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:33.182838 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f40a6-3756-4bea-8c0a-5c421b87e6ea None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:33.183112 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f40a6-3756-4bea-8c0a-5c421b87e6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:33.210511 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-543f40a6-3756-4bea-8c0a-5c421b87e6ea None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:33.211747 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-543f40a6-3756-4bea-8c0a-5c421b87e6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:33.289218 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 128/255] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:33.326196 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ef8a0-4883-4750-8718-cdd41a9c2e4f None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:33.326501 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ef8a0-4883-4750-8718-cdd41a9c2e4f None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:33.326662 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f40a6-3756-4bea-8c0a-5c421b87e6ea None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:33.326755 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ef8a0-4883-4750-8718-cdd41a9c2e4f None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:33.328351 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 128/256] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:33.336155 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e4a7d-a76f-4070-b0ed-f0563292ea0a None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:33.336437 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e4a7d-a76f-4070-b0ed-f0563292ea0a None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:33.336714 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e4a7d-a76f-4070-b0ed-f0563292ea0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:33.361246 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-b31e4a7d-a76f-4070-b0ed-f0563292ea0a None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:33.363288 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-b31e4a7d-a76f-4070-b0ed-f0563292ea0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:33.365295 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:33.447669 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:33.466664 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 129/257] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 10:41:33.488449 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f40a6-3756-4bea-8c0a-5c421b87e6ea None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:33.512768 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e4a7d-a76f-4070-b0ed-f0563292ea0a None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:33.546605 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c69ba9-0ce7-4d5e-8aea-553ca2b8efff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:33.547701 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c69ba9-0ce7-4d5e-8aea-553ca2b8efff None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:33.548257 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c69ba9-0ce7-4d5e-8aea-553ca2b8efff None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:33.548764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c69ba9-0ce7-4d5e-8aea-553ca2b8efff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:33.573081 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c69ba9-0ce7-4d5e-8aea-553ca2b8efff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:33.578446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-35c69ba9-0ce7-4d5e-8aea-553ca2b8efff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 10:41:33.578446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:33.578446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:33.578446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:33.578446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:33.578446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:33.578446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:33.578446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:33.578446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:33.578446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:33.578446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:33.578446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:33.578446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:33.578446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:33.578446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:33.578446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:33.579309 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:33.579309 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:33.579309 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:33.579309 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:33.579309 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:33.579309 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:33.579309 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:33.579309 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:33.579309 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:33.579309 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:33.579309 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:33.579309 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:33.579309 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:33.579309 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:33.579309 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:33.579309 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:33.580133 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:33.580133 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:33.580133 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:33.580133 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:33.580133 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:33.580133 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:33.580133 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:33.580133 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:33.580133 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:33.580133 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:33.580133 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 10:41:33.580133 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:41:33.584210 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 129/258] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 7 10:41:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:41:33.591102 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c69ba9-0ce7-4d5e-8aea-553ca2b8efff None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:33.713584 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e4a7d-a76f-4070-b0ed-f0563292ea0a None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:33.776918 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:33.795635 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82c78c-59ee-4ef9-b5c1-0d62d130c615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:33.796657 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82c78c-59ee-4ef9-b5c1-0d62d130c615 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:33.797135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82c78c-59ee-4ef9-b5c1-0d62d130c615 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:33.797648 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82c78c-59ee-4ef9-b5c1-0d62d130c615 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:33.812150 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c69ba9-0ce7-4d5e-8aea-553ca2b8efff None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:33.818790 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a82c78c-59ee-4ef9-b5c1-0d62d130c615 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:33.830639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-3a82c78c-59ee-4ef9-b5c1-0d62d130c615 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:41:33.830639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:33.830639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:33.830639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:33.830639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:33.830639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:33.830639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:33.830639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:33.830639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:33.830639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:33.830639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:33.830639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:33.830639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:33.830639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:33.830639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:33.830639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:33.831573 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:33.831573 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:33.831573 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:33.831573 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:33.831573 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:33.831573 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:33.831573 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:33.831573 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:33.831573 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:33.831573 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:33.831573 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:33.831573 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:33.831573 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:33.831573 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:33.831573 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:33.831573 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:33.832366 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:33.832366 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:33.832366 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:33.832366 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:33.832366 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:33.832366 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:33.832366 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:33.832366 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:33.832366 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:33.832366 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:33.832366 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:41:33.832366 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:41:33.836436 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 130/259] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:41:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:41:33.842143 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82c78c-59ee-4ef9-b5c1-0d62d130c615 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:33.883623 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96464d4c-bb73-4470-b00b-8cb7f060f1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:33.884613 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96464d4c-bb73-4470-b00b-8cb7f060f1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:33.885089 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96464d4c-bb73-4470-b00b-8cb7f060f1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:33.885647 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96464d4c-bb73-4470-b00b-8cb7f060f1a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:33.887270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96464d4c-bb73-4470-b00b-8cb7f060f1a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:33.887778 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96464d4c-bb73-4470-b00b-8cb7f060f1a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:33.890237 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96464d4c-bb73-4470-b00b-8cb7f060f1a5 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:33.907184 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 130/260] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:41:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:33.910443 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96464d4c-bb73-4470-b00b-8cb7f060f1a5 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:33.942098 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:34.060975 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82c78c-59ee-4ef9-b5c1-0d62d130c615 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:34.146567 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe9014-2ba6-4971-b1be-ac7db6a79468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:34.147553 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe9014-2ba6-4971-b1be-ac7db6a79468 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:34.148249 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe9014-2ba6-4971-b1be-ac7db6a79468 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:34.149443 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe9014-2ba6-4971-b1be-ac7db6a79468 None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:34.150475 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe9014-2ba6-4971-b1be-ac7db6a79468 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:34.151525 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe9014-2ba6-4971-b1be-ac7db6a79468 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:34.153292 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe9014-2ba6-4971-b1be-ac7db6a79468 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:34.155358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96464d4c-bb73-4470-b00b-8cb7f060f1a5 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:34.178150 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 131/261] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:34.183769 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe9014-2ba6-4971-b1be-ac7db6a79468 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:34.234576 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21695a35-5ba2-46d9-9a8b-4213fdfd6e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:34.235211 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21695a35-5ba2-46d9-9a8b-4213fdfd6e48 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:34.235504 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21695a35-5ba2-46d9-9a8b-4213fdfd6e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:34.235765 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21695a35-5ba2-46d9-9a8b-4213fdfd6e48 None admin] PATH_INFO: `/v3/users/d736d6b0cbbc48bf9b8f135aa1ddfe1c` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:34.242000 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21695a35-5ba2-46d9-9a8b-4213fdfd6e48 None admin] RBAC: Authorizing `identity:get_user(user_id=d736d6b0cbbc48bf9b8f135aa1ddfe1c)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:34.243450 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21695a35-5ba2-46d9-9a8b-4213fdfd6e48 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:34.245644 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 131/262] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:33 2022] GET /identity/v3/users/d736d6b0cbbc48bf9b8f135aa1ddfe1c => generated 283 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:34.251661 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21695a35-5ba2-46d9-9a8b-4213fdfd6e48 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:34.281908 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:34.382617 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21695a35-5ba2-46d9-9a8b-4213fdfd6e48 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:34.395268 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe9014-2ba6-4971-b1be-ac7db6a79468 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:34.416903 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f9cd2-f00e-439e-9a09-2e4e94c0445b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:34.417521 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f9cd2-f00e-439e-9a09-2e4e94c0445b None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:34.417800 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f9cd2-f00e-439e-9a09-2e4e94c0445b None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:34.418071 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f9cd2-f00e-439e-9a09-2e4e94c0445b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:34.426269 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:34.486093 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943c5fd-08b1-43aa-900c-4b7629d0207c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:34.487177 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943c5fd-08b1-43aa-900c-4b7629d0207c None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:34.487655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943c5fd-08b1-43aa-900c-4b7629d0207c None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:34.488117 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943c5fd-08b1-43aa-900c-4b7629d0207c None admin] PATH_INFO: `/v3/users/d736d6b0cbbc48bf9b8f135aa1ddfe1c` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:34.488557 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f9cd2-f00e-439e-9a09-2e4e94c0445b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:34.489767 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943c5fd-08b1-43aa-900c-4b7629d0207c None admin] RBAC: Authorizing `identity:get_user(user_id=d736d6b0cbbc48bf9b8f135aa1ddfe1c)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:34.490055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f9cd2-f00e-439e-9a09-2e4e94c0445b None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:34.491805 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943c5fd-08b1-43aa-900c-4b7629d0207c None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:34.493660 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 132/263] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:34 2022] GET /identity/v3/users/d736d6b0cbbc48bf9b8f135aa1ddfe1c => generated 283 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:41:34.499507 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943c5fd-08b1-43aa-900c-4b7629d0207c None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:34.512067 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:34.598630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 132/264] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:41:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 10:41:34.604196 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f9cd2-f00e-439e-9a09-2e4e94c0445b None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:34.763052 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f9cd2-f00e-439e-9a09-2e4e94c0445b None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:34.785273 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943c5fd-08b1-43aa-900c-4b7629d0207c None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:34.794669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:34.831777 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595875e-b976-449e-af2d-a07d1227be88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:34.832482 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595875e-b976-449e-af2d-a07d1227be88 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:34.832763 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595875e-b976-449e-af2d-a07d1227be88 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:34.833034 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595875e-b976-449e-af2d-a07d1227be88 None admin] PATH_INFO: `/v3/projects/712e604258e7461484f5bd25d19f0cf0` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:34.834783 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f595875e-b976-449e-af2d-a07d1227be88 None admin] RBAC: Authorizing `identity:get_project(project_id=712e604258e7461484f5bd25d19f0cf0)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:34.836229 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f595875e-b976-449e-af2d-a07d1227be88 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:34.837915 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 133/265] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:34 2022] GET /identity/v3/projects/712e604258e7461484f5bd25d19f0cf0 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:34.843924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595875e-b976-449e-af2d-a07d1227be88 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:34.886041 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f331f2-640a-40fa-87ea-eee91b98302f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:34.886727 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f331f2-640a-40fa-87ea-eee91b98302f None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:34.886997 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f331f2-640a-40fa-87ea-eee91b98302f None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:34.887276 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f331f2-640a-40fa-87ea-eee91b98302f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:34.988887 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:35.022175 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f331f2-640a-40fa-87ea-eee91b98302f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:35.023654 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f331f2-640a-40fa-87ea-eee91b98302f None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:35.038327 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595875e-b976-449e-af2d-a07d1227be88 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:35.122590 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b35db-ccd6-4a01-a4af-d491a0b60eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:35.123216 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b35db-ccd6-4a01-a4af-d491a0b60eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:35.123489 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b35db-ccd6-4a01-a4af-d491a0b60eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:35.123755 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b35db-ccd6-4a01-a4af-d491a0b60eb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:35.124495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b35db-ccd6-4a01-a4af-d491a0b60eb6 None admin] RBAC: Adding query filter params (role.id=4269d6d5c6c048728859af681b3610fb, scope.project.id=712e604258e7461484f5bd25d19f0cf0, user.id=d736d6b0cbbc48bf9b8f135aa1ddfe1c) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:35.124801 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b35db-ccd6-4a01-a4af-d491a0b60eb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:35.126274 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b35db-ccd6-4a01-a4af-d491a0b60eb6 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:35.147624 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 134/266] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:41:34 2022] GET /identity/v3/role_assignments?user.id=d736d6b0cbbc48bf9b8f135aa1ddfe1c&scope.project.id=712e604258e7461484f5bd25d19f0cf0&role.id=4269d6d5c6c048728859af681b3610fb => generated 608 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:35.148809 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c601778-7513-4dc9-9373-416d083282a6 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:35.149088 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c601778-7513-4dc9-9373-416d083282a6 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:35.149377 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c601778-7513-4dc9-9373-416d083282a6 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:35.150830 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 135/267] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:35.173948 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 133/268] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:41:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 10:41:35.179432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f331f2-640a-40fa-87ea-eee91b98302f None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:35.180099 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b191e-dbcf-433a-93fc-1d98c6b9ef6d None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:35.180099 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b191e-dbcf-433a-93fc-1d98c6b9ef6d None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:35.180099 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b191e-dbcf-433a-93fc-1d98c6b9ef6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:35.225295 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-ae5b191e-dbcf-433a-93fc-1d98c6b9ef6d None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:35.226513 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ae5b191e-dbcf-433a-93fc-1d98c6b9ef6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:35.342418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:35.360797 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:35.370657 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 136/269] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:35.372461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a27dd-3914-4e3d-98cb-2fe4daf34cec None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:35.372727 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a27dd-3914-4e3d-98cb-2fe4daf34cec None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:35.373000 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a27dd-3914-4e3d-98cb-2fe4daf34cec None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:35.374277 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 137/270] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:35.380376 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a49cd-ddb1-45b7-b1ab-febd1ed0d4b2 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:35.380650 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a49cd-ddb1-45b7-b1ab-febd1ed0d4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:35.380914 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a49cd-ddb1-45b7-b1ab-febd1ed0d4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:35.401828 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-295a49cd-ddb1-45b7-b1ab-febd1ed0d4b2 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:35.403303 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-295a49cd-ddb1-45b7-b1ab-febd1ed0d4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:35.405898 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f331f2-640a-40fa-87ea-eee91b98302f None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:35.449536 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14100487-3bf5-4fcd-b2a0-0f58295746d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:35.450349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14100487-3bf5-4fcd-b2a0-0f58295746d7 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:35.450723 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14100487-3bf5-4fcd-b2a0-0f58295746d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:35.451001 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14100487-3bf5-4fcd-b2a0-0f58295746d7 None admin] PATH_INFO: `/v3/projects/712e604258e7461484f5bd25d19f0cf0` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:35.452935 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14100487-3bf5-4fcd-b2a0-0f58295746d7 None admin] RBAC: Authorizing `identity:get_project(project_id=712e604258e7461484f5bd25d19f0cf0)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:35.454416 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14100487-3bf5-4fcd-b2a0-0f58295746d7 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:35.457537 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 134/271] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:35 2022] GET /identity/v3/projects/712e604258e7461484f5bd25d19f0cf0 => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:41:35.458390 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14100487-3bf5-4fcd-b2a0-0f58295746d7 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:35.502030 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 138/272] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 10:41:35.502901 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a49cd-ddb1-45b7-b1ab-febd1ed0d4b2 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:35.612585 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14100487-3bf5-4fcd-b2a0-0f58295746d7 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:35.630545 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a49cd-ddb1-45b7-b1ab-febd1ed0d4b2 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:35.641974 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:35.653787 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0de43-ea50-450b-aa85-59446b73eddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:35.654346 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0de43-ea50-450b-aa85-59446b73eddb None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:35.654618 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0de43-ea50-450b-aa85-59446b73eddb None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:35.654886 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0de43-ea50-450b-aa85-59446b73eddb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:35.666001 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0de43-ea50-450b-aa85-59446b73eddb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:35.668647 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e7acd-7a2b-42af-a9e3-411419a79cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:35.669259 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e7acd-7a2b-42af-a9e3-411419a79cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:35.669562 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e7acd-7a2b-42af-a9e3-411419a79cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:35.669834 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e7acd-7a2b-42af-a9e3-411419a79cc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:35.670570 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e7acd-7a2b-42af-a9e3-411419a79cc8 None admin] RBAC: Adding query filter params (role.id=9da6e501237c405ca021a9d9f6173caf, scope.project.id=712e604258e7461484f5bd25d19f0cf0, user.id=d736d6b0cbbc48bf9b8f135aa1ddfe1c) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:35.670878 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e7acd-7a2b-42af-a9e3-411419a79cc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:35.672303 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e7acd-7a2b-42af-a9e3-411419a79cc8 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:35.672893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-0bd0de43-ea50-450b-aa85-59446b73eddb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:35.672893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:35.672893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:35.672893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:35.672893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:35.672893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:35.672893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:35.672893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:35.672893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:35.672893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:35.672893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:35.672893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:35.672893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:35.672893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:35.672893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:35.672893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:35.674348 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:35.674348 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:35.674348 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:35.674348 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:35.674348 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:35.674348 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:35.674348 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:35.674348 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:35.674348 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:35.674348 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:35.674348 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:35.674348 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:35.674348 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:35.674348 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:35.674348 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:35.674348 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:35.675150 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:35.675150 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:35.675150 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:35.675150 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:35.675150 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:35.675150 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:35.675150 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:35.675150 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:35.675150 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:35.675150 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:35.675150 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:35.675150 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:41:35.675150 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 135/273] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:35.676279 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0de43-ea50-450b-aa85-59446b73eddb None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:35.679859 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 139/274] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:41:35 2022] GET /identity/v3/role_assignments?user.id=d736d6b0cbbc48bf9b8f135aa1ddfe1c&scope.project.id=712e604258e7461484f5bd25d19f0cf0&role.id=9da6e501237c405ca021a9d9f6173caf => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:35.681422 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e7acd-7a2b-42af-a9e3-411419a79cc8 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:35.690493 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:35.815962 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0de43-ea50-450b-aa85-59446b73eddb None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:35.819461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e7acd-7a2b-42af-a9e3-411419a79cc8 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:35.857740 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a1a9a-a533-4e0d-93cc-11ae8022e276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:35.858216 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461edf2-be0d-461f-9fa2-dcacc5d8deb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:35.858332 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a1a9a-a533-4e0d-93cc-11ae8022e276 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:35.858605 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a1a9a-a533-4e0d-93cc-11ae8022e276 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:35.858875 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a1a9a-a533-4e0d-93cc-11ae8022e276 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:35.859551 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a1a9a-a533-4e0d-93cc-11ae8022e276 None admin] RBAC: Adding query filter params (name=member) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:35.859730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461edf2-be0d-461f-9fa2-dcacc5d8deb0 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:35.859856 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a1a9a-a533-4e0d-93cc-11ae8022e276 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:35.859946 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461edf2-be0d-461f-9fa2-dcacc5d8deb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:35.860203 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461edf2-be0d-461f-9fa2-dcacc5d8deb0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:35.861508 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a1a9a-a533-4e0d-93cc-11ae8022e276 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:35.861615 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461edf2-be0d-461f-9fa2-dcacc5d8deb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:35.863291 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461edf2-be0d-461f-9fa2-dcacc5d8deb0 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:35.870278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 136/275] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:41:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:35.870278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0dcdce-5b91-4c93-bdfb-46c3ce8c3ebe None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:35.870278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0dcdce-5b91-4c93-bdfb-46c3ce8c3ebe None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:35.870278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0dcdce-5b91-4c93-bdfb-46c3ce8c3ebe None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:35.870278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 137/276] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:35.870664 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66495fb2-fd4a-4733-baf6-130a8c8a7686 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:35.871890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66495fb2-fd4a-4733-baf6-130a8c8a7686 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:35.871890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66495fb2-fd4a-4733-baf6-130a8c8a7686 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:35.872061 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 140/277] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 7 10:41:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:35.872620 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a1a9a-a533-4e0d-93cc-11ae8022e276 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:35.872720 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 138/278] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:35.877463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a7bc6-cd4a-47b3-a2eb-8d619e34c6dc None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:35.877685 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a7bc6-cd4a-47b3-a2eb-8d619e34c6dc None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:35.877956 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a7bc6-cd4a-47b3-a2eb-8d619e34c6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:35.898675 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-d28a7bc6-cd4a-47b3-a2eb-8d619e34c6dc None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:35.900207 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-d28a7bc6-cd4a-47b3-a2eb-8d619e34c6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:35.916909 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:35.974568 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 139/279] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:35.975420 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a7bc6-cd4a-47b3-a2eb-8d619e34c6dc None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:35.985743 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:35.992611 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a1a9a-a533-4e0d-93cc-11ae8022e276 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:36.026850 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41a19f-10e2-4607-bdec-caeb0cc8b31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:36.027448 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41a19f-10e2-4607-bdec-caeb0cc8b31e None admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:36.027720 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41a19f-10e2-4607-bdec-caeb0cc8b31e None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:36.027983 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41a19f-10e2-4607-bdec-caeb0cc8b31e None admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:36.028624 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41a19f-10e2-4607-bdec-caeb0cc8b31e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:36.030074 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41a19f-10e2-4607-bdec-caeb0cc8b31e None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:36.052329 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 141/280] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 7 10:41:35 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:41:36.053572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1e5ed-2275-4eed-83ec-c25429f2bd03 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:36.053860 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1e5ed-2275-4eed-83ec-c25429f2bd03 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:36.054132 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1e5ed-2275-4eed-83ec-c25429f2bd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:36.073524 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-13b1e5ed-2275-4eed-83ec-c25429f2bd03 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:36.074760 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-13b1e5ed-2275-4eed-83ec-c25429f2bd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:36.103379 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a7bc6-cd4a-47b3-a2eb-8d619e34c6dc None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:36.147247 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10cdb0-bcff-4081-a63d-7e757e5c762f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:36.147882 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10cdb0-bcff-4081-a63d-7e757e5c762f None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:36.148154 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10cdb0-bcff-4081-a63d-7e757e5c762f None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:36.148419 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10cdb0-bcff-4081-a63d-7e757e5c762f None admin] PATH_INFO: `/v3/users/b929e6d4043743d8a27b74fd1479027f` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:36.155838 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 142/281] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:36.157461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1e5ed-2275-4eed-83ec-c25429f2bd03 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:36.165720 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10cdb0-bcff-4081-a63d-7e757e5c762f None admin] RBAC: Authorizing `identity:get_user(user_id=b929e6d4043743d8a27b74fd1479027f)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:36.167433 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10cdb0-bcff-4081-a63d-7e757e5c762f None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:36.175027 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 140/282] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:35 2022] GET /identity/v3/users/b929e6d4043743d8a27b74fd1479027f => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:36.176150 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10cdb0-bcff-4081-a63d-7e757e5c762f None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:36.192262 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:36.256137 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:36.283263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1e5ed-2275-4eed-83ec-c25429f2bd03 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:36.302420 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10cdb0-bcff-4081-a63d-7e757e5c762f None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:36.325653 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e13723-2b9b-4e30-9eb1-a885a29c0f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:36.326281 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e13723-2b9b-4e30-9eb1-a885a29c0f69 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:36.326558 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e13723-2b9b-4e30-9eb1-a885a29c0f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:36.326823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e13723-2b9b-4e30-9eb1-a885a29c0f69 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:36.340491 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e13723-2b9b-4e30-9eb1-a885a29c0f69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:36.347463 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-b6e13723-2b9b-4e30-9eb1-a885a29c0f69 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 10:41:36.347463 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:36.347463 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:36.347463 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:36.347463 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:36.347463 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:36.347463 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:36.347463 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:36.347463 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:36.347463 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:36.347463 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:36.347463 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:36.347463 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:36.347463 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:36.347463 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:36.347463 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:36.348748 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:36.348748 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:36.348748 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:36.348748 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:36.348748 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:36.348748 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:36.348748 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:36.348748 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:36.348748 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:36.348748 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:36.348748 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:36.348748 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:36.348748 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:36.348748 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:36.348748 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:36.348748 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:36.349566 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:36.349566 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:36.349566 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:36.349566 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:36.349566 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:36.349566 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:36.349566 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:36.349566 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:36.349566 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:36.349566 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:36.349566 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 10:41:36.349566 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:41:36.350734 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 143/283] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:36.351386 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e13723-2b9b-4e30-9eb1-a885a29c0f69 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:36.365741 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f642836-eed0-4c26-ae3d-6709862646b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:36.366359 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f642836-eed0-4c26-ae3d-6709862646b3 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:36.366637 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f642836-eed0-4c26-ae3d-6709862646b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:36.366906 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f642836-eed0-4c26-ae3d-6709862646b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:36.368049 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f642836-eed0-4c26-ae3d-6709862646b3 None admin] RBAC: Adding query filter params (role.id=28e65a5027f7406cac824e6ff6474bb2, user.id=b929e6d4043743d8a27b74fd1479027f, scope.system=all) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:36.368361 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f642836-eed0-4c26-ae3d-6709862646b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:36.371518 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f642836-eed0-4c26-ae3d-6709862646b3 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:36.378368 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 141/284] 10.222.0.27 () {56 vars in 1308 bytes} [Sun Aug 7 10:41:36 2022] GET /identity/v3/role_assignments?user.id=b929e6d4043743d8a27b74fd1479027f&scope.system=all&role.id=28e65a5027f7406cac824e6ff6474bb2 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:36.379209 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f642836-eed0-4c26-ae3d-6709862646b3 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:36.459286 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:36.484426 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e13723-2b9b-4e30-9eb1-a885a29c0f69 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:36.528060 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786077d-d88b-4be2-b1cf-3a3bf66c5b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:36.528431 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f642836-eed0-4c26-ae3d-6709862646b3 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:36.529171 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786077d-d88b-4be2-b1cf-3a3bf66c5b3f None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:36.529582 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786077d-d88b-4be2-b1cf-3a3bf66c5b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:36.529856 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786077d-d88b-4be2-b1cf-3a3bf66c5b3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:36.556870 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786077d-d88b-4be2-b1cf-3a3bf66c5b3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:36.561668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-3786077d-d88b-4be2-b1cf-3a3bf66c5b3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:36.561668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:36.561668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:36.561668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:36.561668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:36.561668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:36.561668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:36.561668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:36.561668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:36.561668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:36.561668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:36.561668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:36.561668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:36.561668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:36.561668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:36.561668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:36.562541 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:36.562541 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:36.562541 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:36.562541 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:36.562541 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:36.562541 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:36.562541 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:36.562541 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:36.562541 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:36.562541 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:36.562541 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:36.562541 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:36.562541 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:36.562541 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:36.562541 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:36.562541 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:36.563339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:36.563339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:36.563339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:36.563339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:36.563339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:36.563339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:36.563339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:36.563339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:36.563339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:36.563339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:36.563339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:36.563339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:41:36.563339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 144/285] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:36.573098 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786077d-d88b-4be2-b1cf-3a3bf66c5b3f None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:36.591317 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:36.617302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b6678-15df-4392-937a-9eeb73da5041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:36.617940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b6678-15df-4392-937a-9eeb73da5041 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:36.618215 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b6678-15df-4392-937a-9eeb73da5041 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:36.618482 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b6678-15df-4392-937a-9eeb73da5041 None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:36.619434 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b6678-15df-4392-937a-9eeb73da5041 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:36.619732 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b6678-15df-4392-937a-9eeb73da5041 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:36.621124 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b6678-15df-4392-937a-9eeb73da5041 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:36.634879 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 142/286] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 7 10:41:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:36.641538 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b6678-15df-4392-937a-9eeb73da5041 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:36.705425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786077d-d88b-4be2-b1cf-3a3bf66c5b3f None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:36.742008 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7588a1-8c1b-4660-8b56-defe40f8bbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:36.743044 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7588a1-8c1b-4660-8b56-defe40f8bbd0 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:36.743550 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7588a1-8c1b-4660-8b56-defe40f8bbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:36.744293 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7588a1-8c1b-4660-8b56-defe40f8bbd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:36.745105 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7588a1-8c1b-4660-8b56-defe40f8bbd0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:36.745567 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7588a1-8c1b-4660-8b56-defe40f8bbd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:36.747186 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7588a1-8c1b-4660-8b56-defe40f8bbd0 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:36.756826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 145/287] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 7 10:41:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:36.761096 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b6678-15df-4392-937a-9eeb73da5041 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:36.762843 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7588a1-8c1b-4660-8b56-defe40f8bbd0 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:36.786208 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:36.795454 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06aec54-a508-41a4-848a-069a0f89ca88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:36.796092 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06aec54-a508-41a4-848a-069a0f89ca88 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:36.796366 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06aec54-a508-41a4-848a-069a0f89ca88 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:36.796684 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06aec54-a508-41a4-848a-069a0f89ca88 None admin] PATH_INFO: `/v3/users/9a15a778dcee4d21b55905ccd3f228ab` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:36.797810 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06aec54-a508-41a4-848a-069a0f89ca88 None admin] RBAC: Authorizing `identity:get_user(user_id=9a15a778dcee4d21b55905ccd3f228ab)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:36.799371 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06aec54-a508-41a4-848a-069a0f89ca88 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:36.801285 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 143/288] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:36 2022] GET /identity/v3/users/9a15a778dcee4d21b55905ccd3f228ab => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:36.808368 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06aec54-a508-41a4-848a-069a0f89ca88 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:36.882033 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:36.916172 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7588a1-8c1b-4660-8b56-defe40f8bbd0 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:36.929340 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06aec54-a508-41a4-848a-069a0f89ca88 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:36.974325 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea935f-8efb-421d-b515-91a018f88b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:36.975065 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea935f-8efb-421d-b515-91a018f88b09 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:36.975348 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea935f-8efb-421d-b515-91a018f88b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:36.975620 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea935f-8efb-421d-b515-91a018f88b09 None admin] PATH_INFO: `/v3/users/cfc288302e164ff59f59dce8f17b4133` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:36.976762 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea935f-8efb-421d-b515-91a018f88b09 None admin] RBAC: Authorizing `identity:get_user(user_id=cfc288302e164ff59f59dce8f17b4133)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:36.977801 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e6106-2156-41f0-a65b-8ba79535b343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:36.978365 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea935f-8efb-421d-b515-91a018f88b09 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:36.978816 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e6106-2156-41f0-a65b-8ba79535b343 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:36.979256 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e6106-2156-41f0-a65b-8ba79535b343 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:36.979698 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e6106-2156-41f0-a65b-8ba79535b343 None admin] PATH_INFO: `/v3/projects/712e604258e7461484f5bd25d19f0cf0` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:36.983041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 146/289] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:36 2022] GET /identity/v3/users/cfc288302e164ff59f59dce8f17b4133 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:41:36.986995 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea935f-8efb-421d-b515-91a018f88b09 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:36.987958 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e6106-2156-41f0-a65b-8ba79535b343 None admin] RBAC: Authorizing `identity:get_project(project_id=712e604258e7461484f5bd25d19f0cf0)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:36.990487 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e6106-2156-41f0-a65b-8ba79535b343 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:36.994897 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 144/290] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:36 2022] GET /identity/v3/projects/712e604258e7461484f5bd25d19f0cf0 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:37.003540 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e6106-2156-41f0-a65b-8ba79535b343 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:37.137665 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:37.174610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e6106-2156-41f0-a65b-8ba79535b343 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:37.188333 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea935f-8efb-421d-b515-91a018f88b09 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:37.227438 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:37.247253 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cd3db-30e8-4515-9ff1-25f68e3b6f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:37.247792 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cd3db-30e8-4515-9ff1-25f68e3b6f8f None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:37.248075 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cd3db-30e8-4515-9ff1-25f68e3b6f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:37.248355 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cd3db-30e8-4515-9ff1-25f68e3b6f8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:37.249994 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c465bf-ce62-4f8b-acc1-aae46799f54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:37.250655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c465bf-ce62-4f8b-acc1-aae46799f54e None admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:37.250931 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c465bf-ce62-4f8b-acc1-aae46799f54e None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:37.251200 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c465bf-ce62-4f8b-acc1-aae46799f54e None admin] PATH_INFO: `/v3/projects/712e604258e7461484f5bd25d19f0cf0/users/9a15a778dcee4d21b55905ccd3f228ab/roles/e9b673af6fc14dfe8c0762885c21da92` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:37.258057 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c465bf-ce62-4f8b-acc1-aae46799f54e None admin] RBAC: Authorizing `identity:create_grant(project_id=712e604258e7461484f5bd25d19f0cf0, user_id=9a15a778dcee4d21b55905ccd3f228ab, role_id=e9b673af6fc14dfe8c0762885c21da92)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:37.259507 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c465bf-ce62-4f8b-acc1-aae46799f54e None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:37.287573 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 145/291] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 7 10:41:37 2022] PUT /identity/v3/projects/712e604258e7461484f5bd25d19f0cf0/users/9a15a778dcee4d21b55905ccd3f228ab/roles/e9b673af6fc14dfe8c0762885c21da92 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:41:37.325925 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196cd3db-30e8-4515-9ff1-25f68e3b6f8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:37.327430 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196cd3db-30e8-4515-9ff1-25f68e3b6f8f None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:37.416936 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:37.448028 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 147/292] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:41:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:41:37.450461 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c465bf-ce62-4f8b-acc1-aae46799f54e None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:37.572146 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c465bf-ce62-4f8b-acc1-aae46799f54e None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:37.606899 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b238d-8a59-44d5-9c0e-c23b11a1d78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:37.607528 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b238d-8a59-44d5-9c0e-c23b11a1d78e None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:37.607809 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b238d-8a59-44d5-9c0e-c23b11a1d78e None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:37.608079 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b238d-8a59-44d5-9c0e-c23b11a1d78e None admin] PATH_INFO: `/v3/projects/712e604258e7461484f5bd25d19f0cf0` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:37.609428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b238d-8a59-44d5-9c0e-c23b11a1d78e None admin] RBAC: Authorizing `identity:get_project(project_id=712e604258e7461484f5bd25d19f0cf0)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:37.610854 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b238d-8a59-44d5-9c0e-c23b11a1d78e None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:37.612873 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 146/293] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:37 2022] GET /identity/v3/projects/712e604258e7461484f5bd25d19f0cf0 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:37.618534 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cd3db-30e8-4515-9ff1-25f68e3b6f8f None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:37.743626 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cd3db-30e8-4515-9ff1-25f68e3b6f8f None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:37.778510 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be223da-5aaa-45a4-9c8c-8967f6c4462c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:37.779116 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be223da-5aaa-45a4-9c8c-8967f6c4462c None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:37.779390 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be223da-5aaa-45a4-9c8c-8967f6c4462c None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:37.779655 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be223da-5aaa-45a4-9c8c-8967f6c4462c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:37.780378 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be223da-5aaa-45a4-9c8c-8967f6c4462c None admin] RBAC: Adding query filter params (role.id=28e65a5027f7406cac824e6ff6474bb2, scope.project.id=712e604258e7461484f5bd25d19f0cf0, user.id=cfc288302e164ff59f59dce8f17b4133) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:37.780677 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be223da-5aaa-45a4-9c8c-8967f6c4462c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:37.782127 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be223da-5aaa-45a4-9c8c-8967f6c4462c None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:37.793447 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 148/294] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:41:37 2022] GET /identity/v3/role_assignments?user.id=cfc288302e164ff59f59dce8f17b4133&scope.project.id=712e604258e7461484f5bd25d19f0cf0&role.id=28e65a5027f7406cac824e6ff6474bb2 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:38.484635 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29c294-2c0d-4420-b462-84ee407bac51 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:38.485658 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29c294-2c0d-4420-b462-84ee407bac51 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:38.486645 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29c294-2c0d-4420-b462-84ee407bac51 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:38.488447 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 147/295] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:38.493767 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6427883-6020-454b-b4b1-290719976cba None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:38.494826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6427883-6020-454b-b4b1-290719976cba None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:38.495291 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6427883-6020-454b-b4b1-290719976cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:38.513343 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-e6427883-6020-454b-b4b1-290719976cba None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:38.514869 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-e6427883-6020-454b-b4b1-290719976cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:38.528858 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013932d7-f608-4117-aa00-97ab6eeb9801 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:38.529457 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013932d7-f608-4117-aa00-97ab6eeb9801 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:38.529925 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013932d7-f608-4117-aa00-97ab6eeb9801 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:38.531476 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 148/296] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 10:41:38.538572 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ae95c-b602-41cb-bc0d-c83d324001e5 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:38.539138 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ae95c-b602-41cb-bc0d-c83d324001e5 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:38.539606 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ae95c-b602-41cb-bc0d-c83d324001e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:38.550853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:38.562165 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-eb6ae95c-b602-41cb-bc0d-c83d324001e5 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:38.564236 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-eb6ae95c-b602-41cb-bc0d-c83d324001e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:38.599840 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 149/297] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:38.623239 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6427883-6020-454b-b4b1-290719976cba None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:38.638489 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:38.650825 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 149/298] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:38.672883 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ae95c-b602-41cb-bc0d-c83d324001e5 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:38.754561 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6427883-6020-454b-b4b1-290719976cba None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:38.794336 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cb797-7ebb-4e7a-9067-0ad935b8ecc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:38.795343 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cb797-7ebb-4e7a-9067-0ad935b8ecc8 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:38.795835 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cb797-7ebb-4e7a-9067-0ad935b8ecc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:38.796300 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0cb797-7ebb-4e7a-9067-0ad935b8ecc8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:38.807232 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ae95c-b602-41cb-bc0d-c83d324001e5 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:38.807695 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0cb797-7ebb-4e7a-9067-0ad935b8ecc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:38.813068 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-5c0cb797-7ebb-4e7a-9067-0ad935b8ecc8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 10:41:38.813068 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:38.813068 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:38.813068 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:38.813068 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:38.813068 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:38.813068 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:38.813068 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:38.813068 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:38.813068 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:38.813068 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:38.813068 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:38.813068 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:38.813068 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:38.813068 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:38.813068 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:38.813962 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:38.813962 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:38.813962 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:38.813962 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:38.813962 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:38.813962 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:38.813962 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:38.813962 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:38.813962 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:38.813962 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:38.813962 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:38.813962 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:38.813962 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:38.813962 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:38.813962 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:38.813962 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:38.815312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:38.815312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:38.815312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:38.815312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:38.815312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:38.815312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:38.815312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:38.815312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:38.815312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:38.815312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:38.815312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 10:41:38.815312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:41:38.817999 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 150/299] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:41:38.824296 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cb797-7ebb-4e7a-9067-0ad935b8ecc8 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:38.850272 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf51deb-2c90-494d-a7ff-0b8d06b3c55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:38.850819 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf51deb-2c90-494d-a7ff-0b8d06b3c55f None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:38.851146 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf51deb-2c90-494d-a7ff-0b8d06b3c55f None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:38.851418 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf51deb-2c90-494d-a7ff-0b8d06b3c55f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:38.852531 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf51deb-2c90-494d-a7ff-0b8d06b3c55f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:38.854003 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf51deb-2c90-494d-a7ff-0b8d06b3c55f None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:38.856798 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 150/300] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:41:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:41:38.860589 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:38.863057 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034f536-c951-4cb4-9715-99609d973e58 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:38.863406 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034f536-c951-4cb4-9715-99609d973e58 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:38.863836 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034f536-c951-4cb4-9715-99609d973e58 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:38.865254 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 151/301] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:38.869816 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034f536-c951-4cb4-9715-99609d973e58 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:38.927898 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:38.939932 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0cb797-7ebb-4e7a-9067-0ad935b8ecc8 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:38.977546 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489f377-cda1-4676-93a0-5f97112a0755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:38.978437 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489f377-cda1-4676-93a0-5f97112a0755 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:38.979023 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489f377-cda1-4676-93a0-5f97112a0755 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:38.979202 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034f536-c951-4cb4-9715-99609d973e58 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:38.979641 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489f377-cda1-4676-93a0-5f97112a0755 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:38.980478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489f377-cda1-4676-93a0-5f97112a0755 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:38.980924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489f377-cda1-4676-93a0-5f97112a0755 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:38.982511 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489f377-cda1-4676-93a0-5f97112a0755 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:38.991424 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 151/302] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 7 10:41:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:41:38.992608 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86671baa-48d2-4406-81dc-5e899aa54bbe None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:38.992892 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86671baa-48d2-4406-81dc-5e899aa54bbe None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:38.993165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86671baa-48d2-4406-81dc-5e899aa54bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:39.011797 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-86671baa-48d2-4406-81dc-5e899aa54bbe None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:39.012967 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-86671baa-48d2-4406-81dc-5e899aa54bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:39.020855 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c61e9b-73e9-49e0-86ea-5754f3ba24a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:39.021514 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c61e9b-73e9-49e0-86ea-5754f3ba24a7 None admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:39.021797 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c61e9b-73e9-49e0-86ea-5754f3ba24a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:39.022070 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c61e9b-73e9-49e0-86ea-5754f3ba24a7 None admin] PATH_INFO: `/v3/groups` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:39.023067 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c61e9b-73e9-49e0-86ea-5754f3ba24a7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:39.024800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c61e9b-73e9-49e0-86ea-5754f3ba24a7 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:39.043057 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 152/303] 10.222.0.27 () {60 vars in 1134 bytes} [Sun Aug 7 10:41:38 2022] POST /identity/v3/groups => generated 229 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:41:39.054409 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c61e9b-73e9-49e0-86ea-5754f3ba24a7 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:39.098967 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 152/304] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:39.131560 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86671baa-48d2-4406-81dc-5e899aa54bbe None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:39.159719 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:39.185438 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c61e9b-73e9-49e0-86ea-5754f3ba24a7 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:39.202148 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:39.233022 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008d428-d84e-4452-9579-c3b0bdad9ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:39.233989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008d428-d84e-4452-9579-c3b0bdad9ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:39.234448 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008d428-d84e-4452-9579-c3b0bdad9ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:39.234891 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008d428-d84e-4452-9579-c3b0bdad9ac6 None admin] PATH_INFO: `/v3/users/7d56d68e717043a79d1f8d7230e7f080` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:39.259349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1008d428-d84e-4452-9579-c3b0bdad9ac6 None admin] RBAC: Authorizing `identity:get_user(user_id=7d56d68e717043a79d1f8d7230e7f080)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:39.260816 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1008d428-d84e-4452-9579-c3b0bdad9ac6 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:39.262846 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 153/305] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:39 2022] GET /identity/v3/users/7d56d68e717043a79d1f8d7230e7f080 => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:39.266325 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86671baa-48d2-4406-81dc-5e899aa54bbe None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:39.268943 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008d428-d84e-4452-9579-c3b0bdad9ac6 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:39.308331 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d6284-985e-4187-9ce3-89a4f886a8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:39.309027 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d6284-985e-4187-9ce3-89a4f886a8da None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:39.309370 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d6284-985e-4187-9ce3-89a4f886a8da None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:39.309647 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d6284-985e-4187-9ce3-89a4f886a8da None admin] PATH_INFO: `/v3/roles/member` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:39.323845 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d6284-985e-4187-9ce3-89a4f886a8da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:39.331054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-440d6284-985e-4187-9ce3-89a4f886a8da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:39.331054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:39.331054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:39.331054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:39.331054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:39.331054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:39.331054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:39.331054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:39.331054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:39.331054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:39.331054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:39.331054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:39.331054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:39.331054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:39.331054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:39.331054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:39.332040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:39.332040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:39.332040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:39.332040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:39.332040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:39.332040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:39.332040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:39.332040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:39.332040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:39.332040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:39.332040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:39.332040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:39.332040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:39.332040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:39.332040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:39.332040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:39.332829 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:39.332829 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:39.332829 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:39.332829 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:39.332829 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:39.332829 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:39.332829 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:39.332829 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:39.332829 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:39.332829 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:39.332829 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:39.332829 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:41:39.333455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 153/306] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:41:39.339828 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d6284-985e-4187-9ce3-89a4f886a8da None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:39.398993 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008d428-d84e-4452-9579-c3b0bdad9ac6 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:39.426872 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:39.446737 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740e8be-40c7-4aef-a86e-9f11e214f03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:39.447666 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740e8be-40c7-4aef-a86e-9f11e214f03b None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:39.448089 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740e8be-40c7-4aef-a86e-9f11e214f03b None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:39.448629 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740e8be-40c7-4aef-a86e-9f11e214f03b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:39.450422 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740e8be-40c7-4aef-a86e-9f11e214f03b None admin] RBAC: Adding query filter params (role.id=e9b673af6fc14dfe8c0762885c21da92, user.id=7d56d68e717043a79d1f8d7230e7f080, scope.system=all) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:39.450734 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740e8be-40c7-4aef-a86e-9f11e214f03b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:39.452155 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740e8be-40c7-4aef-a86e-9f11e214f03b None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:39.456512 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d6284-985e-4187-9ce3-89a4f886a8da None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:39.457974 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 154/307] 10.222.0.27 () {56 vars in 1308 bytes} [Sun Aug 7 10:41:39 2022] GET /identity/v3/role_assignments?user.id=7d56d68e717043a79d1f8d7230e7f080&scope.system=all&role.id=e9b673af6fc14dfe8c0762885c21da92 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:41:39.496551 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b76155-909f-48b6-9e80-e0fba1299af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:39.497842 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b76155-909f-48b6-9e80-e0fba1299af5 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:39.498315 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b76155-909f-48b6-9e80-e0fba1299af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:39.498724 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b76155-909f-48b6-9e80-e0fba1299af5 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:39.499549 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b76155-909f-48b6-9e80-e0fba1299af5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:39.500010 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b76155-909f-48b6-9e80-e0fba1299af5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:39.501576 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b76155-909f-48b6-9e80-e0fba1299af5 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:39.511992 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 154/308] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 7 10:41:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:41:39.518310 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740e8be-40c7-4aef-a86e-9f11e214f03b None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:39.559211 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:39.605757 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ed955-2d14-4b90-9afd-67a045856eb1 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:39.606415 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ed955-2d14-4b90-9afd-67a045856eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:39.606892 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ed955-2d14-4b90-9afd-67a045856eb1 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:39.608776 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 155/309] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 10:41:39.614592 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d819405-2f85-48bb-aceb-6f428d85201c None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:39.615136 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d819405-2f85-48bb-aceb-6f428d85201c None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:39.615716 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d819405-2f85-48bb-aceb-6f428d85201c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:39.635397 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-6d819405-2f85-48bb-aceb-6f428d85201c None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:39.636571 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-6d819405-2f85-48bb-aceb-6f428d85201c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:39.644516 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740e8be-40c7-4aef-a86e-9f11e214f03b None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:39.690504 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4648b75-4bca-46c1-8b23-bd7122d14817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:39.691509 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4648b75-4bca-46c1-8b23-bd7122d14817 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:39.692072 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4648b75-4bca-46c1-8b23-bd7122d14817 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:39.692598 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4648b75-4bca-46c1-8b23-bd7122d14817 None admin] PATH_INFO: `/v3/users/b929e6d4043743d8a27b74fd1479027f` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:39.694137 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4648b75-4bca-46c1-8b23-bd7122d14817 None admin] RBAC: Authorizing `identity:get_user(user_id=b929e6d4043743d8a27b74fd1479027f)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:39.695932 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4648b75-4bca-46c1-8b23-bd7122d14817 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:39.698145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 155/310] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:39 2022] GET /identity/v3/users/b929e6d4043743d8a27b74fd1479027f => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:39.705468 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4648b75-4bca-46c1-8b23-bd7122d14817 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:39.710522 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 156/311] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:39.739042 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d819405-2f85-48bb-aceb-6f428d85201c None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:39.813295 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4648b75-4bca-46c1-8b23-bd7122d14817 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:39.815378 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:39.817700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:39.851664 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d819405-2f85-48bb-aceb-6f428d85201c None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:39.852998 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0fbab-864c-4dc4-901a-5d37a07cc755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:39.854045 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0fbab-864c-4dc4-901a-5d37a07cc755 None admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:39.854328 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0fbab-864c-4dc4-901a-5d37a07cc755 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:39.854657 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0fbab-864c-4dc4-901a-5d37a07cc755 None admin] PATH_INFO: `/v3/system/users/b929e6d4043743d8a27b74fd1479027f/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:39.856586 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0fbab-864c-4dc4-901a-5d37a07cc755 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b929e6d4043743d8a27b74fd1479027f, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:39.858509 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0fbab-864c-4dc4-901a-5d37a07cc755 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:39.881348 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 156/312] 10.222.0.27 () {58 vars in 1334 bytes} [Sun Aug 7 10:41:39 2022] PUT /identity/v3/system/users/b929e6d4043743d8a27b74fd1479027f/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:41:39.909359 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22260cc-0c8a-489b-8848-c5657bb50be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:39.910049 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22260cc-0c8a-489b-8848-c5657bb50be4 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:39.910445 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22260cc-0c8a-489b-8848-c5657bb50be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:39.910714 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22260cc-0c8a-489b-8848-c5657bb50be4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:39.925327 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22260cc-0c8a-489b-8848-c5657bb50be4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:39.930507 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-d22260cc-0c8a-489b-8848-c5657bb50be4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 10:41:39.930507 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:39.930507 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:39.930507 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:39.930507 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:39.930507 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:39.930507 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:39.930507 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:39.930507 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:39.930507 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:39.930507 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:39.930507 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:39.930507 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:39.930507 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:39.930507 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:39.930507 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:39.931425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:39.931425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:39.931425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:39.931425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:39.931425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:39.931425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:39.931425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:39.931425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:39.931425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:39.931425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:39.931425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:39.931425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:39.931425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:39.931425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:39.931425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:39.931425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:39.932461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:39.932461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:39.932461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:39.932461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:39.932461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:39.932461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:39.932461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:39.932461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:39.932461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:39.932461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:39.932461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 10:41:39.932461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:41:39.932461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 157/313] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:39.937998 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0fbab-864c-4dc4-901a-5d37a07cc755 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:40.060173 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0fbab-864c-4dc4-901a-5d37a07cc755 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:40.095259 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48393626-099c-45a4-853e-a34dcd97fc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:40.095893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48393626-099c-45a4-853e-a34dcd97fc5f None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:40.096170 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48393626-099c-45a4-853e-a34dcd97fc5f None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:40.096440 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48393626-099c-45a4-853e-a34dcd97fc5f None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:40.097109 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48393626-099c-45a4-853e-a34dcd97fc5f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:40.097439 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48393626-099c-45a4-853e-a34dcd97fc5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:40.098884 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48393626-099c-45a4-853e-a34dcd97fc5f None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:40.107663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 157/314] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 7 10:41:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:40.114011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22260cc-0c8a-489b-8848-c5657bb50be4 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:40.225542 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22260cc-0c8a-489b-8848-c5657bb50be4 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:40.262447 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:40.270103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31844508-3f6c-488a-ade0-d61d69c3a2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:40.270757 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31844508-3f6c-488a-ade0-d61d69c3a2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:40.271032 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31844508-3f6c-488a-ade0-d61d69c3a2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:40.271366 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31844508-3f6c-488a-ade0-d61d69c3a2c9 None admin] PATH_INFO: `/v3/users/9a15a778dcee4d21b55905ccd3f228ab` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:40.272714 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31844508-3f6c-488a-ade0-d61d69c3a2c9 None admin] RBAC: Authorizing `identity:get_user(user_id=9a15a778dcee4d21b55905ccd3f228ab)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:40.274217 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31844508-3f6c-488a-ade0-d61d69c3a2c9 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:40.276152 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 158/315] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:40 2022] GET /identity/v3/users/9a15a778dcee4d21b55905ccd3f228ab => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:40.282479 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48393626-099c-45a4-853e-a34dcd97fc5f None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:40.314795 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:40.390562 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48393626-099c-45a4-853e-a34dcd97fc5f None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:40.426553 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c9006-5e57-4fe1-861e-74b2d94dc55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:40.427152 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c9006-5e57-4fe1-861e-74b2d94dc55f None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:40.427426 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c9006-5e57-4fe1-861e-74b2d94dc55f None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:40.427691 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c9006-5e57-4fe1-861e-74b2d94dc55f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:40.497799 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c9006-5e57-4fe1-861e-74b2d94dc55f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:40.499255 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c9006-5e57-4fe1-861e-74b2d94dc55f None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:40.528678 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:40.613611 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 158/316] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:41:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:41:40.619448 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31844508-3f6c-488a-ade0-d61d69c3a2c9 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:40.727234 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31844508-3f6c-488a-ade0-d61d69c3a2c9 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:40.763213 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dfe167-daff-49be-94e1-a1c09d593c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:40.763840 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfe167-daff-49be-94e1-a1c09d593c4d None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:40.764117 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfe167-daff-49be-94e1-a1c09d593c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:40.764382 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfe167-daff-49be-94e1-a1c09d593c4d None admin] PATH_INFO: `/v3/projects/712e604258e7461484f5bd25d19f0cf0` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:40.765589 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dfe167-daff-49be-94e1-a1c09d593c4d None admin] RBAC: Authorizing `identity:get_project(project_id=712e604258e7461484f5bd25d19f0cf0)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:40.767083 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dfe167-daff-49be-94e1-a1c09d593c4d None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:40.773673 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 159/317] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:40 2022] GET /identity/v3/projects/712e604258e7461484f5bd25d19f0cf0 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:40.775492 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c9006-5e57-4fe1-861e-74b2d94dc55f None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:40.874918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c9006-5e57-4fe1-861e-74b2d94dc55f None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:40.904247 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:40.910842 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9012bcc-4c41-4d50-8868-4aa1b093a558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:40.911444 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9012bcc-4c41-4d50-8868-4aa1b093a558 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:40.911720 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9012bcc-4c41-4d50-8868-4aa1b093a558 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:40.911992 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9012bcc-4c41-4d50-8868-4aa1b093a558 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:40.912720 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9012bcc-4c41-4d50-8868-4aa1b093a558 None admin] RBAC: Adding query filter params (role.id=e9b673af6fc14dfe8c0762885c21da92, scope.project.id=712e604258e7461484f5bd25d19f0cf0, user.id=9a15a778dcee4d21b55905ccd3f228ab) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:40.913027 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9012bcc-4c41-4d50-8868-4aa1b093a558 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:40.914551 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9012bcc-4c41-4d50-8868-4aa1b093a558 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:40.920496 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 159/318] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:41:40 2022] GET /identity/v3/role_assignments?user.id=9a15a778dcee4d21b55905ccd3f228ab&scope.project.id=712e604258e7461484f5bd25d19f0cf0&role.id=e9b673af6fc14dfe8c0762885c21da92 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:41.169334 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f205d13-648c-4eb2-ac10-5d525e240d4d None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:41.169675 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f205d13-648c-4eb2-ac10-5d525e240d4d None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:41.169797 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f205d13-648c-4eb2-ac10-5d525e240d4d None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:41.171276 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 160/319] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:41.176744 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55536ae-4b12-4f23-a011-924210992c80 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:41.177035 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55536ae-4b12-4f23-a011-924210992c80 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:41.177328 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55536ae-4b12-4f23-a011-924210992c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:41.195155 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-e55536ae-4b12-4f23-a011-924210992c80 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:41.196351 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-e55536ae-4b12-4f23-a011-924210992c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:41.264671 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 160/320] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:41.286594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f205d13-648c-4eb2-ac10-5d525e240d4d None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:41.359402 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:41.396062 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f205d13-648c-4eb2-ac10-5d525e240d4d None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:41.429454 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9ec98-739d-4686-afa4-9e72a98811bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:41.430005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9ec98-739d-4686-afa4-9e72a98811bc None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:41.430280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9ec98-739d-4686-afa4-9e72a98811bc None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:41.430543 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9ec98-739d-4686-afa4-9e72a98811bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:41.431632 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9ec98-739d-4686-afa4-9e72a98811bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:41.433065 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9ec98-739d-4686-afa4-9e72a98811bc None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:41.434935 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 161/321] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:41:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:41.441016 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55536ae-4b12-4f23-a011-924210992c80 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:41.539414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55536ae-4b12-4f23-a011-924210992c80 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:41.554833 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff134d33-2906-443f-baf9-b35105a63549 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:41.555116 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff134d33-2906-443f-baf9-b35105a63549 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:41.555384 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff134d33-2906-443f-baf9-b35105a63549 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:41.556745 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 162/322] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 10:41:41.561726 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f037b-a4e5-4b1f-b1f6-b8b31d764dc4 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:41.562004 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f037b-a4e5-4b1f-b1f6-b8b31d764dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:41.562269 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f037b-a4e5-4b1f-b1f6-b8b31d764dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:41.567153 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:41.578797 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76169a15-ae4f-42fe-b076-6b5f6971a66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:41.579453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76169a15-ae4f-42fe-b076-6b5f6971a66e None admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:41.579735 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76169a15-ae4f-42fe-b076-6b5f6971a66e None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:41.580046 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76169a15-ae4f-42fe-b076-6b5f6971a66e None admin] PATH_INFO: `/v3/groups` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:41.580789 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76169a15-ae4f-42fe-b076-6b5f6971a66e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:41.581119 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-846f037b-a4e5-4b1f-b1f6-b8b31d764dc4 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:41.582306 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76169a15-ae4f-42fe-b076-6b5f6971a66e None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:41.582401 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-846f037b-a4e5-4b1f-b1f6-b8b31d764dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:41.601021 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 161/323] 10.222.0.27 () {60 vars in 1134 bytes} [Sun Aug 7 10:41:41 2022] POST /identity/v3/groups => generated 226 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:41:41.667615 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 163/324] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 10:41:41.689350 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76169a15-ae4f-42fe-b076-6b5f6971a66e None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:41.802231 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76169a15-ae4f-42fe-b076-6b5f6971a66e None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:41.836701 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8903a97-a2fc-431f-8443-f4b41607550f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:41.837347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8903a97-a2fc-431f-8443-f4b41607550f None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:41.837633 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8903a97-a2fc-431f-8443-f4b41607550f None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:41.837904 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8903a97-a2fc-431f-8443-f4b41607550f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:41.850901 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8903a97-a2fc-431f-8443-f4b41607550f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:41.856218 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-b8903a97-a2fc-431f-8443-f4b41607550f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 10:41:41.856218 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:41.856218 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:41.856218 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:41.856218 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:41.856218 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:41.856218 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:41.856218 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:41.856218 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:41.856218 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:41.856218 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:41.856218 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:41.856218 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:41.856218 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:41.856218 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:41.856218 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:41.857125 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:41.857125 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:41.857125 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:41.857125 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:41.857125 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:41.857125 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:41.857125 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:41.857125 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:41.857125 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:41.857125 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:41.857125 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:41.857125 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:41.857125 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:41.857125 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:41.857125 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:41.857125 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:41.858374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:41.858374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:41.858374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:41.858374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:41.858374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:41.858374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:41.858374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:41.858374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:41.858374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:41.858374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:41.858374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 10:41:41.858374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:41:41.858374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 162/325] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:41.864494 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f037b-a4e5-4b1f-b1f6-b8b31d764dc4 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:41.954099 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:41.998162 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f037b-a4e5-4b1f-b1f6-b8b31d764dc4 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:42.035265 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031e684-8d8e-4d80-8827-f75c9d4d743d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:42.035879 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031e684-8d8e-4d80-8827-f75c9d4d743d None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:42.036151 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031e684-8d8e-4d80-8827-f75c9d4d743d None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:42.036416 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031e684-8d8e-4d80-8827-f75c9d4d743d None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:42.037151 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031e684-8d8e-4d80-8827-f75c9d4d743d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:42.037485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031e684-8d8e-4d80-8827-f75c9d4d743d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:42.038843 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031e684-8d8e-4d80-8827-f75c9d4d743d None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:42.049483 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 164/326] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 7 10:41:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:41:42.054990 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8903a97-a2fc-431f-8443-f4b41607550f None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:42.097888 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86525f7-949c-4607-b069-d77fd70308aa None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:42.098216 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86525f7-949c-4607-b069-d77fd70308aa None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:42.098426 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86525f7-949c-4607-b069-d77fd70308aa None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:42.099923 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 165/327] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 10:41:42.104649 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243079c-acd1-4bb2-81b7-43a481ab93eb None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:42.104902 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243079c-acd1-4bb2-81b7-43a481ab93eb None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:42.105172 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243079c-acd1-4bb2-81b7-43a481ab93eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:42.124002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-b243079c-acd1-4bb2-81b7-43a481ab93eb None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:42.125181 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-b243079c-acd1-4bb2-81b7-43a481ab93eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:42.144248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:42.233037 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8903a97-a2fc-431f-8443-f4b41607550f None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:42.233583 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 166/328] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 10:41:42.263462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243079c-acd1-4bb2-81b7-43a481ab93eb None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:42.281939 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183e043-4b8e-41ba-8c5c-b3e8925ba349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:42.282787 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183e043-4b8e-41ba-8c5c-b3e8925ba349 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:42.283674 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183e043-4b8e-41ba-8c5c-b3e8925ba349 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:42.283947 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183e043-4b8e-41ba-8c5c-b3e8925ba349 None admin] PATH_INFO: `/v3/users/7d56d68e717043a79d1f8d7230e7f080` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:42.285392 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183e043-4b8e-41ba-8c5c-b3e8925ba349 None admin] RBAC: Authorizing `identity:get_user(user_id=7d56d68e717043a79d1f8d7230e7f080)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:42.286962 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183e043-4b8e-41ba-8c5c-b3e8925ba349 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:42.288574 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 163/329] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:42 2022] GET /identity/v3/users/7d56d68e717043a79d1f8d7230e7f080 => generated 293 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:42.302161 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183e043-4b8e-41ba-8c5c-b3e8925ba349 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:42.345299 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:42.394018 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243079c-acd1-4bb2-81b7-43a481ab93eb None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:42.431565 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183e043-4b8e-41ba-8c5c-b3e8925ba349 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:42.439386 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8c86f-c13d-42b8-92c6-f297bf078dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:42.440042 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8c86f-c13d-42b8-92c6-f297bf078dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:42.440320 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8c86f-c13d-42b8-92c6-f297bf078dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:42.440595 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8c86f-c13d-42b8-92c6-f297bf078dd7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:42.444980 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:42.456808 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8c86f-c13d-42b8-92c6-f297bf078dd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:42.465817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-0cd8c86f-c13d-42b8-92c6-f297bf078dd7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:42.465817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:42.465817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:42.465817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:42.465817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:42.465817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:42.465817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:42.465817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:42.465817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:42.465817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:42.465817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:42.465817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:42.465817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:42.465817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:42.465817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:42.465817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:42.466744 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:42.466744 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:42.466744 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:42.466744 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:42.466744 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:42.466744 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:42.466744 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:42.466744 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:42.466744 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:42.466744 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:42.466744 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:42.466744 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:42.466744 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:42.466744 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:42.466744 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:42.466744 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:42.467508 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:42.467508 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:42.467508 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:42.467508 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:42.467508 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:42.467508 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:42.467508 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:42.467508 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:42.467508 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:42.467508 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:42.467508 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:42.467508 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:41:42.467508 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 167/330] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:42.474255 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8c86f-c13d-42b8-92c6-f297bf078dd7 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:42.478028 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b94154-19eb-4a93-917d-3a418ecc84b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:42.478695 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b94154-19eb-4a93-917d-3a418ecc84b3 None admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:42.478975 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b94154-19eb-4a93-917d-3a418ecc84b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:42.479247 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b94154-19eb-4a93-917d-3a418ecc84b3 None admin] PATH_INFO: `/v3/system/users/7d56d68e717043a79d1f8d7230e7f080/roles/e9b673af6fc14dfe8c0762885c21da92` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:42.480782 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b94154-19eb-4a93-917d-3a418ecc84b3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7d56d68e717043a79d1f8d7230e7f080, role_id=e9b673af6fc14dfe8c0762885c21da92)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:42.482186 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b94154-19eb-4a93-917d-3a418ecc84b3 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:42.497555 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 164/331] 10.222.0.27 () {58 vars in 1334 bytes} [Sun Aug 7 10:41:42 2022] PUT /identity/v3/system/users/7d56d68e717043a79d1f8d7230e7f080/roles/e9b673af6fc14dfe8c0762885c21da92 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:41:42.594443 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8c86f-c13d-42b8-92c6-f297bf078dd7 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:42.613966 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:42.635567 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5235609-b8ac-4e1f-a209-18d02e09b4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:42.636177 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5235609-b8ac-4e1f-a209-18d02e09b4be None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:42.636500 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5235609-b8ac-4e1f-a209-18d02e09b4be None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:42.636774 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5235609-b8ac-4e1f-a209-18d02e09b4be None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:42.637518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5235609-b8ac-4e1f-a209-18d02e09b4be None admin] RBAC: Adding query filter params (name=member) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:42.637823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5235609-b8ac-4e1f-a209-18d02e09b4be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:42.639327 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5235609-b8ac-4e1f-a209-18d02e09b4be None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:42.648811 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 168/332] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 7 10:41:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:41:42.654365 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b94154-19eb-4a93-917d-3a418ecc84b3 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:42.785636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b94154-19eb-4a93-917d-3a418ecc84b3 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:42.826096 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2ab5b-e100-4ac0-90a8-d8d26f7b702a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:42.826728 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2ab5b-e100-4ac0-90a8-d8d26f7b702a None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:42.827005 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2ab5b-e100-4ac0-90a8-d8d26f7b702a None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:42.827275 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2ab5b-e100-4ac0-90a8-d8d26f7b702a None admin] PATH_INFO: `/v3/users/b929e6d4043743d8a27b74fd1479027f` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:42.828426 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c2ab5b-e100-4ac0-90a8-d8d26f7b702a None admin] RBAC: Authorizing `identity:get_user(user_id=b929e6d4043743d8a27b74fd1479027f)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:42.829985 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c2ab5b-e100-4ac0-90a8-d8d26f7b702a None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:42.831878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 165/333] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:42 2022] GET /identity/v3/users/b929e6d4043743d8a27b74fd1479027f => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:42.837468 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5235609-b8ac-4e1f-a209-18d02e09b4be None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:42.946118 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5235609-b8ac-4e1f-a209-18d02e09b4be None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:42.983415 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef92e15-6d97-4ab6-aa14-fab25d90e11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:42.984027 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef92e15-6d97-4ab6-aa14-fab25d90e11e None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:42.984372 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef92e15-6d97-4ab6-aa14-fab25d90e11e None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:42.984631 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef92e15-6d97-4ab6-aa14-fab25d90e11e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:42.985401 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef92e15-6d97-4ab6-aa14-fab25d90e11e None admin] RBAC: Adding query filter params (role.id=28e65a5027f7406cac824e6ff6474bb2, user.id=b929e6d4043743d8a27b74fd1479027f, scope.system=all) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:42.985710 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef92e15-6d97-4ab6-aa14-fab25d90e11e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:42.987680 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef92e15-6d97-4ab6-aa14-fab25d90e11e None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:43.001106 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 169/334] 10.222.0.27 () {56 vars in 1308 bytes} [Sun Aug 7 10:41:42 2022] GET /identity/v3/role_assignments?user.id=b929e6d4043743d8a27b74fd1479027f&scope.system=all&role.id=28e65a5027f7406cac824e6ff6474bb2 => generated 510 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:41:44.436579 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358de67-2b33-4256-9eaa-5b29a6376670 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:44.437083 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358de67-2b33-4256-9eaa-5b29a6376670 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:44.437342 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358de67-2b33-4256-9eaa-5b29a6376670 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:44.439042 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 166/335] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:44.445597 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7690d-2d81-4726-9742-5ee377ee1ff3 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:44.446010 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7690d-2d81-4726-9742-5ee377ee1ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:44.446144 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7690d-2d81-4726-9742-5ee377ee1ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:44.469047 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-5cd7690d-2d81-4726-9742-5ee377ee1ff3 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:44.470255 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-5cd7690d-2d81-4726-9742-5ee377ee1ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:44.512302 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:44.554402 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 170/336] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:44.580491 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358de67-2b33-4256-9eaa-5b29a6376670 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:44.636992 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:44.714981 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358de67-2b33-4256-9eaa-5b29a6376670 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:44.758484 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b72d7a-cafe-4b6b-a536-f2ad178c3040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:44.759109 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b72d7a-cafe-4b6b-a536-f2ad178c3040 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:44.759380 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b72d7a-cafe-4b6b-a536-f2ad178c3040 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:44.759643 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b72d7a-cafe-4b6b-a536-f2ad178c3040 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:44.772884 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b72d7a-cafe-4b6b-a536-f2ad178c3040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:44.778132 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-92b72d7a-cafe-4b6b-a536-f2ad178c3040 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 10:41:44.778132 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:44.778132 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:44.778132 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:44.778132 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:44.778132 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:44.778132 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:44.778132 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:44.778132 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:44.778132 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:44.778132 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:44.778132 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:44.778132 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:44.778132 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:44.778132 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:44.778132 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:44.779011 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:44.779011 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:44.779011 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:44.779011 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:44.779011 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:44.779011 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:44.779011 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:44.779011 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:44.779011 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:44.779011 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:44.779011 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:44.779011 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:44.779011 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:44.779011 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:44.779011 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:44.779011 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:44.779795 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:44.779795 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:44.779795 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:44.779795 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:44.779795 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:44.779795 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:44.779795 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:44.779795 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:44.779795 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:44.779795 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:44.779795 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 10:41:44.779795 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:41:44.779795 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 167/337] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 7 10:41:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:44.785401 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7690d-2d81-4726-9742-5ee377ee1ff3 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:44.866887 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84868d0-ea8f-45f8-8269-00b7817586d7 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:44.866887 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84868d0-ea8f-45f8-8269-00b7817586d7 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:44.866887 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84868d0-ea8f-45f8-8269-00b7817586d7 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:44.866887 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 168/338] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 10:41:44.873620 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0716c1-13c5-4771-a5f6-9e864c7d755f None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:44.874127 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0716c1-13c5-4771-a5f6-9e864c7d755f None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:44.874589 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0716c1-13c5-4771-a5f6-9e864c7d755f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:44.901150 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-ca0716c1-13c5-4771-a5f6-9e864c7d755f None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:44.902652 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-ca0716c1-13c5-4771-a5f6-9e864c7d755f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:44.959601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7690d-2d81-4726-9742-5ee377ee1ff3 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:44.985227 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 169/339] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 10:41:45.008470 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0716c1-13c5-4771-a5f6-9e864c7d755f None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:45.032502 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed01bfa-1c8e-43fc-8e7c-8548d81b1bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:45.034074 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed01bfa-1c8e-43fc-8e7c-8548d81b1bef None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:45.034563 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed01bfa-1c8e-43fc-8e7c-8548d81b1bef None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:45.035029 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed01bfa-1c8e-43fc-8e7c-8548d81b1bef None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:45.036963 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed01bfa-1c8e-43fc-8e7c-8548d81b1bef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:45.037500 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed01bfa-1c8e-43fc-8e7c-8548d81b1bef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:45.040476 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed01bfa-1c8e-43fc-8e7c-8548d81b1bef None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:45.058902 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 171/340] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:41:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:45.065046 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed01bfa-1c8e-43fc-8e7c-8548d81b1bef None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:45.069490 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:45.123961 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:45.188198 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0716c1-13c5-4771-a5f6-9e864c7d755f None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:45.226313 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f1628-f543-43db-bce9-c6a41fc6ecfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:45.227298 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f1628-f543-43db-bce9-c6a41fc6ecfd None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:45.227765 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f1628-f543-43db-bce9-c6a41fc6ecfd None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:45.228218 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f1628-f543-43db-bce9-c6a41fc6ecfd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:45.242974 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f1628-f543-43db-bce9-c6a41fc6ecfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:45.248278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-671f1628-f543-43db-bce9-c6a41fc6ecfd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:45.248278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:45.248278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:45.248278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:45.248278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:45.248278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:45.248278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:45.248278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:45.248278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:45.248278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:45.248278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:45.248278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:45.248278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:45.248278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:45.248278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:45.248278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:45.249155 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:45.249155 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:45.249155 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:45.249155 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:45.249155 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:45.249155 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:45.249155 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:45.249155 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:45.249155 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:45.249155 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:45.249155 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:45.249155 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:45.249155 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:45.249155 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:45.249155 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:45.249155 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:45.249984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:45.249984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:45.249984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:45.249984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:45.249984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:45.249984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:45.249984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:45.249984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:45.249984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:45.249984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:45.249984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:45.249984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:41:45.253303 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 170/341] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:45.259080 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf794a-859a-47b2-a4ff-e266c7e62445 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:45.259556 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf794a-859a-47b2-a4ff-e266c7e62445 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:45.260029 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf794a-859a-47b2-a4ff-e266c7e62445 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:45.261569 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 171/342] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:45.263736 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf794a-859a-47b2-a4ff-e266c7e62445 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:45.284998 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed01bfa-1c8e-43fc-8e7c-8548d81b1bef None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:45.330409 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3050f8-352b-449d-b7c9-1e64e3f87dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:45.330877 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3050f8-352b-449d-b7c9-1e64e3f87dbe None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:45.331163 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3050f8-352b-449d-b7c9-1e64e3f87dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:45.331429 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3050f8-352b-449d-b7c9-1e64e3f87dbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:45.381724 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf794a-859a-47b2-a4ff-e266c7e62445 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:45.393646 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:45.419742 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473724d-ec4b-4f59-9acf-bfd2fc37702f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:45.420903 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473724d-ec4b-4f59-9acf-bfd2fc37702f None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:45.421399 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473724d-ec4b-4f59-9acf-bfd2fc37702f None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:45.421879 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473724d-ec4b-4f59-9acf-bfd2fc37702f None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:45.422792 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473724d-ec4b-4f59-9acf-bfd2fc37702f None admin] RBAC: Adding query filter params (name=member) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:45.423351 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473724d-ec4b-4f59-9acf-bfd2fc37702f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:45.425506 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473724d-ec4b-4f59-9acf-bfd2fc37702f None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:45.432772 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3050f8-352b-449d-b7c9-1e64e3f87dbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:45.434244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3050f8-352b-449d-b7c9-1e64e3f87dbe None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:45.440728 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 172/343] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 7 10:41:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:41:45.442547 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b71c79-5619-4166-8b1e-c135f66a3813 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:45.443043 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b71c79-5619-4166-8b1e-c135f66a3813 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:45.443507 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b71c79-5619-4166-8b1e-c135f66a3813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:45.464841 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-37b71c79-5619-4166-8b1e-c135f66a3813 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:45.466441 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-37b71c79-5619-4166-8b1e-c135f66a3813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:45.477963 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:45.575830 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 173/344] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:45.577665 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b71c79-5619-4166-8b1e-c135f66a3813 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:45.624709 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 172/345] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:41:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:41:45.625952 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3050f8-352b-449d-b7c9-1e64e3f87dbe None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:45.709169 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:45.730026 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b71c79-5619-4166-8b1e-c135f66a3813 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:45.764175 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3050f8-352b-449d-b7c9-1e64e3f87dbe None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:45.778995 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7866e6-3b2d-4e15-a80f-0ac6d601b014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:45.780041 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7866e6-3b2d-4e15-a80f-0ac6d601b014 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:45.780933 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7866e6-3b2d-4e15-a80f-0ac6d601b014 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:45.781518 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7866e6-3b2d-4e15-a80f-0ac6d601b014 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:45.795007 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:45.804611 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065c391-9155-446a-a46e-82e70ed68044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:45.805243 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065c391-9155-446a-a46e-82e70ed68044 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:45.805636 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065c391-9155-446a-a46e-82e70ed68044 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:45.806127 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065c391-9155-446a-a46e-82e70ed68044 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:45.818319 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9065c391-9155-446a-a46e-82e70ed68044 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:45.823495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-9065c391-9155-446a-a46e-82e70ed68044 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:45.823495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:45.823495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:45.823495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:45.823495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:45.823495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:45.823495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:45.823495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:45.823495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:45.823495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:45.823495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:45.823495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:45.823495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:45.823495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:45.823495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:45.823495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:45.824505 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:45.824505 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:45.824505 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:45.824505 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:45.824505 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:45.824505 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:45.824505 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:45.824505 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:45.824505 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:45.824505 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:45.824505 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:45.824505 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:45.824505 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:45.824505 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:45.824505 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:45.824505 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:45.825408 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:45.825408 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:45.825408 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:45.825408 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:45.825408 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:45.825408 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:45.825408 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:45.825408 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:45.825408 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:45.825408 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:45.825408 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:45.825408 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:41:45.831617 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 173/346] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:45.832513 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065c391-9155-446a-a46e-82e70ed68044 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:45.871751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7866e6-3b2d-4e15-a80f-0ac6d601b014 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:45.874356 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7866e6-3b2d-4e15-a80f-0ac6d601b014 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:45.946162 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065c391-9155-446a-a46e-82e70ed68044 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:45.967971 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:45.986914 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 174/347] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:41:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:41:45.988585 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88671fa7-6685-4afe-9c49-8bfd16a7c364 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:45.989059 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88671fa7-6685-4afe-9c49-8bfd16a7c364 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:45.993360 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8704a0c-7cb6-44ca-89ce-ecc2290cf1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:45.993360 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8704a0c-7cb6-44ca-89ce-ecc2290cf1b4 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:45.993360 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8704a0c-7cb6-44ca-89ce-ecc2290cf1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:45.993921 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88671fa7-6685-4afe-9c49-8bfd16a7c364 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:45.994417 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8704a0c-7cb6-44ca-89ce-ecc2290cf1b4 None admin] PATH_INFO: `/v3/projects/aba7d21adf714e6ab286c14428bafa1b` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:45.995825 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 175/348] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:45.996207 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8704a0c-7cb6-44ca-89ce-ecc2290cf1b4 None admin] RBAC: Authorizing `identity:get_project(project_id=aba7d21adf714e6ab286c14428bafa1b)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:45.996588 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88671fa7-6685-4afe-9c49-8bfd16a7c364 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:46.001337 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8704a0c-7cb6-44ca-89ce-ecc2290cf1b4 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:46.003410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 174/349] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:45 2022] GET /identity/v3/projects/aba7d21adf714e6ab286c14428bafa1b => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:46.004333 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8704a0c-7cb6-44ca-89ce-ecc2290cf1b4 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:46.065751 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:46.113666 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8704a0c-7cb6-44ca-89ce-ecc2290cf1b4 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:46.114500 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88671fa7-6685-4afe-9c49-8bfd16a7c364 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:46.151297 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd98cdc-14bd-4a3e-934f-cfe380d50003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:46.151935 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd98cdc-14bd-4a3e-934f-cfe380d50003 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:46.152305 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd98cdc-14bd-4a3e-934f-cfe380d50003 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:46.152701 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd98cdc-14bd-4a3e-934f-cfe380d50003 None admin] PATH_INFO: `/v3/projects/aba7d21adf714e6ab286c14428bafa1b` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:46.153749 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920fb32-3334-4720-a7de-468128e11848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:46.153866 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd98cdc-14bd-4a3e-934f-cfe380d50003 None admin] RBAC: Authorizing `identity:get_project(project_id=aba7d21adf714e6ab286c14428bafa1b)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:46.154372 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920fb32-3334-4720-a7de-468128e11848 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:46.154648 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920fb32-3334-4720-a7de-468128e11848 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:46.155010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920fb32-3334-4720-a7de-468128e11848 None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:46.155399 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd98cdc-14bd-4a3e-934f-cfe380d50003 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:46.155681 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a920fb32-3334-4720-a7de-468128e11848 None admin] RBAC: Adding query filter params (name=member) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:46.155980 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a920fb32-3334-4720-a7de-468128e11848 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:46.157339 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a920fb32-3334-4720-a7de-468128e11848 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:46.157446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 175/350] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:46 2022] GET /identity/v3/projects/aba7d21adf714e6ab286c14428bafa1b => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:46.158556 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c66dec-42f2-40fc-a2fc-bd3e695c9dfb None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:46.158831 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c66dec-42f2-40fc-a2fc-bd3e695c9dfb None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:46.159098 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c66dec-42f2-40fc-a2fc-bd3e695c9dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:46.166862 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 176/351] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 7 10:41:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:46.167733 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920fb32-3334-4720-a7de-468128e11848 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:46.178206 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-15c66dec-42f2-40fc-a2fc-bd3e695c9dfb None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:46.179370 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-15c66dec-42f2-40fc-a2fc-bd3e695c9dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:46.232504 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:46.280095 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 176/352] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:46.281935 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35458371-5346-4203-999f-f3e5d3ff06f1 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:46.282436 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35458371-5346-4203-999f-f3e5d3ff06f1 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:46.283481 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35458371-5346-4203-999f-f3e5d3ff06f1 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:46.289105 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 177/353] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:46.290134 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35458371-5346-4203-999f-f3e5d3ff06f1 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:46.294715 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920fb32-3334-4720-a7de-468128e11848 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:46.339889 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85b28e-790a-432d-b2ac-a86ce14dc8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:46.340531 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85b28e-790a-432d-b2ac-a86ce14dc8a0 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:46.340809 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85b28e-790a-432d-b2ac-a86ce14dc8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:46.341080 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85b28e-790a-432d-b2ac-a86ce14dc8a0 None admin] PATH_INFO: `/v3/groups/1fd19d8309f54c81bf01c71c668623c0` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:46.353081 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85b28e-790a-432d-b2ac-a86ce14dc8a0 None admin] RBAC: Authorizing `identity:get_group(group_id=1fd19d8309f54c81bf01c71c668623c0)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:46.354883 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85b28e-790a-432d-b2ac-a86ce14dc8a0 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:46.356457 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 177/354] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 7 10:41:46 2022] GET /identity/v3/groups/1fd19d8309f54c81bf01c71c668623c0 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:46.357061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85b28e-790a-432d-b2ac-a86ce14dc8a0 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:46.368036 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:46.425667 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35458371-5346-4203-999f-f3e5d3ff06f1 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:46.467004 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c3861-3f4c-4273-9aac-25815d33429b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:46.467882 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c3861-3f4c-4273-9aac-25815d33429b None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:46.468292 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c3861-3f4c-4273-9aac-25815d33429b None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:46.468675 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85b28e-790a-432d-b2ac-a86ce14dc8a0 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:46.469118 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c3861-3f4c-4273-9aac-25815d33429b None admin] PATH_INFO: `/v3/groups/1fd19d8309f54c81bf01c71c668623c0` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:46.469937 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c3861-3f4c-4273-9aac-25815d33429b None admin] RBAC: Authorizing `identity:get_group(group_id=1fd19d8309f54c81bf01c71c668623c0)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:46.472288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c3861-3f4c-4273-9aac-25815d33429b None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:46.473697 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 178/355] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 7 10:41:46 2022] GET /identity/v3/groups/1fd19d8309f54c81bf01c71c668623c0 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:46.474659 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48349cfb-ed94-4fc1-918e-fc9c6f2bc4f2 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:46.475001 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48349cfb-ed94-4fc1-918e-fc9c6f2bc4f2 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:46.475272 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48349cfb-ed94-4fc1-918e-fc9c6f2bc4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:46.484775 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:46.495530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-48349cfb-ed94-4fc1-918e-fc9c6f2bc4f2 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:46.497008 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-48349cfb-ed94-4fc1-918e-fc9c6f2bc4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:46.511006 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e39b80-f3b6-4102-945b-9254cbaaa72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:46.511698 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e39b80-f3b6-4102-945b-9254cbaaa72c None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:46.512006 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e39b80-f3b6-4102-945b-9254cbaaa72c None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:46.512282 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e39b80-f3b6-4102-945b-9254cbaaa72c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:46.578116 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 179/356] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:46.581122 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a17a4b-0074-44e2-b95d-5f067535802f None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:46.581562 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a17a4b-0074-44e2-b95d-5f067535802f None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:46.581877 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a17a4b-0074-44e2-b95d-5f067535802f None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:46.583555 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 180/357] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:46.584275 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a17a4b-0074-44e2-b95d-5f067535802f None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:46.599072 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e39b80-f3b6-4102-945b-9254cbaaa72c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:46.600539 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e39b80-f3b6-4102-945b-9254cbaaa72c None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:46.657341 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:46.714799 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a17a4b-0074-44e2-b95d-5f067535802f None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:46.716495 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 178/358] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:41:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:41:46.717429 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e39b80-f3b6-4102-945b-9254cbaaa72c None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:46.732300 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:46.760801 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2616654-5c79-4553-9fc4-420e6e013e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:46.761453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2616654-5c79-4553-9fc4-420e6e013e58 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:46.761733 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2616654-5c79-4553-9fc4-420e6e013e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:46.762003 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2616654-5c79-4553-9fc4-420e6e013e58 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:46.773852 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2616654-5c79-4553-9fc4-420e6e013e58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:46.778586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-a2616654-5c79-4553-9fc4-420e6e013e58 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 10:41:46.778586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:46.778586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:46.778586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:46.778586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:46.778586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:46.778586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:46.778586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:46.778586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:46.778586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:46.778586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:46.778586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:46.778586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:46.778586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:46.778586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:46.778586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:46.779593 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:46.779593 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:46.779593 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:46.779593 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:46.779593 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:46.779593 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:46.779593 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:46.779593 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:46.779593 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:46.779593 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:46.779593 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:46.779593 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:46.779593 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:46.779593 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:46.779593 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:46.779593 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:46.780427 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:46.780427 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:46.780427 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:46.780427 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:46.780427 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:46.780427 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:46.780427 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:46.780427 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:46.780427 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:46.780427 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:46.780427 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 10:41:46.780427 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:41:46.780427 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 181/359] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:46.781069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2616654-5c79-4553-9fc4-420e6e013e58 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:46.842820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e39b80-f3b6-4102-945b-9254cbaaa72c None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:46.884826 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef07980-cc4d-4705-a1a5-890951d15b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:46.885451 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef07980-cc4d-4705-a1a5-890951d15b8b None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:46.885734 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef07980-cc4d-4705-a1a5-890951d15b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:46.885989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef07980-cc4d-4705-a1a5-890951d15b8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:46.886715 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef07980-cc4d-4705-a1a5-890951d15b8b None admin] RBAC: Adding query filter params (group.id=1fd19d8309f54c81bf01c71c668623c0, role.id=4269d6d5c6c048728859af681b3610fb, scope.project.id=aba7d21adf714e6ab286c14428bafa1b) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:46.887091 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef07980-cc4d-4705-a1a5-890951d15b8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:46.888427 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef07980-cc4d-4705-a1a5-890951d15b8b None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:46.894674 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 179/360] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Aug 7 10:41:46 2022] GET /identity/v3/role_assignments?group.id=1fd19d8309f54c81bf01c71c668623c0&scope.project.id=aba7d21adf714e6ab286c14428bafa1b&role.id=4269d6d5c6c048728859af681b3610fb => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:46.896000 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767c9eb-1afa-4db6-993c-d24bdff81dd7 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:46.896287 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767c9eb-1afa-4db6-993c-d24bdff81dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:46.896556 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767c9eb-1afa-4db6-993c-d24bdff81dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:46.898784 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2616654-5c79-4553-9fc4-420e6e013e58 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:46.917439 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:46.919471 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-4767c9eb-1afa-4db6-993c-d24bdff81dd7 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:46.920747 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-4767c9eb-1afa-4db6-993c-d24bdff81dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:46.955998 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c21c23-76aa-49f4-a4a4-c7652659c15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:46.956617 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c21c23-76aa-49f4-a4a4-c7652659c15b None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:46.956901 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c21c23-76aa-49f4-a4a4-c7652659c15b None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:46.957153 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c21c23-76aa-49f4-a4a4-c7652659c15b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:46.957946 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c21c23-76aa-49f4-a4a4-c7652659c15b None admin] RBAC: Adding query filter params (group.id=1fd19d8309f54c81bf01c71c668623c0, role.id=28e65a5027f7406cac824e6ff6474bb2, scope.project.id=aba7d21adf714e6ab286c14428bafa1b) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:46.958250 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c21c23-76aa-49f4-a4a4-c7652659c15b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:46.959708 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c21c23-76aa-49f4-a4a4-c7652659c15b None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:46.968661 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 182/361] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Aug 7 10:41:46 2022] GET /identity/v3/role_assignments?group.id=1fd19d8309f54c81bf01c71c668623c0&scope.project.id=aba7d21adf714e6ab286c14428bafa1b&role.id=28e65a5027f7406cac824e6ff6474bb2 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:46.969963 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c21c23-76aa-49f4-a4a4-c7652659c15b None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:47.020891 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 180/362] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:47.021858 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767c9eb-1afa-4db6-993c-d24bdff81dd7 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:47.033717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:47.131136 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c21c23-76aa-49f4-a4a4-c7652659c15b None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:47.158810 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767c9eb-1afa-4db6-993c-d24bdff81dd7 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:47.172393 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367bc97-da57-43e3-9e29-80ff66578c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:47.173023 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367bc97-da57-43e3-9e29-80ff66578c6e None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:47.173303 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367bc97-da57-43e3-9e29-80ff66578c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:47.173738 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367bc97-da57-43e3-9e29-80ff66578c6e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:47.187983 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367bc97-da57-43e3-9e29-80ff66578c6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:47.193798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-8367bc97-da57-43e3-9e29-80ff66578c6e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 10:41:47.193798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:47.193798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:47.193798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:47.193798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:47.193798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:47.193798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:47.193798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:47.193798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:47.193798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:47.193798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:47.193798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:47.193798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:47.193798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:47.193798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:47.193798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:47.194707 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:47.194707 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:47.194707 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:47.194707 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:47.194707 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:47.194707 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:47.194707 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:47.194707 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:47.194707 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:47.194707 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:47.194707 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:47.194707 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:47.194707 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:47.194707 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:47.194707 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:47.194707 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:47.195516 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:47.195516 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:47.195516 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:47.195516 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:47.195516 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:47.195516 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:47.195516 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:47.195516 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:47.195516 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:47.195516 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:47.195516 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 10:41:47.195516 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:41:47.196650 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 183/363] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 7 10:41:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:47.196718 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367bc97-da57-43e3-9e29-80ff66578c6e None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:47.197493 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02736e-2493-40a8-b878-724141156900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:47.198132 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02736e-2493-40a8-b878-724141156900 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:47.198408 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02736e-2493-40a8-b878-724141156900 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:47.198677 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02736e-2493-40a8-b878-724141156900 None admin] PATH_INFO: `/v3/projects/712e604258e7461484f5bd25d19f0cf0` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:47.200035 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02736e-2493-40a8-b878-724141156900 None admin] RBAC: Authorizing `identity:get_project(project_id=712e604258e7461484f5bd25d19f0cf0)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:47.202437 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02736e-2493-40a8-b878-724141156900 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:47.204339 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 181/364] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:47 2022] GET /identity/v3/projects/712e604258e7461484f5bd25d19f0cf0 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:47.204999 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02736e-2493-40a8-b878-724141156900 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:47.239886 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:47.297728 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:47.318462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367bc97-da57-43e3-9e29-80ff66578c6e None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:47.324722 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02736e-2493-40a8-b878-724141156900 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:47.362472 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5599fb62-e5cf-49f7-b660-a43df81362d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:47.363368 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599fb62-e5cf-49f7-b660-a43df81362d4 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:47.363472 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2994ee-176b-47a3-af3e-cc209864c696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:47.363948 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599fb62-e5cf-49f7-b660-a43df81362d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:47.364207 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2994ee-176b-47a3-af3e-cc209864c696 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:47.364557 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2994ee-176b-47a3-af3e-cc209864c696 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:47.364743 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599fb62-e5cf-49f7-b660-a43df81362d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:47.364941 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2994ee-176b-47a3-af3e-cc209864c696 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:47.365724 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2994ee-176b-47a3-af3e-cc209864c696 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:47.366092 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2994ee-176b-47a3-af3e-cc209864c696 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:47.367556 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2994ee-176b-47a3-af3e-cc209864c696 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:47.381101 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 184/365] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 7 10:41:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:47.381101 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2994ee-176b-47a3-af3e-cc209864c696 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:47.386815 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5599fb62-e5cf-49f7-b660-a43df81362d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:47.393048 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-5599fb62-e5cf-49f7-b660-a43df81362d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:41:47.393048 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:47.393048 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:47.393048 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:47.393048 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:47.393048 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:47.393048 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:47.393048 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:47.393048 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:47.393048 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:47.393048 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:47.393048 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:47.393048 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:47.393048 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:47.393048 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:47.393048 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:47.393979 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:47.393979 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:47.393979 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:47.393979 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:47.393979 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:47.393979 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:47.393979 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:47.393979 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:47.393979 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:47.393979 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:47.393979 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:47.393979 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:47.393979 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:47.393979 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:47.393979 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:47.393979 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:47.394783 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:47.394783 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:47.394783 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:47.394783 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:47.394783 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:47.394783 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:47.394783 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:47.394783 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:47.394783 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:47.394783 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:47.394783 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:41:47.394783 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:41:47.397822 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 182/366] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:41:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:47.399182 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5599fb62-e5cf-49f7-b660-a43df81362d4 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:47.490941 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:47.498093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2994ee-176b-47a3-af3e-cc209864c696 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:47.540116 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5599fb62-e5cf-49f7-b660-a43df81362d4 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:47.547265 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de79c17-5357-4993-b399-04180122e437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:47.548149 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de79c17-5357-4993-b399-04180122e437 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:47.548606 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de79c17-5357-4993-b399-04180122e437 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:47.549031 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de79c17-5357-4993-b399-04180122e437 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:47.549884 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de79c17-5357-4993-b399-04180122e437 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:47.550326 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de79c17-5357-4993-b399-04180122e437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:47.551918 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de79c17-5357-4993-b399-04180122e437 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:47.563100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 185/367] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:41:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:47.564893 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de79c17-5357-4993-b399-04180122e437 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:47.589122 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f59354-4d21-4cc3-b2c9-95a06f06113a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:47.589959 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f59354-4d21-4cc3-b2c9-95a06f06113a None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:47.590339 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f59354-4d21-4cc3-b2c9-95a06f06113a None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:47.590720 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f59354-4d21-4cc3-b2c9-95a06f06113a None admin] PATH_INFO: `/v3/groups/1fd19d8309f54c81bf01c71c668623c0` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:47.592934 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f59354-4d21-4cc3-b2c9-95a06f06113a None admin] RBAC: Authorizing `identity:get_group(group_id=1fd19d8309f54c81bf01c71c668623c0)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:47.594727 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f59354-4d21-4cc3-b2c9-95a06f06113a None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:47.598087 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 183/368] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 7 10:41:47 2022] GET /identity/v3/groups/1fd19d8309f54c81bf01c71c668623c0 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:47.598998 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f59354-4d21-4cc3-b2c9-95a06f06113a None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:47.613676 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:47.702649 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de79c17-5357-4993-b399-04180122e437 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:47.714612 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f59354-4d21-4cc3-b2c9-95a06f06113a None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:47.747972 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf105bad-f062-4600-843e-d5c9965e124c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:47.749555 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf105bad-f062-4600-843e-d5c9965e124c None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:47.749981 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf105bad-f062-4600-843e-d5c9965e124c None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:47.750423 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf105bad-f062-4600-843e-d5c9965e124c None admin] PATH_INFO: `/v3/users/7d56d68e717043a79d1f8d7230e7f080` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:47.752514 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf105bad-f062-4600-843e-d5c9965e124c None admin] RBAC: Authorizing `identity:get_user(user_id=7d56d68e717043a79d1f8d7230e7f080)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:47.754447 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf105bad-f062-4600-843e-d5c9965e124c None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:47.760645 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886864cb-cc08-4ea0-8b4a-7f00f445881f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:47.760645 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886864cb-cc08-4ea0-8b4a-7f00f445881f None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:47.760645 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886864cb-cc08-4ea0-8b4a-7f00f445881f None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:47.760645 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886864cb-cc08-4ea0-8b4a-7f00f445881f None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:47.761036 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886864cb-cc08-4ea0-8b4a-7f00f445881f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:47.761036 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886864cb-cc08-4ea0-8b4a-7f00f445881f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:47.761036 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886864cb-cc08-4ea0-8b4a-7f00f445881f None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:47.761626 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 186/369] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:41:47 2022] GET /identity/v3/users/7d56d68e717043a79d1f8d7230e7f080 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:47.763009 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf105bad-f062-4600-843e-d5c9965e124c None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:47.771953 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 184/370] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:47.772991 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886864cb-cc08-4ea0-8b4a-7f00f445881f None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:47.804378 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:47.849092 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:47.895400 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886864cb-cc08-4ea0-8b4a-7f00f445881f None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:47.905962 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf105bad-f062-4600-843e-d5c9965e124c None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:47.944129 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f1e16-9cbe-4e69-9bd8-cf7c0da5089d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:47.945213 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f1e16-9cbe-4e69-9bd8-cf7c0da5089d None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:47.946066 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f1e16-9cbe-4e69-9bd8-cf7c0da5089d None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:47.946526 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f1e16-9cbe-4e69-9bd8-cf7c0da5089d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:47.947515 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f1e16-9cbe-4e69-9bd8-cf7c0da5089d None admin] RBAC: Adding query filter params (group.id=1fd19d8309f54c81bf01c71c668623c0, role.id=28e65a5027f7406cac824e6ff6474bb2, scope.project.id=712e604258e7461484f5bd25d19f0cf0) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:47.948101 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f1e16-9cbe-4e69-9bd8-cf7c0da5089d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:47.949689 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453f1e16-9cbe-4e69-9bd8-cf7c0da5089d None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:47.951807 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe35e71-4ffb-4e8f-b5dc-91b7b5f8f11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:47.952512 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe35e71-4ffb-4e8f-b5dc-91b7b5f8f11f None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:47.952892 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe35e71-4ffb-4e8f-b5dc-91b7b5f8f11f None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:47.953342 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe35e71-4ffb-4e8f-b5dc-91b7b5f8f11f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:47.957099 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 185/371] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Aug 7 10:41:47 2022] GET /identity/v3/role_assignments?group.id=1fd19d8309f54c81bf01c71c668623c0&scope.project.id=712e604258e7461484f5bd25d19f0cf0&role.id=28e65a5027f7406cac824e6ff6474bb2 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:47.959108 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f1e16-9cbe-4e69-9bd8-cf7c0da5089d None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:48.058110 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe35e71-4ffb-4e8f-b5dc-91b7b5f8f11f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:48.060424 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe35e71-4ffb-4e8f-b5dc-91b7b5f8f11f None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:48.102043 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f1e16-9cbe-4e69-9bd8-cf7c0da5089d None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:48.103278 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:48.138151 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:48.146510 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1381e2-84cb-4fad-be0f-5c3b201f4b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:48.147274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1381e2-84cb-4fad-be0f-5c3b201f4b53 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:48.147722 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1381e2-84cb-4fad-be0f-5c3b201f4b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:48.148094 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1381e2-84cb-4fad-be0f-5c3b201f4b53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:48.152154 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1381e2-84cb-4fad-be0f-5c3b201f4b53 None admin] RBAC: Adding query filter params (role.id=e9b673af6fc14dfe8c0762885c21da92, user.id=7d56d68e717043a79d1f8d7230e7f080, scope.system=all) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:48.152154 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1381e2-84cb-4fad-be0f-5c3b201f4b53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:48.152154 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1381e2-84cb-4fad-be0f-5c3b201f4b53 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:48.165098 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 186/372] 10.222.0.27 () {56 vars in 1308 bytes} [Sun Aug 7 10:41:47 2022] GET /identity/v3/role_assignments?user.id=7d56d68e717043a79d1f8d7230e7f080&scope.system=all&role.id=e9b673af6fc14dfe8c0762885c21da92 => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:48.166173 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1381e2-84cb-4fad-be0f-5c3b201f4b53 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:48.255194 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 187/373] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:41:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:41:48.261223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe35e71-4ffb-4e8f-b5dc-91b7b5f8f11f None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:48.293832 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1381e2-84cb-4fad-be0f-5c3b201f4b53 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:48.380026 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b124260-e7b8-4778-aa19-40ff2d33cdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:48.381004 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b124260-e7b8-4778-aa19-40ff2d33cdbc None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:48.382649 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b124260-e7b8-4778-aa19-40ff2d33cdbc None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:48.383075 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b124260-e7b8-4778-aa19-40ff2d33cdbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:48.432253 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe35e71-4ffb-4e8f-b5dc-91b7b5f8f11f None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:48.467286 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:48.487744 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b124260-e7b8-4778-aa19-40ff2d33cdbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:48.489640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b124260-e7b8-4778-aa19-40ff2d33cdbc None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:48.490828 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:48.503635 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cca2de-cb06-46a0-91e2-f8bef581a55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:48.504446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cca2de-cb06-46a0-91e2-f8bef581a55f None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:48.504830 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cca2de-cb06-46a0-91e2-f8bef581a55f None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:48.505203 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cca2de-cb06-46a0-91e2-f8bef581a55f None admin] PATH_INFO: `/v3/projects/712e604258e7461484f5bd25d19f0cf0` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:48.511084 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cca2de-cb06-46a0-91e2-f8bef581a55f None admin] RBAC: Authorizing `identity:get_project(project_id=712e604258e7461484f5bd25d19f0cf0)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:48.511965 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cca2de-cb06-46a0-91e2-f8bef581a55f None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:48.513848 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 188/374] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:48 2022] GET /identity/v3/projects/712e604258e7461484f5bd25d19f0cf0 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:48.519765 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cca2de-cb06-46a0-91e2-f8bef581a55f None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:48.608257 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 187/375] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:41:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:41:48.613492 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b124260-e7b8-4778-aa19-40ff2d33cdbc None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:48.726353 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:48.738602 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cca2de-cb06-46a0-91e2-f8bef581a55f None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:48.747739 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b124260-e7b8-4778-aa19-40ff2d33cdbc None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:48.788502 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f74d7-1223-48d6-992b-1995a90881a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:48.789263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f74d7-1223-48d6-992b-1995a90881a4 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:48.790295 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f74d7-1223-48d6-992b-1995a90881a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:48.790553 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f74d7-1223-48d6-992b-1995a90881a4 None admin] PATH_INFO: `/v3/groups/1fd19d8309f54c81bf01c71c668623c0` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:48.791850 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f74d7-1223-48d6-992b-1995a90881a4 None admin] RBAC: Authorizing `identity:get_group(group_id=1fd19d8309f54c81bf01c71c668623c0)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:48.793675 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e551f0-d168-4de1-968b-283336985398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:48.793825 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f74d7-1223-48d6-992b-1995a90881a4 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:48.794585 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e551f0-d168-4de1-968b-283336985398 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:48.795004 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e551f0-d168-4de1-968b-283336985398 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:48.795415 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e551f0-d168-4de1-968b-283336985398 None admin] PATH_INFO: `/v3/projects/a981d307e79a4251be167c0015c9f536` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:48.795587 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 189/376] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 7 10:41:48 2022] GET /identity/v3/groups/1fd19d8309f54c81bf01c71c668623c0 => generated 226 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:41:48.796937 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e551f0-d168-4de1-968b-283336985398 None admin] RBAC: Authorizing `identity:get_project(project_id=a981d307e79a4251be167c0015c9f536)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:48.800649 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e551f0-d168-4de1-968b-283336985398 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:48.800938 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 188/377] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:48 2022] GET /identity/v3/projects/a981d307e79a4251be167c0015c9f536 => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:41:48.801873 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f74d7-1223-48d6-992b-1995a90881a4 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:48.810769 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e551f0-d168-4de1-968b-283336985398 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:48.884227 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:48.921416 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f74d7-1223-48d6-992b-1995a90881a4 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:48.949229 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e551f0-d168-4de1-968b-283336985398 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:48.962275 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56459196-d405-468c-a466-485e61916ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:48.962760 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56459196-d405-468c-a466-485e61916ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:48.963099 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56459196-d405-468c-a466-485e61916ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:48.963373 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56459196-d405-468c-a466-485e61916ae9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:48.964107 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56459196-d405-468c-a466-485e61916ae9 None admin] RBAC: Adding query filter params (group.id=1fd19d8309f54c81bf01c71c668623c0, role.id=4269d6d5c6c048728859af681b3610fb, scope.project.id=712e604258e7461484f5bd25d19f0cf0) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:48.964436 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56459196-d405-468c-a466-485e61916ae9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:48.965908 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56459196-d405-468c-a466-485e61916ae9 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:48.972766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 190/378] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Aug 7 10:41:48 2022] GET /identity/v3/role_assignments?group.id=1fd19d8309f54c81bf01c71c668623c0&scope.project.id=712e604258e7461484f5bd25d19f0cf0&role.id=4269d6d5c6c048728859af681b3610fb => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:48.996567 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996ffd5-d283-4a66-8102-449b4aba4a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:48.997620 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996ffd5-d283-4a66-8102-449b4aba4a5b None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:48.998101 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996ffd5-d283-4a66-8102-449b4aba4a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:48.998572 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996ffd5-d283-4a66-8102-449b4aba4a5b None admin] PATH_INFO: `/v3/groups/ce4c6ff9717c43a1b1bec5ee01ee2e91` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:49.005765 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996ffd5-d283-4a66-8102-449b4aba4a5b None admin] RBAC: Authorizing `identity:get_group(group_id=ce4c6ff9717c43a1b1bec5ee01ee2e91)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:49.007611 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996ffd5-d283-4a66-8102-449b4aba4a5b None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:49.010133 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 189/379] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 7 10:41:48 2022] GET /identity/v3/groups/ce4c6ff9717c43a1b1bec5ee01ee2e91 => generated 229 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:49.017451 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56459196-d405-468c-a466-485e61916ae9 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:49.135163 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56459196-d405-468c-a466-485e61916ae9 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:49.163643 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:49.171512 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb77cb-4531-441b-b21e-c4084ff59ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:49.172129 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb77cb-4531-441b-b21e-c4084ff59ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:49.172805 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb77cb-4531-441b-b21e-c4084ff59ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:49.173513 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb77cb-4531-441b-b21e-c4084ff59ec4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:49.174684 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb77cb-4531-441b-b21e-c4084ff59ec4 None admin] RBAC: Adding query filter params (group.id=ce4c6ff9717c43a1b1bec5ee01ee2e91, role.id=9da6e501237c405ca021a9d9f6173caf, scope.project.id=a981d307e79a4251be167c0015c9f536) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:49.174994 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb77cb-4531-441b-b21e-c4084ff59ec4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:49.176417 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb77cb-4531-441b-b21e-c4084ff59ec4 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:49.182548 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 191/380] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Aug 7 10:41:49 2022] GET /identity/v3/role_assignments?group.id=ce4c6ff9717c43a1b1bec5ee01ee2e91&scope.project.id=a981d307e79a4251be167c0015c9f536&role.id=9da6e501237c405ca021a9d9f6173caf => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:49.836090 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb00a5-0d0e-4ce0-9f4b-5a100ac8cbd6 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:49.837061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb00a5-0d0e-4ce0-9f4b-5a100ac8cbd6 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:49.837716 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb00a5-0d0e-4ce0-9f4b-5a100ac8cbd6 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:49.839537 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 190/381] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:49.850824 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558848c-5760-4aa8-9b84-ca157fce39df None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:49.851266 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558848c-5760-4aa8-9b84-ca157fce39df None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:49.851366 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558848c-5760-4aa8-9b84-ca157fce39df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:49.874712 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-f558848c-5760-4aa8-9b84-ca157fce39df None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:49.875899 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-f558848c-5760-4aa8-9b84-ca157fce39df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:49.949253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108175aa-b0ba-4ce3-8686-e94adb73bdfd None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:49.949596 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108175aa-b0ba-4ce3-8686-e94adb73bdfd None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:49.949819 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108175aa-b0ba-4ce3-8686-e94adb73bdfd None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:49.951398 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 191/382] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:49.956584 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861f7e8-f007-4738-b6cd-8341732de1fe None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:49.956856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861f7e8-f007-4738-b6cd-8341732de1fe None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:49.957123 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861f7e8-f007-4738-b6cd-8341732de1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:49.958711 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 192/383] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:49.997161 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-7861f7e8-f007-4738-b6cd-8341732de1fe None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:49.997391 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558848c-5760-4aa8-9b84-ca157fce39df None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:49.998372 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-7861f7e8-f007-4738-b6cd-8341732de1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:50.021730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:50.127874 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 192/384] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:50.150559 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861f7e8-f007-4738-b6cd-8341732de1fe None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:50.184461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558848c-5760-4aa8-9b84-ca157fce39df None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:50.233929 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:50.258298 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7649bc-dab2-4050-bec8-0912b0b6edae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:50.259851 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7649bc-dab2-4050-bec8-0912b0b6edae None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:50.261553 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7649bc-dab2-4050-bec8-0912b0b6edae None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:50.262262 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7649bc-dab2-4050-bec8-0912b0b6edae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:50.285858 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7649bc-dab2-4050-bec8-0912b0b6edae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:50.295818 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-6b7649bc-dab2-4050-bec8-0912b0b6edae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 10:41:50.295818 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:50.295818 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:50.295818 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:50.295818 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:50.295818 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:50.295818 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:50.295818 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:50.295818 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:50.295818 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:50.295818 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:50.295818 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:50.295818 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:50.295818 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:50.295818 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:50.295818 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:50.296734 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:50.296734 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:50.296734 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:50.296734 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:50.296734 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:50.296734 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:50.296734 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:50.296734 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:50.296734 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:50.296734 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:50.296734 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:50.296734 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:50.296734 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:50.296734 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:50.296734 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:50.296734 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:50.297572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:50.297572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:50.297572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:50.297572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:50.297572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:50.297572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:50.297572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:50.297572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:50.297572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:50.297572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:50.297572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 10:41:50.297572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:41:50.303967 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 193/385] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 7 10:41:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:41:50.307260 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7649bc-dab2-4050-bec8-0912b0b6edae None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:50.349367 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861f7e8-f007-4738-b6cd-8341732de1fe None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:50.390803 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6df133-be97-4766-8eb2-d2d96cc5f9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:50.391945 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6df133-be97-4766-8eb2-d2d96cc5f9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:50.392515 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6df133-be97-4766-8eb2-d2d96cc5f9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:50.393003 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6df133-be97-4766-8eb2-d2d96cc5f9f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:50.404794 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6df133-be97-4766-8eb2-d2d96cc5f9f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:50.410071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-bd6df133-be97-4766-8eb2-d2d96cc5f9f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:50.410071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:50.410071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:50.410071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:50.410071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:50.410071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:50.410071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:50.410071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:50.410071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:50.410071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:50.410071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:50.410071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:50.410071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:50.410071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:50.410071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:50.410071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:50.410987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:50.410987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:50.410987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:50.410987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:50.410987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:50.410987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:50.410987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:50.410987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:50.410987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:50.410987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:50.410987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:50.410987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:50.410987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:50.410987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:50.410987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:50.410987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:50.411810 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:50.411810 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:50.411810 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:50.411810 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:50.411810 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:50.411810 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:50.411810 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:50.411810 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:50.411810 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:50.411810 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:50.411810 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:50.411810 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:41:50.414575 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 193/386] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:41:50.422272 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6df133-be97-4766-8eb2-d2d96cc5f9f8 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:50.439600 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:50.457676 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7649bc-dab2-4050-bec8-0912b0b6edae None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:50.540643 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673753b1-ac4b-4ca1-9332-538e833bb790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:50.541259 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673753b1-ac4b-4ca1-9332-538e833bb790 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:50.541554 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673753b1-ac4b-4ca1-9332-538e833bb790 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:50.541818 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673753b1-ac4b-4ca1-9332-538e833bb790 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:50.542538 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673753b1-ac4b-4ca1-9332-538e833bb790 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:50.542837 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673753b1-ac4b-4ca1-9332-538e833bb790 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:50.544279 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673753b1-ac4b-4ca1-9332-538e833bb790 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:50.557552 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 194/387] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:41:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:50.560436 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673753b1-ac4b-4ca1-9332-538e833bb790 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:50.588326 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6df133-be97-4766-8eb2-d2d96cc5f9f8 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:50.638519 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:50.645243 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d855a-2871-4a5a-b3fb-620377b4137b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:50.645829 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d855a-2871-4a5a-b3fb-620377b4137b None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:50.646104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d855a-2871-4a5a-b3fb-620377b4137b None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:50.646376 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d855a-2871-4a5a-b3fb-620377b4137b None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:50.647047 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d855a-2871-4a5a-b3fb-620377b4137b None admin] RBAC: Adding query filter params (name=member) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:50.647344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d855a-2871-4a5a-b3fb-620377b4137b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:50.649238 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d855a-2871-4a5a-b3fb-620377b4137b None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:50.661416 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 194/388] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 7 10:41:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:50.662770 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637163f-89f4-4f3f-b896-23d796ac3cf8 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:50.663148 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637163f-89f4-4f3f-b896-23d796ac3cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:50.663512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637163f-89f4-4f3f-b896-23d796ac3cf8 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:50.665103 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 195/389] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:50.665922 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637163f-89f4-4f3f-b896-23d796ac3cf8 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:50.705231 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673753b1-ac4b-4ca1-9332-538e833bb790 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:50.740156 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d68531-96f2-4c16-a9ae-f7b39e03f463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:50.740923 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d68531-96f2-4c16-a9ae-f7b39e03f463 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:50.741294 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d68531-96f2-4c16-a9ae-f7b39e03f463 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:50.741696 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d68531-96f2-4c16-a9ae-f7b39e03f463 None admin] PATH_INFO: `/v3/groups/1fd19d8309f54c81bf01c71c668623c0` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:50.742860 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d68531-96f2-4c16-a9ae-f7b39e03f463 None admin] RBAC: Authorizing `identity:get_group(group_id=1fd19d8309f54c81bf01c71c668623c0)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:50.744692 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d68531-96f2-4c16-a9ae-f7b39e03f463 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:50.746652 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 195/390] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 7 10:41:50 2022] GET /identity/v3/groups/1fd19d8309f54c81bf01c71c668623c0 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:41:50.747809 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859860a-4b5f-4a0f-b1f5-d0c4bd1d96f7 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:50.748157 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859860a-4b5f-4a0f-b1f5-d0c4bd1d96f7 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:50.748484 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859860a-4b5f-4a0f-b1f5-d0c4bd1d96f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:50.757831 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:50.766628 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-a859860a-4b5f-4a0f-b1f5-d0c4bd1d96f7 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:50.768419 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a859860a-4b5f-4a0f-b1f5-d0c4bd1d96f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:50.802112 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637163f-89f4-4f3f-b896-23d796ac3cf8 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:50.838408 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 196/391] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:50.839260 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859860a-4b5f-4a0f-b1f5-d0c4bd1d96f7 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:50.857503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b4107-9316-4147-be90-22180cf5eada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:50.858187 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b4107-9316-4147-be90-22180cf5eada None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:50.858463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b4107-9316-4147-be90-22180cf5eada None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:50.858733 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b4107-9316-4147-be90-22180cf5eada None admin] PATH_INFO: `/v3/groups/1fd19d8309f54c81bf01c71c668623c0` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:50.860484 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b4107-9316-4147-be90-22180cf5eada None admin] RBAC: Authorizing `identity:get_group(group_id=1fd19d8309f54c81bf01c71c668623c0)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:50.862905 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b4107-9316-4147-be90-22180cf5eada None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:50.864531 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 196/392] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 7 10:41:50 2022] GET /identity/v3/groups/1fd19d8309f54c81bf01c71c668623c0 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:50.865297 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b4107-9316-4147-be90-22180cf5eada None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:50.905676 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:50.977685 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859860a-4b5f-4a0f-b1f5-d0c4bd1d96f7 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:50.993047 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b4107-9316-4147-be90-22180cf5eada None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:51.014831 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13fb5f2-c213-4b27-b99b-472428691861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:51.015698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fb5f2-c213-4b27-b99b-472428691861 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:51.016215 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fb5f2-c213-4b27-b99b-472428691861 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:51.016683 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13fb5f2-c213-4b27-b99b-472428691861 None admin] PATH_INFO: `/v3/projects/aba7d21adf714e6ab286c14428bafa1b` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:51.018196 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13fb5f2-c213-4b27-b99b-472428691861 None admin] RBAC: Authorizing `identity:get_project(project_id=aba7d21adf714e6ab286c14428bafa1b)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:51.019847 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13fb5f2-c213-4b27-b99b-472428691861 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:51.022123 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 197/393] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:50 2022] GET /identity/v3/projects/aba7d21adf714e6ab286c14428bafa1b => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:51.023205 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13fb5f2-c213-4b27-b99b-472428691861 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:51.031943 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0aa2e-d523-4263-9798-d0d5db6c2fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:51.033353 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0aa2e-d523-4263-9798-d0d5db6c2fca None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:51.033483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0aa2e-d523-4263-9798-d0d5db6c2fca None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:51.033756 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0aa2e-d523-4263-9798-d0d5db6c2fca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:51.041333 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:51.046885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0aa2e-d523-4263-9798-d0d5db6c2fca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:51.055831 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-f8a0aa2e-d523-4263-9798-d0d5db6c2fca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:51.055831 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:51.055831 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:51.055831 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:51.055831 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:51.055831 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:51.055831 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:51.055831 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:51.055831 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:51.055831 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:51.055831 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:51.055831 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:51.055831 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:51.055831 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:51.055831 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:51.055831 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:51.056897 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:51.056897 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:51.056897 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:51.056897 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:51.056897 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:51.056897 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:51.056897 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:51.056897 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:51.056897 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:51.056897 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:51.056897 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:51.056897 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:51.056897 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:51.056897 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:51.056897 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:51.056897 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:51.057726 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:51.057726 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:51.057726 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:51.057726 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:51.057726 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:51.057726 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:51.057726 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:51.057726 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:51.057726 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:51.057726 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:51.057726 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:51.057726 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:41:51.064827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 197/394] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:51.066001 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0aa2e-d523-4263-9798-d0d5db6c2fca None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:51.129761 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13fb5f2-c213-4b27-b99b-472428691861 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:51.141031 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:51.166442 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f7d5b-e04b-4cb1-a3ac-11aec97a4269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:51.167103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f7d5b-e04b-4cb1-a3ac-11aec97a4269 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:51.167448 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f7d5b-e04b-4cb1-a3ac-11aec97a4269 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:51.167841 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f7d5b-e04b-4cb1-a3ac-11aec97a4269 None admin] PATH_INFO: `/v3/projects/aba7d21adf714e6ab286c14428bafa1b` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:51.169372 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f7d5b-e04b-4cb1-a3ac-11aec97a4269 None admin] RBAC: Authorizing `identity:get_project(project_id=aba7d21adf714e6ab286c14428bafa1b)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:51.170585 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f7d5b-e04b-4cb1-a3ac-11aec97a4269 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:51.172299 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 198/395] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:51 2022] GET /identity/v3/projects/aba7d21adf714e6ab286c14428bafa1b => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:51.173184 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f7d5b-e04b-4cb1-a3ac-11aec97a4269 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:51.187537 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0aa2e-d523-4263-9798-d0d5db6c2fca None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:51.225303 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845743b-3968-426c-a772-2263d8bf94f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:51.226014 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845743b-3968-426c-a772-2263d8bf94f9 None admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:51.226292 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845743b-3968-426c-a772-2263d8bf94f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:51.226566 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845743b-3968-426c-a772-2263d8bf94f9 None admin] PATH_INFO: `/v3/projects/aba7d21adf714e6ab286c14428bafa1b/groups/1fd19d8309f54c81bf01c71c668623c0/roles/4269d6d5c6c048728859af681b3610fb` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:51.229121 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845743b-3968-426c-a772-2263d8bf94f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=aba7d21adf714e6ab286c14428bafa1b, group_id=1fd19d8309f54c81bf01c71c668623c0, role_id=4269d6d5c6c048728859af681b3610fb)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:51.230611 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845743b-3968-426c-a772-2263d8bf94f9 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:51.245784 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 198/396] 10.222.0.27 () {58 vars in 1442 bytes} [Sun Aug 7 10:41:51 2022] PUT /identity/v3/projects/aba7d21adf714e6ab286c14428bafa1b/groups/1fd19d8309f54c81bf01c71c668623c0/roles/4269d6d5c6c048728859af681b3610fb => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:41:51.246512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845743b-3968-426c-a772-2263d8bf94f9 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:51.284190 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f7d5b-e04b-4cb1-a3ac-11aec97a4269 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:51.316639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:51.322382 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe5a4f-87fa-4182-a16e-e215cacde128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:51.323326 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe5a4f-87fa-4182-a16e-e215cacde128 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:51.323940 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe5a4f-87fa-4182-a16e-e215cacde128 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:51.324220 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe5a4f-87fa-4182-a16e-e215cacde128 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:51.325011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe5a4f-87fa-4182-a16e-e215cacde128 None admin] RBAC: Adding query filter params (name=member) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:51.325337 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe5a4f-87fa-4182-a16e-e215cacde128 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:51.326915 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe5a4f-87fa-4182-a16e-e215cacde128 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:51.338664 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 199/397] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 7 10:41:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:51.347577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe5a4f-87fa-4182-a16e-e215cacde128 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:51.371729 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845743b-3968-426c-a772-2263d8bf94f9 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:51.400200 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:51.411472 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124dbb51-0c0b-48db-b5fb-0397ce45a3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:51.412156 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124dbb51-0c0b-48db-b5fb-0397ce45a3d8 None admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:51.412435 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124dbb51-0c0b-48db-b5fb-0397ce45a3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:51.412708 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124dbb51-0c0b-48db-b5fb-0397ce45a3d8 None admin] PATH_INFO: `/v3/projects/aba7d21adf714e6ab286c14428bafa1b/groups/1fd19d8309f54c81bf01c71c668623c0/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:51.415013 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124dbb51-0c0b-48db-b5fb-0397ce45a3d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=aba7d21adf714e6ab286c14428bafa1b, group_id=1fd19d8309f54c81bf01c71c668623c0, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:51.416519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124dbb51-0c0b-48db-b5fb-0397ce45a3d8 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:51.449769 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 199/398] 10.222.0.27 () {58 vars in 1442 bytes} [Sun Aug 7 10:41:51 2022] PUT /identity/v3/projects/aba7d21adf714e6ab286c14428bafa1b/groups/1fd19d8309f54c81bf01c71c668623c0/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:41:51.474948 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd55be4-f5bb-4078-8e61-acb980779301 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:51.475230 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd55be4-f5bb-4078-8e61-acb980779301 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:51.475505 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd55be4-f5bb-4078-8e61-acb980779301 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:51.476876 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 200/399] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:51.477464 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe5a4f-87fa-4182-a16e-e215cacde128 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:51.486816 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21902c-a636-4b35-86a0-c4c4e97d4f18 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:51.487093 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21902c-a636-4b35-86a0-c4c4e97d4f18 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:51.487366 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21902c-a636-4b35-86a0-c4c4e97d4f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:51.520683 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e6b4a-acc9-4cbf-8f64-e05c5fcadcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:51.521353 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e6b4a-acc9-4cbf-8f64-e05c5fcadcef None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:51.521635 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e6b4a-acc9-4cbf-8f64-e05c5fcadcef None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:51.521903 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e6b4a-acc9-4cbf-8f64-e05c5fcadcef None admin] PATH_INFO: `/v3/groups/1fd19d8309f54c81bf01c71c668623c0` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:51.523261 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e6b4a-acc9-4cbf-8f64-e05c5fcadcef None admin] RBAC: Authorizing `identity:get_group(group_id=1fd19d8309f54c81bf01c71c668623c0)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:51.524827 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e6b4a-acc9-4cbf-8f64-e05c5fcadcef None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:51.527043 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 200/400] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 7 10:41:51 2022] GET /identity/v3/groups/1fd19d8309f54c81bf01c71c668623c0 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:41:51.536103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e6b4a-acc9-4cbf-8f64-e05c5fcadcef None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:51.536365 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-4a21902c-a636-4b35-86a0-c4c4e97d4f18 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:51.537343 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-4a21902c-a636-4b35-86a0-c4c4e97d4f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:51.641962 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 201/401] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:51.643705 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71555a2d-8851-4e62-814a-0e70cdf90024 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:51.643985 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71555a2d-8851-4e62-814a-0e70cdf90024 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:51.644536 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71555a2d-8851-4e62-814a-0e70cdf90024 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:51.650321 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 202/402] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:51.656242 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2de22-71f6-4c05-ba98-554ef157beb1 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:51.656517 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2de22-71f6-4c05-ba98-554ef157beb1 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:51.656790 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2de22-71f6-4c05-ba98-554ef157beb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:51.674722 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e6b4a-acc9-4cbf-8f64-e05c5fcadcef None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:51.680616 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-3be2de22-71f6-4c05-ba98-554ef157beb1 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:51.681896 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-3be2de22-71f6-4c05-ba98-554ef157beb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:51.684099 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:51.711076 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67ceb3-dca1-49f7-bbb2-2bd01b3b530a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:51.711816 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67ceb3-dca1-49f7-bbb2-2bd01b3b530a None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:51.712095 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67ceb3-dca1-49f7-bbb2-2bd01b3b530a None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:51.712362 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67ceb3-dca1-49f7-bbb2-2bd01b3b530a None admin] PATH_INFO: `/v3/projects/712e604258e7461484f5bd25d19f0cf0` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:51.713601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67ceb3-dca1-49f7-bbb2-2bd01b3b530a None admin] RBAC: Authorizing `identity:get_project(project_id=712e604258e7461484f5bd25d19f0cf0)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:51.715028 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da67ceb3-dca1-49f7-bbb2-2bd01b3b530a None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:51.720830 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 201/403] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:51 2022] GET /identity/v3/projects/712e604258e7461484f5bd25d19f0cf0 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:51.720830 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67ceb3-dca1-49f7-bbb2-2bd01b3b530a None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:51.737674 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:51.774460 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 203/404] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 10:41:51.775616 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2de22-71f6-4c05-ba98-554ef157beb1 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:51.830991 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67ceb3-dca1-49f7-bbb2-2bd01b3b530a None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:51.865382 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862de2d-815c-4dbb-aab9-fdfb2d2a1fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:51.866021 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862de2d-815c-4dbb-aab9-fdfb2d2a1fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:51.866296 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862de2d-815c-4dbb-aab9-fdfb2d2a1fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:51.866571 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862de2d-815c-4dbb-aab9-fdfb2d2a1fc7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:51.877902 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862de2d-815c-4dbb-aab9-fdfb2d2a1fc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:51.883079 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-4862de2d-815c-4dbb-aab9-fdfb2d2a1fc7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 10:41:51.883079 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:51.883079 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:51.883079 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:51.883079 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:51.883079 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:51.883079 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:51.883079 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:51.883079 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:51.883079 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:51.883079 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:51.883079 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:51.883079 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:51.883079 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:51.883079 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:51.883079 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:51.883976 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:51.883976 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:51.883976 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:51.883976 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:51.883976 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:51.883976 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:51.883976 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:51.883976 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:51.883976 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:51.883976 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:51.883976 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:51.883976 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:51.883976 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:51.883976 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:51.883976 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:51.883976 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:51.884817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:51.884817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:51.884817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:51.884817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:51.884817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:51.884817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:51.884817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:51.884817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:51.884817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:51.884817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:51.884817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 10:41:51.884817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:41:51.889023 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 202/405] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 7 10:41:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:51.889893 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862de2d-815c-4dbb-aab9-fdfb2d2a1fc7 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:51.906162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2de22-71f6-4c05-ba98-554ef157beb1 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:51.928901 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:51.957218 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c6a7e-b524-49d6-bd7f-98e4bbf16f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:51.957901 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c6a7e-b524-49d6-bd7f-98e4bbf16f6d None admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:51.958176 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c6a7e-b524-49d6-bd7f-98e4bbf16f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:51.958444 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c6a7e-b524-49d6-bd7f-98e4bbf16f6d None admin] PATH_INFO: `/v3/projects/712e604258e7461484f5bd25d19f0cf0/groups/1fd19d8309f54c81bf01c71c668623c0/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:51.961668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c6a7e-b524-49d6-bd7f-98e4bbf16f6d None admin] RBAC: Authorizing `identity:create_grant(project_id=712e604258e7461484f5bd25d19f0cf0, group_id=1fd19d8309f54c81bf01c71c668623c0, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:51.963123 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c6a7e-b524-49d6-bd7f-98e4bbf16f6d None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:51.979822 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 204/406] 10.222.0.27 () {58 vars in 1442 bytes} [Sun Aug 7 10:41:51 2022] PUT /identity/v3/projects/712e604258e7461484f5bd25d19f0cf0/groups/1fd19d8309f54c81bf01c71c668623c0/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:41:51.980783 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c6a7e-b524-49d6-bd7f-98e4bbf16f6d None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:52.029499 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:52.055368 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862de2d-815c-4dbb-aab9-fdfb2d2a1fc7 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:52.100829 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c6a7e-b524-49d6-bd7f-98e4bbf16f6d None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:52.126070 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468cb92-fe3a-4e08-ab62-b340abbc7f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:52.127325 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468cb92-fe3a-4e08-ab62-b340abbc7f8f None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:52.127824 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468cb92-fe3a-4e08-ab62-b340abbc7f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:52.128287 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468cb92-fe3a-4e08-ab62-b340abbc7f8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:52.141457 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e250647-786e-4fdd-a268-b5cfa3ef9df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:52.142618 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e250647-786e-4fdd-a268-b5cfa3ef9df7 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:52.142866 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e250647-786e-4fdd-a268-b5cfa3ef9df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:52.143133 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e250647-786e-4fdd-a268-b5cfa3ef9df7 None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:52.143803 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e250647-786e-4fdd-a268-b5cfa3ef9df7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:52.144103 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e250647-786e-4fdd-a268-b5cfa3ef9df7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:52.145535 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e250647-786e-4fdd-a268-b5cfa3ef9df7 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:52.146231 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468cb92-fe3a-4e08-ab62-b340abbc7f8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:52.151700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-1468cb92-fe3a-4e08-ab62-b340abbc7f8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:41:52.151700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:52.151700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:52.151700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:52.151700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:52.151700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:52.151700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:52.151700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:52.151700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:52.151700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:52.151700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:52.151700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:52.151700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:52.151700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:52.151700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:52.151700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:52.152575 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:52.152575 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:52.152575 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:52.152575 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:52.152575 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:52.152575 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:52.152575 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:52.152575 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:52.152575 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:52.152575 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:52.152575 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:52.152575 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:52.152575 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:52.152575 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:52.152575 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:52.152575 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:52.153404 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:52.153404 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:52.153404 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:52.153404 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:52.153404 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:52.153404 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:52.153404 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:52.153404 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:52.153404 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:52.153404 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:52.153404 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:41:52.153404 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:41:52.155993 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 205/407] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:41:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:52.156420 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 203/408] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:41:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:52.161655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e250647-786e-4fdd-a268-b5cfa3ef9df7 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:52.166082 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468cb92-fe3a-4e08-ab62-b340abbc7f8f None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:52.267770 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:52.269840 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:52.273871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e250647-786e-4fdd-a268-b5cfa3ef9df7 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:52.275052 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468cb92-fe3a-4e08-ab62-b340abbc7f8f None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:52.317096 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefc7a3-6c6f-41d5-8cb2-2aa4f998aa82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:52.318735 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefc7a3-6c6f-41d5-8cb2-2aa4f998aa82 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:52.318912 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefc7a3-6c6f-41d5-8cb2-2aa4f998aa82 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:52.320301 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefc7a3-6c6f-41d5-8cb2-2aa4f998aa82 None admin] PATH_INFO: `/v3/groups/1fd19d8309f54c81bf01c71c668623c0` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:52.322317 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aefc7a3-6c6f-41d5-8cb2-2aa4f998aa82 None admin] RBAC: Authorizing `identity:get_group(group_id=1fd19d8309f54c81bf01c71c668623c0)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:52.324614 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aefc7a3-6c6f-41d5-8cb2-2aa4f998aa82 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:52.329223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 206/409] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 7 10:41:52 2022] GET /identity/v3/groups/1fd19d8309f54c81bf01c71c668623c0 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:52.336323 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefc7a3-6c6f-41d5-8cb2-2aa4f998aa82 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:52.338529 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f4fbd-27f6-4ee5-883b-2f35ba37b128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:52.339149 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f4fbd-27f6-4ee5-883b-2f35ba37b128 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:52.339424 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f4fbd-27f6-4ee5-883b-2f35ba37b128 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:52.339692 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f4fbd-27f6-4ee5-883b-2f35ba37b128 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:52.340365 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f4fbd-27f6-4ee5-883b-2f35ba37b128 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:52.340665 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f4fbd-27f6-4ee5-883b-2f35ba37b128 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:52.342071 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f4fbd-27f6-4ee5-883b-2f35ba37b128 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:52.367596 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 204/410] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:41:52.373820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f4fbd-27f6-4ee5-883b-2f35ba37b128 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:52.506523 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefc7a3-6c6f-41d5-8cb2-2aa4f998aa82 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:52.547759 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f4fbd-27f6-4ee5-883b-2f35ba37b128 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:52.586039 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65338da-0706-42d3-9ca0-113845f0751d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:52.586678 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65338da-0706-42d3-9ca0-113845f0751d None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:52.587005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65338da-0706-42d3-9ca0-113845f0751d None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:52.587277 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65338da-0706-42d3-9ca0-113845f0751d None admin] PATH_INFO: `/v3/groups/ce4c6ff9717c43a1b1bec5ee01ee2e91` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:52.588441 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65338da-0706-42d3-9ca0-113845f0751d None admin] RBAC: Authorizing `identity:get_group(group_id=ce4c6ff9717c43a1b1bec5ee01ee2e91)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:52.589916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65338da-0706-42d3-9ca0-113845f0751d None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:52.592410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 205/411] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 7 10:41:52 2022] GET /identity/v3/groups/ce4c6ff9717c43a1b1bec5ee01ee2e91 => generated 229 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:52.599338 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65338da-0706-42d3-9ca0-113845f0751d None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:52.608713 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9d252-4163-4246-ad40-d2f3b29da2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:52.609388 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9d252-4163-4246-ad40-d2f3b29da2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:52.609671 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9d252-4163-4246-ad40-d2f3b29da2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:52.609939 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9d252-4163-4246-ad40-d2f3b29da2b2 None admin] PATH_INFO: `/v3/projects/712e604258e7461484f5bd25d19f0cf0` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:52.613350 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9d252-4163-4246-ad40-d2f3b29da2b2 None admin] RBAC: Authorizing `identity:get_project(project_id=712e604258e7461484f5bd25d19f0cf0)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:52.613350 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9d252-4163-4246-ad40-d2f3b29da2b2 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:52.616056 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 207/412] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:52 2022] GET /identity/v3/projects/712e604258e7461484f5bd25d19f0cf0 => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:52.623057 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9d252-4163-4246-ad40-d2f3b29da2b2 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:52.663893 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:52.685676 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:52.766915 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65338da-0706-42d3-9ca0-113845f0751d None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:52.802609 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835d66e-c7f4-4044-a755-3f81b676494f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:52.803456 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835d66e-c7f4-4044-a755-3f81b676494f None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:52.803866 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835d66e-c7f4-4044-a755-3f81b676494f None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:52.804261 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835d66e-c7f4-4044-a755-3f81b676494f None admin] PATH_INFO: `/v3/projects/a981d307e79a4251be167c0015c9f536` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:52.805734 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9835d66e-c7f4-4044-a755-3f81b676494f None admin] RBAC: Authorizing `identity:get_project(project_id=a981d307e79a4251be167c0015c9f536)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:52.807358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9835d66e-c7f4-4044-a755-3f81b676494f None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:52.809495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 206/413] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:52 2022] GET /identity/v3/projects/a981d307e79a4251be167c0015c9f536 => generated 344 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:52.816385 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9d252-4163-4246-ad40-d2f3b29da2b2 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:52.817836 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835d66e-c7f4-4044-a755-3f81b676494f None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:52.878825 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3010e24-8d57-4afc-9ba8-dce1b93a22ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:52.881755 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3010e24-8d57-4afc-9ba8-dce1b93a22ec None admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:52.882231 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3010e24-8d57-4afc-9ba8-dce1b93a22ec None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:52.882686 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3010e24-8d57-4afc-9ba8-dce1b93a22ec None admin] PATH_INFO: `/v3/projects/712e604258e7461484f5bd25d19f0cf0/groups/1fd19d8309f54c81bf01c71c668623c0/roles/4269d6d5c6c048728859af681b3610fb` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:52.887635 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3010e24-8d57-4afc-9ba8-dce1b93a22ec None admin] RBAC: Authorizing `identity:create_grant(project_id=712e604258e7461484f5bd25d19f0cf0, group_id=1fd19d8309f54c81bf01c71c668623c0, role_id=4269d6d5c6c048728859af681b3610fb)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:52.889537 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3010e24-8d57-4afc-9ba8-dce1b93a22ec None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:52.915398 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 208/414] 10.222.0.27 () {58 vars in 1442 bytes} [Sun Aug 7 10:41:52 2022] PUT /identity/v3/projects/712e604258e7461484f5bd25d19f0cf0/groups/1fd19d8309f54c81bf01c71c668623c0/roles/4269d6d5c6c048728859af681b3610fb => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:41:52.989392 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:53.000767 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835d66e-c7f4-4044-a755-3f81b676494f None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:53.049170 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4175f75-a0c6-46ac-9ade-81d21a9cf991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:53.050311 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4175f75-a0c6-46ac-9ade-81d21a9cf991 None admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:53.050773 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4175f75-a0c6-46ac-9ade-81d21a9cf991 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:53.051224 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4175f75-a0c6-46ac-9ade-81d21a9cf991 None admin] PATH_INFO: `/v3/projects/a981d307e79a4251be167c0015c9f536/groups/ce4c6ff9717c43a1b1bec5ee01ee2e91/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:53.055772 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4175f75-a0c6-46ac-9ade-81d21a9cf991 None admin] RBAC: Authorizing `identity:create_grant(project_id=a981d307e79a4251be167c0015c9f536, group_id=ce4c6ff9717c43a1b1bec5ee01ee2e91, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:53.057599 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4175f75-a0c6-46ac-9ade-81d21a9cf991 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:53.079475 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 207/415] 10.222.0.27 () {58 vars in 1442 bytes} [Sun Aug 7 10:41:52 2022] PUT /identity/v3/projects/a981d307e79a4251be167c0015c9f536/groups/ce4c6ff9717c43a1b1bec5ee01ee2e91/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:41:53.582162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05573c-789d-467d-922a-fd5add3e8990 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:53.582543 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05573c-789d-467d-922a-fd5add3e8990 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:53.582740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05573c-789d-467d-922a-fd5add3e8990 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:53.584350 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 209/416] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:53.589549 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e4053-a529-4145-8f67-c98238335eb4 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:53.589836 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e4053-a529-4145-8f67-c98238335eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:53.590110 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e4053-a529-4145-8f67-c98238335eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:53.611395 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-176e4053-a529-4145-8f67-c98238335eb4 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:53.612524 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-176e4053-a529-4145-8f67-c98238335eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:53.718719 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 208/417] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:53.758396 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05573c-789d-467d-922a-fd5add3e8990 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:53.874983 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:53.889682 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05573c-789d-467d-922a-fd5add3e8990 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:53.933888 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4670575-30ce-4189-a4c7-263b21123b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:53.934503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4670575-30ce-4189-a4c7-263b21123b2a None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:53.934782 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4670575-30ce-4189-a4c7-263b21123b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:53.935057 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4670575-30ce-4189-a4c7-263b21123b2a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:53.954265 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4670575-30ce-4189-a4c7-263b21123b2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:53.959084 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-c4670575-30ce-4189-a4c7-263b21123b2a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 10:41:53.959084 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:53.959084 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:53.959084 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:53.959084 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:53.959084 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:53.959084 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:53.959084 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:53.959084 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:53.959084 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:53.959084 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:53.959084 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:53.959084 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:53.959084 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:53.959084 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:53.959084 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:53.959992 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:53.959992 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:53.959992 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:53.959992 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:53.959992 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:53.959992 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:53.959992 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:53.959992 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:53.959992 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:53.959992 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:53.959992 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:53.959992 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:53.959992 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:53.959992 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:53.959992 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:53.959992 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:53.960821 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:53.960821 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:53.960821 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:53.960821 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:53.960821 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:53.960821 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:53.960821 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:53.960821 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:53.960821 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:53.960821 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:53.960821 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 10:41:53.960821 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:41:53.960821 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 210/418] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 7 10:41:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:53.966173 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e4053-a529-4145-8f67-c98238335eb4 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:53.977307 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c5393-ef0d-4fe2-b39b-48c9ebd725fd None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:53.977669 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c5393-ef0d-4fe2-b39b-48c9ebd725fd None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:53.977946 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c5393-ef0d-4fe2-b39b-48c9ebd725fd None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:53.979305 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 211/419] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:53.984514 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32564790-62d8-404a-a498-d6bfdccf9bec None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:53.984969 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32564790-62d8-404a-a498-d6bfdccf9bec None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:53.985406 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32564790-62d8-404a-a498-d6bfdccf9bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:54.005017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-32564790-62d8-404a-a498-d6bfdccf9bec None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:54.006586 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-32564790-62d8-404a-a498-d6bfdccf9bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:54.076991 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 212/420] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:54.101772 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32564790-62d8-404a-a498-d6bfdccf9bec None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:54.152239 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:54.194441 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e4053-a529-4145-8f67-c98238335eb4 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:54.201707 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:54.215128 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32564790-62d8-404a-a498-d6bfdccf9bec None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:54.255504 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68158c52-89da-4d3f-92c3-f9276d10d2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:54.256189 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68158c52-89da-4d3f-92c3-f9276d10d2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:54.256472 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68158c52-89da-4d3f-92c3-f9276d10d2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:54.256743 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68158c52-89da-4d3f-92c3-f9276d10d2f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:54.268674 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68158c52-89da-4d3f-92c3-f9276d10d2f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:54.273780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-68158c52-89da-4d3f-92c3-f9276d10d2f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:54.273780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:54.273780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:54.273780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:54.273780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:54.273780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:54.273780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:54.273780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:54.273780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:54.273780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:54.273780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:54.273780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:54.273780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:54.273780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:54.273780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:54.273780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:54.274687 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:54.274687 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:54.274687 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:54.274687 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:54.274687 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:54.274687 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:54.274687 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:54.274687 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:54.274687 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:54.274687 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:54.274687 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:54.274687 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:54.274687 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:54.274687 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:54.274687 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:54.274687 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:54.275461 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:54.275461 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:54.275461 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:54.275461 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:54.275461 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:54.275461 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:54.275461 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:54.275461 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:54.275461 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:54.275461 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:54.275461 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:54.275461 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:41:54.276057 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 213/421] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:54.284901 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe326a-f3c2-42a6-972f-d02673e35c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:54.285573 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe326a-f3c2-42a6-972f-d02673e35c80 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:54.285855 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe326a-f3c2-42a6-972f-d02673e35c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:54.286129 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe326a-f3c2-42a6-972f-d02673e35c80 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:54.286406 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68158c52-89da-4d3f-92c3-f9276d10d2f7 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:54.286827 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe326a-f3c2-42a6-972f-d02673e35c80 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:54.287320 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe326a-f3c2-42a6-972f-d02673e35c80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:54.288678 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe326a-f3c2-42a6-972f-d02673e35c80 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:54.298575 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 209/422] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:41:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:54.303939 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe326a-f3c2-42a6-972f-d02673e35c80 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:54.478996 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68158c52-89da-4d3f-92c3-f9276d10d2f7 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:54.502014 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe326a-f3c2-42a6-972f-d02673e35c80 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:54.552090 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445e437-619e-46ba-abdf-487491cdb87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:54.552720 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445e437-619e-46ba-abdf-487491cdb87e None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:54.552997 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445e437-619e-46ba-abdf-487491cdb87e None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:54.553261 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445e437-619e-46ba-abdf-487491cdb87e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:54.554612 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a44057-7d94-4a11-8141-fdf1c5010d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:54.555240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a44057-7d94-4a11-8141-fdf1c5010d72 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:54.555510 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a44057-7d94-4a11-8141-fdf1c5010d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:54.555775 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a44057-7d94-4a11-8141-fdf1c5010d72 None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:54.556467 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a44057-7d94-4a11-8141-fdf1c5010d72 None admin] RBAC: Adding query filter params (name=member) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:54.556765 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a44057-7d94-4a11-8141-fdf1c5010d72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:54.558208 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a44057-7d94-4a11-8141-fdf1c5010d72 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:54.577470 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 214/423] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 7 10:41:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:54.585535 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a44057-7d94-4a11-8141-fdf1c5010d72 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:54.593654 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:54.604739 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:54.664017 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445e437-619e-46ba-abdf-487491cdb87e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:54.665553 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2445e437-619e-46ba-abdf-487491cdb87e None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:54.733616 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a44057-7d94-4a11-8141-fdf1c5010d72 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:54.777233 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995700da-5cca-46ef-a6b7-06bec1fad5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:54.777870 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995700da-5cca-46ef-a6b7-06bec1fad5e2 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:54.778149 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995700da-5cca-46ef-a6b7-06bec1fad5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:54.778421 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995700da-5cca-46ef-a6b7-06bec1fad5e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:54.798098 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 210/424] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:41:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 10:41:54.799776 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245ff87-5d6a-4772-888d-83b79fee9c5f None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:54.800324 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245ff87-5d6a-4772-888d-83b79fee9c5f None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:54.800655 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245ff87-5d6a-4772-888d-83b79fee9c5f None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:54.805402 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 211/425] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:54.806171 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245ff87-5d6a-4772-888d-83b79fee9c5f None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:54.855475 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:54.862773 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995700da-5cca-46ef-a6b7-06bec1fad5e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:54.864223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995700da-5cca-46ef-a6b7-06bec1fad5e2 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:54.875274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:54.910359 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245ff87-5d6a-4772-888d-83b79fee9c5f None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:54.945548 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01820c8a-5e1b-436e-a9b5-cec36ab81c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:54.946263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01820c8a-5e1b-436e-a9b5-cec36ab81c72 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:54.946607 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01820c8a-5e1b-436e-a9b5-cec36ab81c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:54.946944 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01820c8a-5e1b-436e-a9b5-cec36ab81c72 None admin] PATH_INFO: `/v3/projects/aba7d21adf714e6ab286c14428bafa1b` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:54.948154 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01820c8a-5e1b-436e-a9b5-cec36ab81c72 None admin] RBAC: Authorizing `identity:get_project(project_id=aba7d21adf714e6ab286c14428bafa1b)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:54.949676 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01820c8a-5e1b-436e-a9b5-cec36ab81c72 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:54.951531 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 212/426] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:54 2022] GET /identity/v3/projects/aba7d21adf714e6ab286c14428bafa1b => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:54.952540 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af635f6c-a65c-4955-b482-29dee3d7bb9c None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:54.952885 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af635f6c-a65c-4955-b482-29dee3d7bb9c None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:54.953219 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af635f6c-a65c-4955-b482-29dee3d7bb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:54.971526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-af635f6c-a65c-4955-b482-29dee3d7bb9c None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:54.972817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-af635f6c-a65c-4955-b482-29dee3d7bb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:54.981806 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 215/427] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:41:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:41:54.982923 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995700da-5cca-46ef-a6b7-06bec1fad5e2 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:55.041720 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 213/428] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:55.042608 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af635f6c-a65c-4955-b482-29dee3d7bb9c None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:55.089518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:55.120583 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995700da-5cca-46ef-a6b7-06bec1fad5e2 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:55.130934 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:55.145970 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af635f6c-a65c-4955-b482-29dee3d7bb9c None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:55.160261 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33bef3f-7791-467f-87b6-ba2a6db3f3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:55.160997 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bef3f-7791-467f-87b6-ba2a6db3f3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:55.161278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bef3f-7791-467f-87b6-ba2a6db3f3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:55.161579 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bef3f-7791-467f-87b6-ba2a6db3f3f6 None admin] PATH_INFO: `/v3/groups/1fd19d8309f54c81bf01c71c668623c0` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:55.162711 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33bef3f-7791-467f-87b6-ba2a6db3f3f6 None admin] RBAC: Authorizing `identity:get_group(group_id=1fd19d8309f54c81bf01c71c668623c0)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:55.164324 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33bef3f-7791-467f-87b6-ba2a6db3f3f6 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:55.166163 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 216/429] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 7 10:41:54 2022] GET /identity/v3/groups/1fd19d8309f54c81bf01c71c668623c0 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:55.166874 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33bef3f-7791-467f-87b6-ba2a6db3f3f6 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:55.182006 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d344b-2022-484a-a1b6-9f7e939a3363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:55.182631 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d344b-2022-484a-a1b6-9f7e939a3363 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:55.182895 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d344b-2022-484a-a1b6-9f7e939a3363 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:55.183219 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d344b-2022-484a-a1b6-9f7e939a3363 None admin] PATH_INFO: `/v3/projects/aba7d21adf714e6ab286c14428bafa1b` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:55.184370 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d344b-2022-484a-a1b6-9f7e939a3363 None admin] RBAC: Authorizing `identity:get_project(project_id=aba7d21adf714e6ab286c14428bafa1b)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:55.185831 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d344b-2022-484a-a1b6-9f7e939a3363 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:55.187762 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 214/430] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:55 2022] GET /identity/v3/projects/aba7d21adf714e6ab286c14428bafa1b => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:55.188537 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d344b-2022-484a-a1b6-9f7e939a3363 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:55.275012 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33bef3f-7791-467f-87b6-ba2a6db3f3f6 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:55.295463 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d344b-2022-484a-a1b6-9f7e939a3363 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:55.309299 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:55.311653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa61d73-2a80-4daa-bd7c-b520d294e56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:55.312250 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa61d73-2a80-4daa-bd7c-b520d294e56a None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:55.312519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa61d73-2a80-4daa-bd7c-b520d294e56a None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:55.312848 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa61d73-2a80-4daa-bd7c-b520d294e56a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:55.323916 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa61d73-2a80-4daa-bd7c-b520d294e56a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:55.328605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-6aa61d73-2a80-4daa-bd7c-b520d294e56a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:55.328605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:55.328605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:55.328605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:55.328605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:55.328605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:55.328605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:55.328605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:55.328605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:55.328605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:55.328605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:55.328605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:55.328605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:55.328605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:55.328605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:55.328605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:55.329554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:55.329554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:55.329554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:55.329554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:55.329554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:55.329554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:55.329554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:55.329554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:55.329554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:55.329554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:55.329554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:55.329554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:55.329554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:55.329554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:55.329554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:55.329554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:55.330394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:55.330394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:55.330394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:55.330394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:55.330394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:55.330394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:55.330394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:55.330394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:55.330394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:55.330394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:55.330394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 10:41:55.330394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:41:55.330394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 217/431] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:55.331055 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa61d73-2a80-4daa-bd7c-b520d294e56a None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:55.337445 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3a110-1808-4817-acd3-886c44e1c7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:55.338070 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3a110-1808-4817-acd3-886c44e1c7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:55.338351 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3a110-1808-4817-acd3-886c44e1c7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:55.338625 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3a110-1808-4817-acd3-886c44e1c7b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:55.339368 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3a110-1808-4817-acd3-886c44e1c7b3 None admin] RBAC: Adding query filter params (group.id=1fd19d8309f54c81bf01c71c668623c0, role.id=4269d6d5c6c048728859af681b3610fb, scope.project.id=aba7d21adf714e6ab286c14428bafa1b) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:55.339676 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3a110-1808-4817-acd3-886c44e1c7b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:55.341128 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3a110-1808-4817-acd3-886c44e1c7b3 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:55.350758 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 215/432] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Aug 7 10:41:55 2022] GET /identity/v3/role_assignments?group.id=1fd19d8309f54c81bf01c71c668623c0&scope.project.id=aba7d21adf714e6ab286c14428bafa1b&role.id=4269d6d5c6c048728859af681b3610fb => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:55.363840 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce29ae-6a72-4e2a-9be6-500f47471749 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:55.364843 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce29ae-6a72-4e2a-9be6-500f47471749 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:55.365428 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce29ae-6a72-4e2a-9be6-500f47471749 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:55.368225 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 216/433] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:55.369705 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce29ae-6a72-4e2a-9be6-500f47471749 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:55.381358 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:55.474596 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa61d73-2a80-4daa-bd7c-b520d294e56a None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:55.519310 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa8606-9599-402b-968b-219d83b94651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:55.519965 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa8606-9599-402b-968b-219d83b94651 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:55.520237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa8606-9599-402b-968b-219d83b94651 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:55.520498 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa8606-9599-402b-968b-219d83b94651 None admin] PATH_INFO: `/v3/groups/1fd19d8309f54c81bf01c71c668623c0` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:55.521646 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa8606-9599-402b-968b-219d83b94651 None admin] RBAC: Authorizing `identity:get_group(group_id=1fd19d8309f54c81bf01c71c668623c0)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:55.522920 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce29ae-6a72-4e2a-9be6-500f47471749 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:55.523098 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa8606-9599-402b-968b-219d83b94651 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:55.524783 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 218/434] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 7 10:41:55 2022] GET /identity/v3/groups/1fd19d8309f54c81bf01c71c668623c0 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:55.525778 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead47c8-8d10-4a52-ab44-a5ef3e5581d2 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:55.526051 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead47c8-8d10-4a52-ab44-a5ef3e5581d2 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:55.526382 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead47c8-8d10-4a52-ab44-a5ef3e5581d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:55.547110 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-cead47c8-8d10-4a52-ab44-a5ef3e5581d2 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:55.548405 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-cead47c8-8d10-4a52-ab44-a5ef3e5581d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:55.570486 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead79ccd-11a4-44c8-b9f8-c2f51c69fbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:55.571382 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead79ccd-11a4-44c8-b9f8-c2f51c69fbd7 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:55.571666 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead79ccd-11a4-44c8-b9f8-c2f51c69fbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:55.571937 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead79ccd-11a4-44c8-b9f8-c2f51c69fbd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:55.573149 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead79ccd-11a4-44c8-b9f8-c2f51c69fbd7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:55.573499 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead79ccd-11a4-44c8-b9f8-c2f51c69fbd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:55.575081 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead79ccd-11a4-44c8-b9f8-c2f51c69fbd7 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:55.584572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 217/435] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 7 10:41:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:55.585333 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead79ccd-11a4-44c8-b9f8-c2f51c69fbd7 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:55.626787 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 219/436] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:55.628249 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656d91f-b658-4e34-b0a8-4ff2dab7b1da None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:55.628603 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656d91f-b658-4e34-b0a8-4ff2dab7b1da None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:55.628944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3656d91f-b658-4e34-b0a8-4ff2dab7b1da None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:55.630431 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 220/437] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:41:55.631118 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656d91f-b658-4e34-b0a8-4ff2dab7b1da None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:55.634028 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:55.671968 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:55.690455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead79ccd-11a4-44c8-b9f8-c2f51c69fbd7 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:55.724231 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31b45a-b5b5-4a54-aaa4-2eaea3cb70c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:55.724821 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31b45a-b5b5-4a54-aaa4-2eaea3cb70c4 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:55.725100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31b45a-b5b5-4a54-aaa4-2eaea3cb70c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:55.725397 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31b45a-b5b5-4a54-aaa4-2eaea3cb70c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:55.733385 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31b45a-b5b5-4a54-aaa4-2eaea3cb70c4 None admin] RBAC: Adding query filter params (group.id=1fd19d8309f54c81bf01c71c668623c0, role.id=28e65a5027f7406cac824e6ff6474bb2, scope.project.id=aba7d21adf714e6ab286c14428bafa1b) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:55.733694 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31b45a-b5b5-4a54-aaa4-2eaea3cb70c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:55.735101 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31b45a-b5b5-4a54-aaa4-2eaea3cb70c4 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:55.737135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3656d91f-b658-4e34-b0a8-4ff2dab7b1da None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:55.741083 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 218/438] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Aug 7 10:41:55 2022] GET /identity/v3/role_assignments?group.id=1fd19d8309f54c81bf01c71c668623c0&scope.project.id=aba7d21adf714e6ab286c14428bafa1b&role.id=28e65a5027f7406cac824e6ff6474bb2 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:55.742352 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879c003-0eb6-4dc2-be47-dbcb73fad5cb None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:55.742638 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879c003-0eb6-4dc2-be47-dbcb73fad5cb None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:55.742908 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879c003-0eb6-4dc2-be47-dbcb73fad5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:55.763232 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-0879c003-0eb6-4dc2-be47-dbcb73fad5cb None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:41:55.764473 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-0879c003-0eb6-4dc2-be47-dbcb73fad5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:41:55.780838 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea352cc8-24a1-41c6-9071-4510d92a3574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:55.781500 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea352cc8-24a1-41c6-9071-4510d92a3574 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:55.781774 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea352cc8-24a1-41c6-9071-4510d92a3574 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:55.782036 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea352cc8-24a1-41c6-9071-4510d92a3574 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:55.846040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 219/439] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:41:55.846838 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879c003-0eb6-4dc2-be47-dbcb73fad5cb None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:55.876857 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea352cc8-24a1-41c6-9071-4510d92a3574 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:55.878338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea352cc8-24a1-41c6-9071-4510d92a3574 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:55.885798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:55.915802 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:55.973942 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879c003-0eb6-4dc2-be47-dbcb73fad5cb None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:55.998920 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 221/440] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:41:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:41:55.999988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea352cc8-24a1-41c6-9071-4510d92a3574 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:56.012184 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba924c-df30-42a6-8eb1-142d6a150a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:56.012906 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba924c-df30-42a6-8eb1-142d6a150a0a None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:56.013249 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba924c-df30-42a6-8eb1-142d6a150a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:56.013630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba924c-df30-42a6-8eb1-142d6a150a0a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:56.026921 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba924c-df30-42a6-8eb1-142d6a150a0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:56.031698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-d3ba924c-df30-42a6-8eb1-142d6a150a0a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 10:41:56.031698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:56.031698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:56.031698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:56.031698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:56.031698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:56.031698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:56.031698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:56.031698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:56.031698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:56.031698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:56.031698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:56.031698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:56.031698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:56.031698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:56.031698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:56.032611 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:56.032611 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:56.032611 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:56.032611 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:56.032611 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:56.032611 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:56.032611 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:56.032611 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:56.032611 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:56.032611 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:56.032611 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:56.032611 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:56.032611 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:56.032611 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:56.032611 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:56.032611 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:56.033526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:56.033526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:56.033526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:56.033526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:56.033526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:56.033526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:56.033526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:56.033526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:56.033526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:56.033526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:56.033526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 10:41:56.033526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:41:56.033526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 220/441] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 7 10:41:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:56.039143 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba924c-df30-42a6-8eb1-142d6a150a0a None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:56.124798 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea352cc8-24a1-41c6-9071-4510d92a3574 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:56.150663 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:56.163383 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba924c-df30-42a6-8eb1-142d6a150a0a None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:56.166235 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a1d90-ccde-4fb7-88ac-58d9130ac3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:56.167532 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a1d90-ccde-4fb7-88ac-58d9130ac3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:56.167532 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a1d90-ccde-4fb7-88ac-58d9130ac3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:56.167532 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a1d90-ccde-4fb7-88ac-58d9130ac3c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:56.170630 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:56.183547 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a1d90-ccde-4fb7-88ac-58d9130ac3c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:41:56.188135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-426a1d90-ccde-4fb7-88ac-58d9130ac3c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:41:56.188135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:41:56.188135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:41:56.188135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:41:56.188135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:41:56.188135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:41:56.188135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:41:56.188135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:41:56.188135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:41:56.188135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:41:56.188135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:41:56.188135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:41:56.188135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:41:56.188135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:41:56.188135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:41:56.188135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:41:56.189748 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:41:56.189748 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:41:56.189748 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:41:56.189748 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:41:56.189748 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:41:56.189748 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:41:56.189748 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:41:56.189748 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:41:56.189748 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:41:56.189748 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:41:56.189748 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:41:56.189748 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:41:56.189748 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:41:56.189748 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:41:56.189748 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:41:56.189748 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:41:56.190578 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:41:56.190578 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:41:56.190578 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:41:56.190578 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:41:56.190578 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:41:56.190578 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:41:56.190578 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:41:56.190578 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:41:56.190578 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:41:56.190578 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:41:56.190578 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:41:56.190578 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:41:56.190578 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 222/442] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:41:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:41:56.191757 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a1d90-ccde-4fb7-88ac-58d9130ac3c4 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:56.205698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d49cf-4242-4094-9f2e-be6ee01100e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:56.206326 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d49cf-4242-4094-9f2e-be6ee01100e8 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:56.206600 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d49cf-4242-4094-9f2e-be6ee01100e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:56.206867 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d49cf-4242-4094-9f2e-be6ee01100e8 None admin] PATH_INFO: `/v3/projects/712e604258e7461484f5bd25d19f0cf0` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:56.208001 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d49cf-4242-4094-9f2e-be6ee01100e8 None admin] RBAC: Authorizing `identity:get_project(project_id=712e604258e7461484f5bd25d19f0cf0)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:56.209491 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d49cf-4242-4094-9f2e-be6ee01100e8 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:56.211119 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 221/443] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:56 2022] GET /identity/v3/projects/712e604258e7461484f5bd25d19f0cf0 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:56.211869 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d49cf-4242-4094-9f2e-be6ee01100e8 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:56.307138 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a1d90-ccde-4fb7-88ac-58d9130ac3c4 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:56.320953 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d49cf-4242-4094-9f2e-be6ee01100e8 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:56.342641 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ea1eb-dcfd-4a8d-9542-49192936e7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:56.343382 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ea1eb-dcfd-4a8d-9542-49192936e7aa None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:56.343726 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ea1eb-dcfd-4a8d-9542-49192936e7aa None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:56.344006 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ea1eb-dcfd-4a8d-9542-49192936e7aa None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:56.344674 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ea1eb-dcfd-4a8d-9542-49192936e7aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:56.344976 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ea1eb-dcfd-4a8d-9542-49192936e7aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:56.346929 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ea1eb-dcfd-4a8d-9542-49192936e7aa None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:56.357503 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02941278-26bd-4d18-a9ec-8bf2b0990ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:56.358105 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02941278-26bd-4d18-a9ec-8bf2b0990ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:56.358381 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02941278-26bd-4d18-a9ec-8bf2b0990ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:56.358651 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02941278-26bd-4d18-a9ec-8bf2b0990ca0 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:56.359316 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02941278-26bd-4d18-a9ec-8bf2b0990ca0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:56.359620 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02941278-26bd-4d18-a9ec-8bf2b0990ca0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:56.359743 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 223/444] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:41:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:56.360441 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ea1eb-dcfd-4a8d-9542-49192936e7aa None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:56.361723 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02941278-26bd-4d18-a9ec-8bf2b0990ca0 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:56.370253 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 222/445] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:41:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:56.370925 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02941278-26bd-4d18-a9ec-8bf2b0990ca0 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:56.396879 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:56.419896 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:56.462961 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ea1eb-dcfd-4a8d-9542-49192936e7aa None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:56.471703 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02941278-26bd-4d18-a9ec-8bf2b0990ca0 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:56.496211 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc4b46-e70f-4051-a07b-e6210954163a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:56.496837 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc4b46-e70f-4051-a07b-e6210954163a None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:56.497115 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc4b46-e70f-4051-a07b-e6210954163a None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:56.497417 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc4b46-e70f-4051-a07b-e6210954163a None admin] PATH_INFO: `/v3/groups/1fd19d8309f54c81bf01c71c668623c0` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:56.498542 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc4b46-e70f-4051-a07b-e6210954163a None admin] RBAC: Authorizing `identity:get_group(group_id=1fd19d8309f54c81bf01c71c668623c0)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:56.499966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc4b46-e70f-4051-a07b-e6210954163a None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:56.501651 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 224/446] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 7 10:41:56 2022] GET /identity/v3/groups/1fd19d8309f54c81bf01c71c668623c0 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:56.502410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc4b46-e70f-4051-a07b-e6210954163a None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:56.504971 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e1a5c-6771-41df-910e-686228449421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:56.505599 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e1a5c-6771-41df-910e-686228449421 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:56.505873 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e1a5c-6771-41df-910e-686228449421 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:56.506139 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e1a5c-6771-41df-910e-686228449421 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:56.572953 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e1a5c-6771-41df-910e-686228449421 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:56.574438 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e1a5c-6771-41df-910e-686228449421 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:56.597426 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:56.599612 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc4b46-e70f-4051-a07b-e6210954163a None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:56.622146 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:56.632749 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f3786-18bf-4439-9ed0-96f6882d2e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:56.633367 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f3786-18bf-4439-9ed0-96f6882d2e24 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:56.633655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f3786-18bf-4439-9ed0-96f6882d2e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:56.633928 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f3786-18bf-4439-9ed0-96f6882d2e24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:56.671712 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 223/447] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:41:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:41:56.672469 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e1a5c-6771-41df-910e-686228449421 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:56.705625 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f3786-18bf-4439-9ed0-96f6882d2e24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:56.707069 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f3786-18bf-4439-9ed0-96f6882d2e24 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:56.769949 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e1a5c-6771-41df-910e-686228449421 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:56.792262 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:56.804126 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb135a9b-6a0a-4367-9887-6e04701a9f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:56.804824 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb135a9b-6a0a-4367-9887-6e04701a9f1a None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:56.805168 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb135a9b-6a0a-4367-9887-6e04701a9f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:56.805306 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 225/448] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:41:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:41:56.805491 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb135a9b-6a0a-4367-9887-6e04701a9f1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:56.806159 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f3786-18bf-4439-9ed0-96f6882d2e24 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:56.806255 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb135a9b-6a0a-4367-9887-6e04701a9f1a None admin] RBAC: Adding query filter params (group.id=1fd19d8309f54c81bf01c71c668623c0, role.id=28e65a5027f7406cac824e6ff6474bb2, scope.project.id=712e604258e7461484f5bd25d19f0cf0) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:56.806583 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb135a9b-6a0a-4367-9887-6e04701a9f1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:56.807958 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb135a9b-6a0a-4367-9887-6e04701a9f1a None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:56.814578 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 224/449] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Aug 7 10:41:56 2022] GET /identity/v3/role_assignments?group.id=1fd19d8309f54c81bf01c71c668623c0&scope.project.id=712e604258e7461484f5bd25d19f0cf0&role.id=28e65a5027f7406cac824e6ff6474bb2 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:56.815346 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb135a9b-6a0a-4367-9887-6e04701a9f1a None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:56.833265 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:56.926524 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f3786-18bf-4439-9ed0-96f6882d2e24 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:56.930636 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb135a9b-6a0a-4367-9887-6e04701a9f1a None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:56.963563 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f0fb3-236a-45dd-844c-ff258bf48b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:56.964498 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f0fb3-236a-45dd-844c-ff258bf48b5d None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:56.964777 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f0fb3-236a-45dd-844c-ff258bf48b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:56.965048 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f0fb3-236a-45dd-844c-ff258bf48b5d None admin] PATH_INFO: `/v3/projects/712e604258e7461484f5bd25d19f0cf0` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:56.966211 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f0fb3-236a-45dd-844c-ff258bf48b5d None admin] RBAC: Authorizing `identity:get_project(project_id=712e604258e7461484f5bd25d19f0cf0)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:56.967754 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f0fb3-236a-45dd-844c-ff258bf48b5d None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:56.969581 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 226/450] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:56 2022] GET /identity/v3/projects/712e604258e7461484f5bd25d19f0cf0 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:56.971029 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6cce2-11a9-4cb3-a7c7-a559a358e11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:56.971986 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6cce2-11a9-4cb3-a7c7-a559a358e11a None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:56.972404 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6cce2-11a9-4cb3-a7c7-a559a358e11a None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:56.972854 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6cce2-11a9-4cb3-a7c7-a559a358e11a None admin] PATH_INFO: `/v3/projects/a981d307e79a4251be167c0015c9f536` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:56.974181 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6cce2-11a9-4cb3-a7c7-a559a358e11a None admin] RBAC: Authorizing `identity:get_project(project_id=a981d307e79a4251be167c0015c9f536)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:56.975627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6cce2-11a9-4cb3-a7c7-a559a358e11a None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:56.976013 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f0fb3-236a-45dd-844c-ff258bf48b5d None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:56.977769 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 225/451] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:41:56 2022] GET /identity/v3/projects/a981d307e79a4251be167c0015c9f536 => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:41:56.983390 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6cce2-11a9-4cb3-a7c7-a559a358e11a None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:57.046510 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:57.083451 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:57.093549 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f0fb3-236a-45dd-844c-ff258bf48b5d None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:57.107947 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6cce2-11a9-4cb3-a7c7-a559a358e11a None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:57.136597 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790a6dc-df47-4ce5-a6d7-bf7bd8fee3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:57.137228 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790a6dc-df47-4ce5-a6d7-bf7bd8fee3bc None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:57.137571 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790a6dc-df47-4ce5-a6d7-bf7bd8fee3bc None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:57.137840 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790a6dc-df47-4ce5-a6d7-bf7bd8fee3bc None admin] PATH_INFO: `/v3/groups/1fd19d8309f54c81bf01c71c668623c0` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:57.138981 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b790a6dc-df47-4ce5-a6d7-bf7bd8fee3bc None admin] RBAC: Authorizing `identity:get_group(group_id=1fd19d8309f54c81bf01c71c668623c0)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:57.140409 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b790a6dc-df47-4ce5-a6d7-bf7bd8fee3bc None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:57.142036 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 227/452] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 7 10:41:56 2022] GET /identity/v3/groups/1fd19d8309f54c81bf01c71c668623c0 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:41:57.147967 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73d9dd-51fa-4148-9260-84dfd8974648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:57.148611 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790a6dc-df47-4ce5-a6d7-bf7bd8fee3bc None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:57.148722 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73d9dd-51fa-4148-9260-84dfd8974648 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:57.148936 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73d9dd-51fa-4148-9260-84dfd8974648 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:57.149266 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73d9dd-51fa-4148-9260-84dfd8974648 None admin] PATH_INFO: `/v3/groups/ce4c6ff9717c43a1b1bec5ee01ee2e91` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:57.150419 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73d9dd-51fa-4148-9260-84dfd8974648 None admin] RBAC: Authorizing `identity:get_group(group_id=ce4c6ff9717c43a1b1bec5ee01ee2e91)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:57.151865 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73d9dd-51fa-4148-9260-84dfd8974648 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:57.153472 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 226/453] 10.222.0.27 () {56 vars in 1180 bytes} [Sun Aug 7 10:41:56 2022] GET /identity/v3/groups/ce4c6ff9717c43a1b1bec5ee01ee2e91 => generated 229 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:41:57.159615 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73d9dd-51fa-4148-9260-84dfd8974648 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:41:57.255577 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790a6dc-df47-4ce5-a6d7-bf7bd8fee3bc None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:57.259768 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73d9dd-51fa-4148-9260-84dfd8974648 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:41:57.281404 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:41:57.289386 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c873299-8551-4b48-b98c-a9e989ffdd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:57.289984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c873299-8551-4b48-b98c-a9e989ffdd93 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:57.290259 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c873299-8551-4b48-b98c-a9e989ffdd93 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:57.290539 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c873299-8551-4b48-b98c-a9e989ffdd93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:57.291245 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c873299-8551-4b48-b98c-a9e989ffdd93 None admin] RBAC: Adding query filter params (group.id=1fd19d8309f54c81bf01c71c668623c0, role.id=4269d6d5c6c048728859af681b3610fb, scope.project.id=712e604258e7461484f5bd25d19f0cf0) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:57.291551 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c873299-8551-4b48-b98c-a9e989ffdd93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:57.293098 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a4773-2c92-43f6-af96-a91767e17969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:41:57.293255 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c873299-8551-4b48-b98c-a9e989ffdd93 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:57.293716 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a4773-2c92-43f6-af96-a91767e17969 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:41:57.293994 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a4773-2c92-43f6-af96-a91767e17969 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:41:57.294262 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a4773-2c92-43f6-af96-a91767e17969 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:41:57.294982 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a4773-2c92-43f6-af96-a91767e17969 None admin] RBAC: Adding query filter params (group.id=ce4c6ff9717c43a1b1bec5ee01ee2e91, role.id=9da6e501237c405ca021a9d9f6173caf, scope.project.id=a981d307e79a4251be167c0015c9f536) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:41:57.295284 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a4773-2c92-43f6-af96-a91767e17969 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:41:57.296689 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a4773-2c92-43f6-af96-a91767e17969 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:41:57.299383 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 228/454] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Aug 7 10:41:57 2022] GET /identity/v3/role_assignments?group.id=1fd19d8309f54c81bf01c71c668623c0&scope.project.id=712e604258e7461484f5bd25d19f0cf0&role.id=4269d6d5c6c048728859af681b3610fb => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:41:57.317365 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 227/455] 10.222.0.27 () {56 vars in 1376 bytes} [Sun Aug 7 10:41:57 2022] GET /identity/v3/role_assignments?group.id=ce4c6ff9717c43a1b1bec5ee01ee2e91&scope.project.id=a981d307e79a4251be167c0015c9f536&role.id=9da6e501237c405ca021a9d9f6173caf => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:00.089213 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fddc66-266c-48e0-a827-18a750dbd925 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:00.089752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fddc66-266c-48e0-a827-18a750dbd925 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:00.089827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fddc66-266c-48e0-a827-18a750dbd925 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:00.091557 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 229/456] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:00.101806 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653992f2-622a-49b1-b36f-a8129e2dfcd2 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:00.102363 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653992f2-622a-49b1-b36f-a8129e2dfcd2 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:00.102363 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653992f2-622a-49b1-b36f-a8129e2dfcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:00.120639 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-653992f2-622a-49b1-b36f-a8129e2dfcd2 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:00.122202 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-653992f2-622a-49b1-b36f-a8129e2dfcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:00.205386 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 228/457] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:42:00.216026 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e46388-519f-4d4f-8b73-a7a40bc53d9f None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:00.216531 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e46388-519f-4d4f-8b73-a7a40bc53d9f None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:00.217013 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e46388-519f-4d4f-8b73-a7a40bc53d9f None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:00.218789 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 230/458] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:00.223703 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c227bf-b649-470c-bbf0-79e07eaed550 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:00.223991 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c227bf-b649-470c-bbf0-79e07eaed550 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:00.224260 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c227bf-b649-470c-bbf0-79e07eaed550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:00.230659 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e46388-519f-4d4f-8b73-a7a40bc53d9f None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:00.253609 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-d8c227bf-b649-470c-bbf0-79e07eaed550 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:00.255215 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-d8c227bf-b649-470c-bbf0-79e07eaed550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:00.266199 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:00.346347 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 229/459] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:42:00.347912 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbdb25-3a24-46f6-9484-7cc2b6c619a9 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:00.347912 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbdb25-3a24-46f6-9484-7cc2b6c619a9 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:00.347912 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbdb25-3a24-46f6-9484-7cc2b6c619a9 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:00.349333 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 230/460] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:00.354246 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3e2b6-02b9-4423-8b8f-1a3ae6fcff56 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:00.354521 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3e2b6-02b9-4423-8b8f-1a3ae6fcff56 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:00.354787 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3e2b6-02b9-4423-8b8f-1a3ae6fcff56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:00.370188 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e46388-519f-4d4f-8b73-a7a40bc53d9f None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:00.376492 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-e9b3e2b6-02b9-4423-8b8f-1a3ae6fcff56 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:00.377843 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-e9b3e2b6-02b9-4423-8b8f-1a3ae6fcff56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:00.414051 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592f1d0-3ccc-417d-aa89-1a29fa7d919c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:00.414862 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592f1d0-3ccc-417d-aa89-1a29fa7d919c None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:00.415138 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592f1d0-3ccc-417d-aa89-1a29fa7d919c None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:00.415408 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592f1d0-3ccc-417d-aa89-1a29fa7d919c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:00.426329 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:00.432307 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592f1d0-3ccc-417d-aa89-1a29fa7d919c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:00.433772 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592f1d0-3ccc-417d-aa89-1a29fa7d919c None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:00.451709 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-c592f1d0-3ccc-417d-aa89-1a29fa7d919c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:00.451709 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:00.451709 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:00.451709 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:00.451709 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:00.451709 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:00.451709 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:00.451709 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:00.451709 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:00.451709 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:00.451709 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:00.451709 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:00.451709 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:00.451709 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:00.451709 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:00.451709 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:00.452638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:00.452638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:00.452638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:00.452638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:00.452638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:00.452638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:00.452638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:00.452638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:00.452638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:00.452638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:00.452638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:00.452638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:00.452638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:00.452638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:00.452638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:00.452638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:00.452638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:00.453513 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:00.453513 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:00.453513 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:00.453513 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 231/461] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:42:00.454156 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592f1d0-3ccc-417d-aa89-1a29fa7d919c None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:00.464014 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 231/462] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 10:42:00.465145 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3e2b6-02b9-4423-8b8f-1a3ae6fcff56 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:00.537134 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:00.562215 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592f1d0-3ccc-417d-aa89-1a29fa7d919c None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:00.575722 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3e2b6-02b9-4423-8b8f-1a3ae6fcff56 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:00.598431 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b6be9-c0ff-4f84-ae45-aa4fd7e236de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:00.599092 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b6be9-c0ff-4f84-ae45-aa4fd7e236de None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:00.599368 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b6be9-c0ff-4f84-ae45-aa4fd7e236de None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:00.599639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b6be9-c0ff-4f84-ae45-aa4fd7e236de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:00.608843 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bd1e5-d0e3-4c48-ac80-5e831eaefb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:00.609460 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bd1e5-d0e3-4c48-ac80-5e831eaefb6c None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:00.609734 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bd1e5-d0e3-4c48-ac80-5e831eaefb6c None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:00.610002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bd1e5-d0e3-4c48-ac80-5e831eaefb6c None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:00.610618 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b6be9-c0ff-4f84-ae45-aa4fd7e236de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:00.610787 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bd1e5-d0e3-4c48-ac80-5e831eaefb6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:00.611052 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bd1e5-d0e3-4c48-ac80-5e831eaefb6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:00.612104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b6be9-c0ff-4f84-ae45-aa4fd7e236de None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:00.612461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bd1e5-d0e3-4c48-ac80-5e831eaefb6c None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:00.627099 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-4d8b6be9-c0ff-4f84-ae45-aa4fd7e236de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:00.627099 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:00.627099 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:00.627099 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:00.627099 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:00.627099 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:00.627099 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:00.627099 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:00.627099 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:00.627099 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:00.627099 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:00.627099 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:00.627099 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:00.627099 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:00.627099 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:00.627099 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:00.627980 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:00.627980 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:00.627980 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:00.627980 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:00.627980 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:00.627980 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:00.627980 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:00.627980 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:00.627980 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:00.627980 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:00.627980 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:00.627980 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:00.627980 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:00.627980 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:00.627980 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:00.627980 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:00.627980 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:00.628835 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:00.628835 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:00.628835 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:00.628835 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 232/463] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:00.629479 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d3f8b-5670-4ff3-9867-3398f36cacce None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:00.629638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d3f8b-5670-4ff3-9867-3398f36cacce None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:00.629890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d3f8b-5670-4ff3-9867-3398f36cacce None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:00.633428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 233/464] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:00.633428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d3f8b-5670-4ff3-9867-3398f36cacce None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:00.635399 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 232/465] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:00.636219 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bd1e5-d0e3-4c48-ac80-5e831eaefb6c None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:00.673122 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:00.741881 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bd1e5-d0e3-4c48-ac80-5e831eaefb6c None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:00.744856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d3f8b-5670-4ff3-9867-3398f36cacce None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:00.772497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:00.777104 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b08abd-8922-4bc6-8bfe-adf5405d5c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:00.777749 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b08abd-8922-4bc6-8bfe-adf5405d5c4a None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:00.778024 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b08abd-8922-4bc6-8bfe-adf5405d5c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:00.778292 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b08abd-8922-4bc6-8bfe-adf5405d5c4a None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:00.778937 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b08abd-8922-4bc6-8bfe-adf5405d5c4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:00.779236 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b08abd-8922-4bc6-8bfe-adf5405d5c4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:00.780610 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b08abd-8922-4bc6-8bfe-adf5405d5c4a None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:00.785981 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be21293-4e3e-413d-839a-3f1f89187552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:00.786604 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be21293-4e3e-413d-839a-3f1f89187552 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:00.786875 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be21293-4e3e-413d-839a-3f1f89187552 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:00.787141 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be21293-4e3e-413d-839a-3f1f89187552 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:00.797037 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 233/466] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:00.797037 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb06b1-9c8b-4fb9-b24b-3ab16c203f49 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:00.797037 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb06b1-9c8b-4fb9-b24b-3ab16c203f49 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:00.797037 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb06b1-9c8b-4fb9-b24b-3ab16c203f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:00.802092 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be21293-4e3e-413d-839a-3f1f89187552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:00.803805 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be21293-4e3e-413d-839a-3f1f89187552 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:00.812577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-e2fb06b1-9c8b-4fb9-b24b-3ab16c203f49 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:00.814320 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-e2fb06b1-9c8b-4fb9-b24b-3ab16c203f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:00.819424 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-0be21293-4e3e-413d-839a-3f1f89187552 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:00.819424 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:00.819424 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:00.819424 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:00.819424 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:00.819424 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:00.819424 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:00.819424 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:00.819424 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:00.819424 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:00.819424 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:00.819424 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:00.819424 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:00.819424 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:00.819424 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:00.819424 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:00.820302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:00.820302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:00.820302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:00.820302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:00.820302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:00.820302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:00.820302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:00.820302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:00.820302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:00.820302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:00.820302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:00.820302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:00.820302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:00.820302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:00.820302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:00.820302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:00.820302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:00.825940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:00.825940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:00.825940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:00.825940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 234/467] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:00.825940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be21293-4e3e-413d-839a-3f1f89187552 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:00.891835 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 234/468] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:42:00.893152 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb06b1-9c8b-4fb9-b24b-3ab16c203f49 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:00.930907 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:00.932352 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be21293-4e3e-413d-839a-3f1f89187552 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:00.969158 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db996f8c-135c-4946-ae91-220737c40c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:00.969784 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db996f8c-135c-4946-ae91-220737c40c4d None admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:00.970113 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db996f8c-135c-4946-ae91-220737c40c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:00.970431 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db996f8c-135c-4946-ae91-220737c40c4d None admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:00.971110 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db996f8c-135c-4946-ae91-220737c40c4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:00.972529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db996f8c-135c-4946-ae91-220737c40c4d None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:01.005346 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 235/469] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 7 10:42:00 2022] POST /identity/v3/users => generated 248 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:42:01.005346 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db996f8c-135c-4946-ae91-220737c40c4d None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:01.030379 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb06b1-9c8b-4fb9-b24b-3ab16c203f49 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:01.037762 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:01.074499 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabce234-bafe-459d-ac9b-0d1e5b4f9ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:01.075264 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabce234-bafe-459d-ac9b-0d1e5b4f9ce6 None admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:01.075692 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabce234-bafe-459d-ac9b-0d1e5b4f9ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:01.076061 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabce234-bafe-459d-ac9b-0d1e5b4f9ce6 None admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:01.077000 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabce234-bafe-459d-ac9b-0d1e5b4f9ce6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:01.078948 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabce234-bafe-459d-ac9b-0d1e5b4f9ce6 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:01.105303 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 235/470] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 7 10:42:00 2022] POST /identity/v3/users => generated 246 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:42:01.106490 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabce234-bafe-459d-ac9b-0d1e5b4f9ce6 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:01.134564 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db996f8c-135c-4946-ae91-220737c40c4d None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:01.212129 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:01.221852 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11428fc6-3831-4712-aefd-56bfa740adaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:01.222718 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11428fc6-3831-4712-aefd-56bfa740adaf None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:01.223133 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11428fc6-3831-4712-aefd-56bfa740adaf None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:01.223536 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11428fc6-3831-4712-aefd-56bfa740adaf None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:01.224361 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11428fc6-3831-4712-aefd-56bfa740adaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:01.224866 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11428fc6-3831-4712-aefd-56bfa740adaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:01.226492 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11428fc6-3831-4712-aefd-56bfa740adaf None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:01.233795 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabce234-bafe-459d-ac9b-0d1e5b4f9ce6 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:01.253502 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 236/471] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:01.262515 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11428fc6-3831-4712-aefd-56bfa740adaf None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:01.275306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a3e5c-d1df-4726-8fbc-35cd1483edd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:01.275955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a3e5c-d1df-4726-8fbc-35cd1483edd2 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:01.276231 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a3e5c-d1df-4726-8fbc-35cd1483edd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:01.276499 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a3e5c-d1df-4726-8fbc-35cd1483edd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:01.290446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a3e5c-d1df-4726-8fbc-35cd1483edd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:01.292810 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a3e5c-d1df-4726-8fbc-35cd1483edd2 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:01.312674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-da0a3e5c-d1df-4726-8fbc-35cd1483edd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:01.312674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:01.312674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:01.312674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:01.312674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:01.312674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:01.312674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:01.312674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:01.312674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:01.312674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:01.312674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:01.312674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:01.312674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:01.312674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:01.312674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:01.312674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:01.313670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:01.313670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:01.313670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:01.313670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:01.313670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:01.313670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:01.313670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:01.313670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:01.313670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:01.313670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:01.313670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:01.313670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:01.313670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:01.313670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:01.313670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:01.313670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:01.313670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:01.315083 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:01.315083 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:01.315083 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:01.315083 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 236/472] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:01.320120 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a3e5c-d1df-4726-8fbc-35cd1483edd2 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:01.396677 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:01.406176 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11428fc6-3831-4712-aefd-56bfa740adaf None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:01.453865 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a3e5c-d1df-4726-8fbc-35cd1483edd2 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:01.454166 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737287f-d6b9-4823-9a5b-da1136be2b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:01.454745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737287f-d6b9-4823-9a5b-da1136be2b41 None admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:01.455022 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737287f-d6b9-4823-9a5b-da1136be2b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:01.455292 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737287f-d6b9-4823-9a5b-da1136be2b41 None admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:01.456189 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737287f-d6b9-4823-9a5b-da1136be2b41 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:01.458651 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737287f-d6b9-4823-9a5b-da1136be2b41 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:01.490021 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 237/473] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 7 10:42:01 2022] POST /identity/v3/users => generated 248 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:42:01.491262 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6787c9e-0b00-49a6-b942-ef87c399b0e1 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:01.491547 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6787c9e-0b00-49a6-b942-ef87c399b0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:01.491817 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6787c9e-0b00-49a6-b942-ef87c399b0e1 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:01.493360 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 238/474] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:01.499227 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5d431-4505-45bb-a4c5-9d4e17bf2e34 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:01.499496 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5d431-4505-45bb-a4c5-9d4e17bf2e34 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:01.500242 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5d431-4505-45bb-a4c5-9d4e17bf2e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:01.506196 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef7cf6-fe75-408d-9f1f-0a56f0c2ecd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:01.506820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef7cf6-fe75-408d-9f1f-0a56f0c2ecd0 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:01.507470 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef7cf6-fe75-408d-9f1f-0a56f0c2ecd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:01.507752 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef7cf6-fe75-408d-9f1f-0a56f0c2ecd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:01.509649 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef7cf6-fe75-408d-9f1f-0a56f0c2ecd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:01.509961 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef7cf6-fe75-408d-9f1f-0a56f0c2ecd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:01.511408 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef7cf6-fe75-408d-9f1f-0a56f0c2ecd0 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:01.513439 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:01.523187 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-4ff5d431-4505-45bb-a4c5-9d4e17bf2e34 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:01.525004 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-4ff5d431-4505-45bb-a4c5-9d4e17bf2e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:01.527993 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 237/475] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:01.535048 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef7cf6-fe75-408d-9f1f-0a56f0c2ecd0 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:01.642607 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 239/476] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 10:42:01.667897 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5d431-4505-45bb-a4c5-9d4e17bf2e34 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:01.748472 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef7cf6-fe75-408d-9f1f-0a56f0c2ecd0 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:01.777886 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:01.801363 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ccb122-efb7-4b7a-9aff-293da174fc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:01.801974 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccb122-efb7-4b7a-9aff-293da174fc45 None admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:01.802406 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccb122-efb7-4b7a-9aff-293da174fc45 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:01.802670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccb122-efb7-4b7a-9aff-293da174fc45 None admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:01.803865 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ccb122-efb7-4b7a-9aff-293da174fc45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:01.805337 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ccb122-efb7-4b7a-9aff-293da174fc45 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:01.805655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5d431-4505-45bb-a4c5-9d4e17bf2e34 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:01.834519 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 238/477] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 7 10:42:01 2022] POST /identity/v3/users => generated 249 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:42:01.852492 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29767a7-76d1-4263-a61f-d4b39e979fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:01.853184 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29767a7-76d1-4263-a61f-d4b39e979fdd None admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:01.853590 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29767a7-76d1-4263-a61f-d4b39e979fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:01.853864 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29767a7-76d1-4263-a61f-d4b39e979fdd None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:01.854641 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29767a7-76d1-4263-a61f-d4b39e979fdd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:01.856123 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29767a7-76d1-4263-a61f-d4b39e979fdd None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:01.869780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.sql.core [None req-b29767a7-76d1-4263-a61f-d4b39e979fdd None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 07 10:42:01.869780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 07 10:42:01.869780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [parameters: {'id': '8a2c6316dcea4203966ef9c94a5d37fa', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 07 10:42:01.869780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80144) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 07 10:42:01.888273 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-b29767a7-76d1-4263-a61f-d4b39e979fdd None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 07 10:42:01.888273 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:01.888273 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 10:42:01.888273 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 10:42:01.888273 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 10:42:01.888273 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 10:42:01.888273 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 10:42:01.888273 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 10:42:01.888273 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 10:42:01.888273 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application conn.query(q) Aug 07 10:42:01.888273 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 10:42:01.888273 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 10:42:01.888273 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 10:42:01.888273 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application result.read() Aug 07 10:42:01.888273 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 10:42:01.890482 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 10:42:01.890482 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 10:42:01.890482 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 10:42:01.890482 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 10:42:01.890482 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 10:42:01.890482 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 10:42:01.890482 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 10:42:01.890482 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 07 10:42:01.890482 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:01.890482 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 07 10:42:01.890482 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:01.890482 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:01.890482 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 07 10:42:01.890482 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 07 10:42:01.890482 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 07 10:42:01.890482 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return ref.to_dict() Aug 07 10:42:01.890482 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 10:42:01.890482 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application next(self.gen) Aug 07 10:42:01.892878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 07 10:42:01.892878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application yield resource Aug 07 10:42:01.892878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 10:42:01.892878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application next(self.gen) Aug 07 10:42:01.892878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 07 10:42:01.892878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self.session.rollback() Aug 07 10:42:01.892878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 10:42:01.892878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self.force_reraise() Aug 07 10:42:01.892878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 10:42:01.892878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise self.value Aug 07 10:42:01.892878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 07 10:42:01.892878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 07 10:42:01.892878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 07 10:42:01.892878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application session.commit() Aug 07 10:42:01.892878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 07 10:42:01.892878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 07 10:42:01.892878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 07 10:42:01.897682 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self._prepare_impl() Aug 07 10:42:01.897682 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 07 10:42:01.897682 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self.session.flush() Aug 07 10:42:01.897682 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 07 10:42:01.897682 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self._flush(objects) Aug 07 10:42:01.897682 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 07 10:42:01.897682 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 07 10:42:01.897682 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 07 10:42:01.897682 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application compat.raise_( Aug 07 10:42:01.897682 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 10:42:01.897682 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception Aug 07 10:42:01.897682 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 07 10:42:01.897682 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application flush_context.execute() Aug 07 10:42:01.897682 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 07 10:42:01.897682 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rec.execute(self) Aug 07 10:42:01.897682 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 07 10:42:01.897682 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 07 10:42:01.899832 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 07 10:42:01.899832 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 07 10:42:01.899832 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 07 10:42:01.899832 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 07 10:42:01.899832 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 07 10:42:01.899832 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 07 10:42:01.899832 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 07 10:42:01.899832 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 07 10:42:01.899832 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 07 10:42:01.899832 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 07 10:42:01.899832 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 07 10:42:01.899832 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 07 10:42:01.899832 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 07 10:42:01.899832 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 07 10:42:01.899832 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 10:42:01.899832 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception Aug 07 10:42:01.901842 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 10:42:01.901842 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 10:42:01.901842 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 10:42:01.901842 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 10:42:01.901842 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 10:42:01.901842 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 10:42:01.901842 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 10:42:01.901842 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application conn.query(q) Aug 07 10:42:01.901842 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 10:42:01.901842 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 10:42:01.901842 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 10:42:01.901842 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application result.read() Aug 07 10:42:01.901842 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 10:42:01.901842 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 10:42:01.901842 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 10:42:01.901842 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 10:42:01.904047 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 10:42:01.904047 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 10:42:01.904047 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 10:42:01.904047 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 10:42:01.904047 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 07 10:42:01.904047 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 07 10:42:01.904047 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [parameters: {'id': '8a2c6316dcea4203966ef9c94a5d37fa', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 07 10:42:01.904047 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 07 10:42:01.904047 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:01.904047 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 10:42:01.904047 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:01.904047 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:01.904047 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:01.904047 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:01.904047 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:01.904047 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:01.907045 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:01.907045 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:01.907045 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:01.907045 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:01.907045 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:01.907045 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:01.907045 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 07 10:42:01.907045 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 07 10:42:01.907045 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:01.907045 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:01.907045 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 07 10:42:01.907045 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 07 10:42:01.907045 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 07 10:42:01.907045 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 07 10:42:01.907045 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 07 10:42:01.907045 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:01.909052 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 240/478] 10.222.0.27 () {60 vars in 1131 bytes} [Sun Aug 7 10:42:01 2022] POST /identity/v3/roles => generated 144 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:01.909212 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ccb122-efb7-4b7a-9aff-293da174fc45 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:01.965968 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:02.028454 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ccb122-efb7-4b7a-9aff-293da174fc45 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:02.064826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc88cf-5d89-4fce-99cb-bbc89604fbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:02.065508 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc88cf-5d89-4fce-99cb-bbc89604fbc6 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:02.065787 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc88cf-5d89-4fce-99cb-bbc89604fbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:02.066057 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc88cf-5d89-4fce-99cb-bbc89604fbc6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:02.078152 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc88cf-5d89-4fce-99cb-bbc89604fbc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:42:02.084011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-22fc88cf-5d89-4fce-99cb-bbc89604fbc6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 10:42:02.084011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:02.084011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:02.084011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:02.084011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:02.084011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:02.084011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:02.084011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:02.084011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:02.084011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:02.084011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:02.084011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:02.084011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:42:02.084011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:42:02.084011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:42:02.084011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:42:02.084911 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:42:02.084911 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:42:02.084911 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:42:02.084911 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:42:02.084911 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:02.084911 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:02.084911 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:02.084911 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:02.084911 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:02.084911 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:02.084911 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:02.084911 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:02.084911 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:02.084911 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:02.084911 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:02.084911 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:02.085926 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:02.085926 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:02.085926 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:02.085926 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:02.085926 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:42:02.085926 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:42:02.085926 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:42:02.085926 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:42:02.085926 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:42:02.085926 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:42:02.085926 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 10:42:02.085926 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:02.085926 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 239/479] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 7 10:42:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:02.090956 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29767a7-76d1-4263-a61f-d4b39e979fdd None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:02.200180 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29767a7-76d1-4263-a61f-d4b39e979fdd None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:02.236229 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a25bc9-2a40-40d6-a6fc-4f009e6a1619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:02.236900 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a25bc9-2a40-40d6-a6fc-4f009e6a1619 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:02.237181 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a25bc9-2a40-40d6-a6fc-4f009e6a1619 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:02.237485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a25bc9-2a40-40d6-a6fc-4f009e6a1619 None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:02.238160 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a25bc9-2a40-40d6-a6fc-4f009e6a1619 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:02.238460 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a25bc9-2a40-40d6-a6fc-4f009e6a1619 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:02.239821 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a25bc9-2a40-40d6-a6fc-4f009e6a1619 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:02.248910 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 241/480] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:03.518601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b40c0-29c7-4dfd-84a0-e03c030a9b26 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:03.519105 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b40c0-29c7-4dfd-84a0-e03c030a9b26 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:03.519217 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b40c0-29c7-4dfd-84a0-e03c030a9b26 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:03.520753 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 240/481] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:03.526237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05d308-edf5-4bc5-938c-4652bb0de6f5 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:03.527066 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05d308-edf5-4bc5-938c-4652bb0de6f5 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:03.527531 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05d308-edf5-4bc5-938c-4652bb0de6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:03.553509 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-bb05d308-edf5-4bc5-938c-4652bb0de6f5 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:03.555053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-bb05d308-edf5-4bc5-938c-4652bb0de6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:03.557257 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:03.634997 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 242/482] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:42:03.674387 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b40c0-29c7-4dfd-84a0-e03c030a9b26 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:03.734277 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbdadb-eb4c-4ef0-abad-13ef2da3c83b None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:03.734634 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbdadb-eb4c-4ef0-abad-13ef2da3c83b None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:03.734911 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbdadb-eb4c-4ef0-abad-13ef2da3c83b None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:03.736981 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 243/483] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 10:42:03.742960 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5e084-5491-4492-8a39-6e9fea8d325d None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:03.743730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5e084-5491-4492-8a39-6e9fea8d325d None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:03.744193 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5e084-5491-4492-8a39-6e9fea8d325d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:03.766034 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-20d5e084-5491-4492-8a39-6e9fea8d325d None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:03.767596 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-20d5e084-5491-4492-8a39-6e9fea8d325d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:03.841979 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b40c0-29c7-4dfd-84a0-e03c030a9b26 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:03.860730 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:03.898076 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 244/484] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 10:42:03.912812 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6849a-3b5e-48c4-9768-2eecd02a6a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:03.913482 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6849a-3b5e-48c4-9768-2eecd02a6a97 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:03.913763 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6849a-3b5e-48c4-9768-2eecd02a6a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:03.914033 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6849a-3b5e-48c4-9768-2eecd02a6a97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:03.922001 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5e084-5491-4492-8a39-6e9fea8d325d None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:03.935713 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6849a-3b5e-48c4-9768-2eecd02a6a97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:42:03.940871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-cab6849a-3b5e-48c4-9768-2eecd02a6a97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:03.940871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:03.940871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:03.940871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:03.940871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:03.940871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:03.940871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:03.940871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:03.940871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:03.940871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:03.940871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:03.940871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:03.940871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:42:03.940871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:42:03.940871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:42:03.940871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:42:03.941924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:42:03.941924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:42:03.941924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:42:03.941924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:42:03.941924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:03.941924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:03.941924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:03.941924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:03.941924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:03.941924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:03.941924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:03.941924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:03.941924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:03.941924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:03.941924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:03.941924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:03.942722 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:03.942722 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:03.942722 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:03.942722 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:03.942722 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:42:03.942722 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:42:03.942722 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:42:03.942722 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:42:03.942722 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:42:03.942722 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:42:03.942722 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:03.942722 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:03.949881 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 241/485] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 7 10:42:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:03.956486 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6849a-3b5e-48c4-9768-2eecd02a6a97 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:04.001354 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:04.059163 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5e084-5491-4492-8a39-6e9fea8d325d None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:04.103892 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9778dfa-3326-4528-a2a2-0dfdb2dfe3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:04.104526 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9778dfa-3326-4528-a2a2-0dfdb2dfe3da None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:04.104802 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9778dfa-3326-4528-a2a2-0dfdb2dfe3da None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:04.105074 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9778dfa-3326-4528-a2a2-0dfdb2dfe3da None admin] PATH_INFO: `/v3/roles/service` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:04.128553 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9778dfa-3326-4528-a2a2-0dfdb2dfe3da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:42:04.133244 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-a9778dfa-3326-4528-a2a2-0dfdb2dfe3da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:04.133244 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:04.133244 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:04.133244 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:04.133244 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:04.133244 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:04.133244 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:04.133244 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:04.133244 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:04.133244 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:04.133244 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:04.133244 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:04.133244 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:42:04.133244 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:42:04.133244 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:42:04.133244 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:42:04.134138 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:42:04.134138 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:42:04.134138 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:42:04.134138 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:42:04.134138 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:04.134138 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:04.134138 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:04.134138 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:04.134138 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:04.134138 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:04.134138 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:04.134138 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:04.134138 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:04.134138 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:04.134138 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:04.134138 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:04.134947 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:04.134947 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:04.134947 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:04.134947 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:04.134947 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:42:04.134947 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:42:04.134947 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:42:04.134947 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:42:04.134947 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:42:04.134947 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:42:04.134947 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:04.134947 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:04.143371 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 245/486] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 7 10:42:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:42:04.144249 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9778dfa-3326-4528-a2a2-0dfdb2dfe3da None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:04.163856 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6849a-3b5e-48c4-9768-2eecd02a6a97 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:04.231016 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b12e5-f5ab-400f-810a-f96d9d2344b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:04.231629 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b12e5-f5ab-400f-810a-f96d9d2344b0 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:04.231903 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b12e5-f5ab-400f-810a-f96d9d2344b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:04.232175 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b12e5-f5ab-400f-810a-f96d9d2344b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:04.232871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b12e5-f5ab-400f-810a-f96d9d2344b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:04.233143 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b12e5-f5ab-400f-810a-f96d9d2344b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:04.234535 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b12e5-f5ab-400f-810a-f96d9d2344b0 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:04.259396 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 242/487] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 7 10:42:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:04.260836 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b12e5-f5ab-400f-810a-f96d9d2344b0 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:04.300995 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:04.337741 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9778dfa-3326-4528-a2a2-0dfdb2dfe3da None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:04.377653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:04.385769 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4ef9e-d4a5-4af5-85c4-de3a7fb82e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:04.386368 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4ef9e-d4a5-4af5-85c4-de3a7fb82e80 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:04.386646 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4ef9e-d4a5-4af5-85c4-de3a7fb82e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:04.386916 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4ef9e-d4a5-4af5-85c4-de3a7fb82e80 None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:04.387580 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4ef9e-d4a5-4af5-85c4-de3a7fb82e80 None admin] RBAC: Adding query filter params (name=service) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:04.387878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4ef9e-d4a5-4af5-85c4-de3a7fb82e80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:04.389228 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4ef9e-d4a5-4af5-85c4-de3a7fb82e80 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:04.394902 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b12e5-f5ab-400f-810a-f96d9d2344b0 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:04.402323 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 246/488] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 7 10:42:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:04.402323 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fe403-81d6-4a73-877c-94d3f71f0ebb None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:04.402323 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fe403-81d6-4a73-877c-94d3f71f0ebb None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:04.402323 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fe403-81d6-4a73-877c-94d3f71f0ebb None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:04.402323 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 247/489] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:04.406200 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c965b-200b-4179-ae0c-3a9fe50d01ce None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:04.406481 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c965b-200b-4179-ae0c-3a9fe50d01ce None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:04.406754 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c965b-200b-4179-ae0c-3a9fe50d01ce None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:04.408023 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 248/490] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:04.408695 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c965b-200b-4179-ae0c-3a9fe50d01ce None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:04.435627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0a2d9-94a4-460f-ad36-d7f1fc9ac5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:04.436564 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0a2d9-94a4-460f-ad36-d7f1fc9ac5de None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:04.437052 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0a2d9-94a4-460f-ad36-d7f1fc9ac5de None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:04.437500 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0a2d9-94a4-460f-ad36-d7f1fc9ac5de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:04.450325 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0a2d9-94a4-460f-ad36-d7f1fc9ac5de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:04.451964 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0a2d9-94a4-460f-ad36-d7f1fc9ac5de None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:04.467811 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-b6a0a2d9-94a4-460f-ad36-d7f1fc9ac5de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:04.467811 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:04.467811 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:04.467811 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:04.467811 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:04.467811 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:04.467811 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:04.467811 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:04.467811 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:04.467811 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:04.467811 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:04.467811 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:04.467811 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:04.467811 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:04.467811 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:04.467811 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:04.468924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:04.468924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:04.468924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:04.468924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:04.468924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:04.468924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:04.468924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:04.468924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:04.468924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:04.468924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:04.468924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:04.468924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:04.468924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:04.468924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:04.468924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:04.468924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:04.468924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:04.470510 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:04.470510 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:04.470510 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:04.470510 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 243/491] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:42:04.470888 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544800cb-8a78-4f41-b46f-66a75da50020 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:04.471164 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544800cb-8a78-4f41-b46f-66a75da50020 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:04.471431 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544800cb-8a78-4f41-b46f-66a75da50020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:04.490108 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-544800cb-8a78-4f41-b46f-66a75da50020 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:04.491310 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-544800cb-8a78-4f41-b46f-66a75da50020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:04.522762 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c965b-200b-4179-ae0c-3a9fe50d01ce None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:04.558513 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ceb82-95eb-4fa4-a4f6-c3a3ae93b9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:04.559280 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ceb82-95eb-4fa4-a4f6-c3a3ae93b9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:04.559562 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ceb82-95eb-4fa4-a4f6-c3a3ae93b9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:04.559829 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ceb82-95eb-4fa4-a4f6-c3a3ae93b9a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:04.569585 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 244/492] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:42:04.569585 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251c7e8-688a-45ed-b276-eb00e4d7b799 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:04.569585 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251c7e8-688a-45ed-b276-eb00e4d7b799 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:04.569585 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251c7e8-688a-45ed-b276-eb00e4d7b799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:04.580600 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ceb82-95eb-4fa4-a4f6-c3a3ae93b9a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:04.582184 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ceb82-95eb-4fa4-a4f6-c3a3ae93b9a2 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:04.584847 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-6251c7e8-688a-45ed-b276-eb00e4d7b799 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:04.586069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-6251c7e8-688a-45ed-b276-eb00e4d7b799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:04.597495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:04.598376 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-144ceb82-95eb-4fa4-a4f6-c3a3ae93b9a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:04.598376 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:04.598376 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:04.598376 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:04.598376 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:04.598376 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:04.598376 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:04.598376 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:04.598376 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:04.598376 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:04.598376 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:04.598376 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:04.598376 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:04.598376 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:04.598376 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:04.598376 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:04.599237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:04.599237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:04.599237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:04.599237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:04.599237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:04.599237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:04.599237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:04.599237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:04.599237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:04.599237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:04.599237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:04.599237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:04.599237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:04.599237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:04.599237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:04.599237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:04.599237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:04.600668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:04.600668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:04.600668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:04.600668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 249/493] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:04.600668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ceb82-95eb-4fa4-a4f6-c3a3ae93b9a2 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:04.648031 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:04.663015 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 245/494] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:42:04.664180 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251c7e8-688a-45ed-b276-eb00e4d7b799 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:04.719121 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ceb82-95eb-4fa4-a4f6-c3a3ae93b9a2 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:04.756121 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ee752-347a-44ac-a0de-0bb5550faa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:04.756836 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ee752-347a-44ac-a0de-0bb5550faa5d None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:04.757182 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ee752-347a-44ac-a0de-0bb5550faa5d None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:04.757566 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ee752-347a-44ac-a0de-0bb5550faa5d None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:04.758216 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ee752-347a-44ac-a0de-0bb5550faa5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:04.758521 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ee752-347a-44ac-a0de-0bb5550faa5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:04.759893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ee752-347a-44ac-a0de-0bb5550faa5d None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:04.772735 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 250/495] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:04.773643 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ee752-347a-44ac-a0de-0bb5550faa5d None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:04.780123 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251c7e8-688a-45ed-b276-eb00e4d7b799 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:04.818022 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e1768-d64b-4ff2-b8b1-08620a3282bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:04.818650 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e1768-d64b-4ff2-b8b1-08620a3282bb None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:04.819171 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e1768-d64b-4ff2-b8b1-08620a3282bb None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:04.819171 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e1768-d64b-4ff2-b8b1-08620a3282bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:04.830672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e1768-d64b-4ff2-b8b1-08620a3282bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:42:04.837602 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-217e1768-d64b-4ff2-b8b1-08620a3282bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:04.837602 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:04.837602 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:04.837602 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:04.837602 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:04.837602 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:04.837602 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:04.837602 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:04.837602 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:04.837602 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:04.837602 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:04.837602 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:04.837602 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:42:04.837602 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:42:04.837602 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:42:04.837602 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:42:04.838497 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:42:04.838497 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:42:04.838497 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:42:04.838497 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:42:04.838497 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:04.838497 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:04.838497 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:04.838497 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:04.838497 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:04.838497 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:04.838497 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:04.838497 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:04.838497 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:04.838497 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:04.838497 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:04.838497 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:04.839285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:04.839285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:04.839285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:04.839285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:04.839285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:42:04.839285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:42:04.839285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:42:04.839285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:42:04.839285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:42:04.839285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:42:04.839285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:04.839285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:04.839285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 246/496] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 7 10:42:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:04.840573 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e1768-d64b-4ff2-b8b1-08620a3282bb None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:04.845665 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:04.885953 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ee752-347a-44ac-a0de-0bb5550faa5d None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:04.887611 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:04.922822 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42199c-830f-4df8-9755-45dba43fdae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:04.923436 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42199c-830f-4df8-9755-45dba43fdae4 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:04.923708 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42199c-830f-4df8-9755-45dba43fdae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:04.924100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42199c-830f-4df8-9755-45dba43fdae4 None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:04.924646 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42199c-830f-4df8-9755-45dba43fdae4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:04.924943 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42199c-830f-4df8-9755-45dba43fdae4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:04.926324 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42199c-830f-4df8-9755-45dba43fdae4 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:04.937580 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 251/497] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:04.938191 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42199c-830f-4df8-9755-45dba43fdae4 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:04.959049 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e1768-d64b-4ff2-b8b1-08620a3282bb None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:04.994925 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4294b-3d96-4ab2-a7d2-2548a6a34598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:04.995473 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4294b-3d96-4ab2-a7d2-2548a6a34598 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:04.995748 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4294b-3d96-4ab2-a7d2-2548a6a34598 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:04.996015 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4294b-3d96-4ab2-a7d2-2548a6a34598 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:05.005846 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4294b-3d96-4ab2-a7d2-2548a6a34598 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:42:05.010453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-b2f4294b-3d96-4ab2-a7d2-2548a6a34598 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:05.010453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:05.010453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:05.010453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:05.010453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:05.010453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:05.010453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:05.010453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:05.010453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:05.010453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:05.010453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:05.010453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:05.010453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:42:05.010453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:42:05.010453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:42:05.010453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:42:05.011358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:42:05.011358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:42:05.011358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:42:05.011358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:42:05.011358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:05.011358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:05.011358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:05.011358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:05.011358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:05.011358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:05.011358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:05.011358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:05.011358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:05.011358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:05.011358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:05.011358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:05.012170 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:05.012170 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:05.012170 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:05.012170 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:05.012170 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:42:05.012170 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:42:05.012170 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:42:05.012170 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:42:05.012170 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:42:05.012170 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:42:05.012170 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:05.012170 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:05.012170 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 247/498] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 7 10:42:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:05.013652 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4294b-3d96-4ab2-a7d2-2548a6a34598 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:05.041743 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42199c-830f-4df8-9755-45dba43fdae4 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:05.075792 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139690b-6452-4d23-b774-1a97a5db36f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:05.076408 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139690b-6452-4d23-b774-1a97a5db36f3 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:05.076683 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139690b-6452-4d23-b774-1a97a5db36f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:05.076966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139690b-6452-4d23-b774-1a97a5db36f3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:05.081154 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:05.085259 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139690b-6452-4d23-b774-1a97a5db36f3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:05.086721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139690b-6452-4d23-b774-1a97a5db36f3 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:05.098918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-e139690b-6452-4d23-b774-1a97a5db36f3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 10:42:05.098918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:05.098918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:05.098918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:05.098918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:05.098918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:05.098918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:05.098918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:05.098918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:05.098918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:05.098918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:05.098918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:05.098918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:42:05.098918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:42:05.098918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:42:05.098918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:42:05.100017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:05.100017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:05.100017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:42:05.100017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:05.100017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:42:05.100017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:05.100017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:05.100017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:05.100017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:05.100017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:05.100017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:05.100017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:05.100017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:05.100017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:05.100017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:05.100017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:05.100017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:05.100017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:05.101072 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:05.101072 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:05.101072 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:42:05.101072 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:42:05.101072 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:42:05.101072 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:42:05.101072 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:42:05.101072 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:42:05.101072 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 10:42:05.101072 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:05.101072 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 252/499] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Aug 7 10:42:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:05.101721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578049c-2c3e-4dc6-ad6e-e29d72670420 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:05.101721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578049c-2c3e-4dc6-ad6e-e29d72670420 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:05.101721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578049c-2c3e-4dc6-ad6e-e29d72670420 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:05.103042 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 253/500] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:05.103630 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578049c-2c3e-4dc6-ad6e-e29d72670420 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:05.129529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:05.130460 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4294b-3d96-4ab2-a7d2-2548a6a34598 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:05.164478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f79e0d-fde9-4007-863d-7805da3209f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:05.165081 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f79e0d-fde9-4007-863d-7805da3209f9 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:05.165379 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f79e0d-fde9-4007-863d-7805da3209f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:05.165655 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f79e0d-fde9-4007-863d-7805da3209f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:05.166317 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f79e0d-fde9-4007-863d-7805da3209f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:05.166613 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f79e0d-fde9-4007-863d-7805da3209f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:05.167979 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f79e0d-fde9-4007-863d-7805da3209f9 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:05.175926 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 248/501] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 7 10:42:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:05.176719 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f79e0d-fde9-4007-863d-7805da3209f9 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:05.212638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578049c-2c3e-4dc6-ad6e-e29d72670420 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:05.245589 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c6178-88b7-4384-86cc-26c3a28e9e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:05.246118 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c6178-88b7-4384-86cc-26c3a28e9e5a None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:05.246390 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c6178-88b7-4384-86cc-26c3a28e9e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:05.246658 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c6178-88b7-4384-86cc-26c3a28e9e5a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:05.255580 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c6178-88b7-4384-86cc-26c3a28e9e5a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:05.257026 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c6178-88b7-4384-86cc-26c3a28e9e5a None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:05.268447 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-9b9c6178-88b7-4384-86cc-26c3a28e9e5a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 10:42:05.268447 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:05.268447 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:05.268447 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:05.268447 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:05.268447 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:05.268447 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:05.268447 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:05.268447 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:05.268447 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:05.268447 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:05.268447 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:05.268447 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:42:05.268447 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:42:05.268447 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:42:05.268447 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:42:05.269485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:05.269485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:05.269485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:42:05.269485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:05.269485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:42:05.269485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:05.269485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:05.269485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:05.269485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:05.269485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:05.269485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:05.269485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:05.269485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:05.269485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:05.269485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:05.269485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:05.269485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:05.269485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:05.270525 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:05.270525 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:05.270525 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:42:05.270525 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:42:05.270525 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:42:05.270525 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:42:05.270525 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:42:05.270525 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:42:05.270525 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 10:42:05.270525 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:05.270525 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 254/502] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:42:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:05.270525 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c6178-88b7-4384-86cc-26c3a28e9e5a None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:05.277289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f79e0d-fde9-4007-863d-7805da3209f9 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:05.302351 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:05.311077 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c702adf-d6ad-4cec-af2b-6db176fbc68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:05.311680 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c702adf-d6ad-4cec-af2b-6db176fbc68d None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:05.311947 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c702adf-d6ad-4cec-af2b-6db176fbc68d None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:05.312209 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c702adf-d6ad-4cec-af2b-6db176fbc68d None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:05.312873 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c702adf-d6ad-4cec-af2b-6db176fbc68d None admin] RBAC: Adding query filter params (name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:05.313166 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c702adf-d6ad-4cec-af2b-6db176fbc68d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:05.315305 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c702adf-d6ad-4cec-af2b-6db176fbc68d None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:05.323205 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 249/503] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 7 10:42:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:05.324328 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb7029-d909-4de2-84f7-1d27815f6a5f None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:05.324728 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb7029-d909-4de2-84f7-1d27815f6a5f None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:05.324991 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb7029-d909-4de2-84f7-1d27815f6a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:05.343859 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-d3fb7029-d909-4de2-84f7-1d27815f6a5f None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:05.345118 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-d3fb7029-d909-4de2-84f7-1d27815f6a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:05.358698 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:05.377850 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c6178-88b7-4384-86cc-26c3a28e9e5a None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:05.410986 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba09502-a130-4487-b1be-e7808cdbe1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:05.411582 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba09502-a130-4487-b1be-e7808cdbe1be None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:05.411858 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba09502-a130-4487-b1be-e7808cdbe1be None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:05.412128 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba09502-a130-4487-b1be-e7808cdbe1be None admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:05.412857 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba09502-a130-4487-b1be-e7808cdbe1be None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:05.412988 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 250/504] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:42:05.421897 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba09502-a130-4487-b1be-e7808cdbe1be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:05.422005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb7029-d909-4de2-84f7-1d27815f6a5f None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:05.422079 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba09502-a130-4487-b1be-e7808cdbe1be None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:05.451453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 255/505] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Aug 7 10:42:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:05.452291 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba09502-a130-4487-b1be-e7808cdbe1be None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:05.519794 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb7029-d909-4de2-84f7-1d27815f6a5f None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:05.536508 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:05.551721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba09502-a130-4487-b1be-e7808cdbe1be None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:05.553866 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ddca5-5286-45e6-8e0a-7b92f7fc599a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:05.554483 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ddca5-5286-45e6-8e0a-7b92f7fc599a None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:05.554756 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ddca5-5286-45e6-8e0a-7b92f7fc599a None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:05.555019 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ddca5-5286-45e6-8e0a-7b92f7fc599a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:05.566626 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ddca5-5286-45e6-8e0a-7b92f7fc599a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:05.568069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ddca5-5286-45e6-8e0a-7b92f7fc599a None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:05.582880 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-e18ddca5-5286-45e6-8e0a-7b92f7fc599a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:05.582880 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:05.582880 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:05.582880 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:05.582880 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:05.582880 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:05.582880 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:05.582880 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:05.582880 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:05.582880 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:05.582880 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:05.582880 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:05.582880 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:05.582880 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:05.582880 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:05.582880 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:05.584211 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:05.584211 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:05.584211 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:05.584211 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:05.584211 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:05.584211 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:05.584211 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:05.584211 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:05.584211 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:05.584211 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:05.584211 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:05.584211 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:05.584211 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:05.584211 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:05.584211 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:05.584211 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:05.584211 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:05.585056 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:05.585056 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:05.585056 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:05.585056 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 251/506] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:05.585275 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ddca5-5286-45e6-8e0a-7b92f7fc599a None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:05.588631 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b601a-e574-4c0c-874a-20a58f9089cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:05.589369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b601a-e574-4c0c-874a-20a58f9089cc None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:05.589646 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b601a-e574-4c0c-874a-20a58f9089cc None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:05.589910 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b601a-e574-4c0c-874a-20a58f9089cc None admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:05.590639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b601a-e574-4c0c-874a-20a58f9089cc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:05.590935 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b601a-e574-4c0c-874a-20a58f9089cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:05.592351 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b601a-e574-4c0c-874a-20a58f9089cc None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:05.601260 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:05.610397 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 256/507] 10.222.0.27 () {56 vars in 1137 bytes} [Sun Aug 7 10:42:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:05.612131 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b601a-e574-4c0c-874a-20a58f9089cc None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:05.687575 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ddca5-5286-45e6-8e0a-7b92f7fc599a None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:05.712536 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b601a-e574-4c0c-874a-20a58f9089cc None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:05.722338 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a5d5d-e54b-4ec5-8c54-148a9afe8082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:05.722958 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a5d5d-e54b-4ec5-8c54-148a9afe8082 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:05.723262 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a5d5d-e54b-4ec5-8c54-148a9afe8082 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:05.723535 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a5d5d-e54b-4ec5-8c54-148a9afe8082 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:05.733805 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a5d5d-e54b-4ec5-8c54-148a9afe8082 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:05.735274 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a5d5d-e54b-4ec5-8c54-148a9afe8082 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:05.745902 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c494ef8-3a56-4116-9c50-ae0b13824e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:05.746513 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c494ef8-3a56-4116-9c50-ae0b13824e72 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:05.746785 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c494ef8-3a56-4116-9c50-ae0b13824e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:05.747052 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c494ef8-3a56-4116-9c50-ae0b13824e72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:05.749539 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-8e5a5d5d-e54b-4ec5-8c54-148a9afe8082 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:05.749539 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:05.749539 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:05.749539 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:05.749539 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:05.749539 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:05.749539 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:05.749539 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:05.749539 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:05.749539 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:05.749539 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:05.749539 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:05.749539 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:05.749539 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:05.749539 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:05.749539 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:05.750487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:05.750487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:05.750487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:05.750487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:05.750487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:05.750487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:05.750487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:05.750487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:05.750487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:05.750487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:05.750487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:05.750487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:05.750487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:05.750487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:05.750487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:05.750487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:05.750487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:05.751384 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:05.751384 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:05.751384 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:05.751384 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 252/508] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:05.751609 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a5d5d-e54b-4ec5-8c54-148a9afe8082 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:05.759136 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c494ef8-3a56-4116-9c50-ae0b13824e72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:05.760581 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c494ef8-3a56-4116-9c50-ae0b13824e72 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:05.775593 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-2c494ef8-3a56-4116-9c50-ae0b13824e72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:05.775593 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:05.775593 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:05.775593 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:05.775593 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:05.775593 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:05.775593 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:05.775593 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:05.775593 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:05.775593 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:05.775593 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:05.775593 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:05.775593 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:05.775593 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:05.775593 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:05.775593 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:05.776514 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:05.776514 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:05.776514 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:05.776514 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:05.776514 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:05.776514 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:05.776514 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:05.776514 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:05.776514 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:05.776514 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:05.776514 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:05.776514 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:05.776514 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:05.776514 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:05.776514 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:05.776514 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:05.776514 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:05.777388 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:05.777388 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:05.777388 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:05.777388 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 257/509] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:05.777388 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c494ef8-3a56-4116-9c50-ae0b13824e72 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:05.778037 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:05.826754 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:05.859304 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a5d5d-e54b-4ec5-8c54-148a9afe8082 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:05.877536 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c494ef8-3a56-4116-9c50-ae0b13824e72 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:05.893246 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4806a-a3f1-449b-a8db-a611d6b0c5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:05.893874 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4806a-a3f1-449b-a8db-a611d6b0c5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:05.894145 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4806a-a3f1-449b-a8db-a611d6b0c5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:05.894410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4806a-a3f1-449b-a8db-a611d6b0c5d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:05.910411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765363c5-a462-48c4-b50e-9ffbd6796c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:05.911010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765363c5-a462-48c4-b50e-9ffbd6796c6d None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:05.911285 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765363c5-a462-48c4-b50e-9ffbd6796c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:05.911555 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765363c5-a462-48c4-b50e-9ffbd6796c6d None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:05.912195 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765363c5-a462-48c4-b50e-9ffbd6796c6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:05.912492 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765363c5-a462-48c4-b50e-9ffbd6796c6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:05.913883 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765363c5-a462-48c4-b50e-9ffbd6796c6d None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:05.926449 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 258/510] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:05.927271 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765363c5-a462-48c4-b50e-9ffbd6796c6d None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:05.963615 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4806a-a3f1-449b-a8db-a611d6b0c5d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:05.965203 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4806a-a3f1-449b-a8db-a611d6b0c5d5 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:05.988112 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:06.024238 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765363c5-a462-48c4-b50e-9ffbd6796c6d None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:06.035102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:06.058154 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ddf87-2b01-4f24-8208-127c9a3f42db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:06.058747 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ddf87-2b01-4f24-8208-127c9a3f42db None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:06.059019 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ddf87-2b01-4f24-8208-127c9a3f42db None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:06.059290 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ddf87-2b01-4f24-8208-127c9a3f42db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:06.061939 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 253/511] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:42:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:42:06.062771 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4806a-a3f1-449b-a8db-a611d6b0c5d5 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:06.127072 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ddf87-2b01-4f24-8208-127c9a3f42db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:06.128507 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ddf87-2b01-4f24-8208-127c9a3f42db None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:06.159036 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4806a-a3f1-449b-a8db-a611d6b0c5d5 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:06.180851 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:06.193173 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630edd4-5f0a-4d6c-b58e-4980f17c3dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:06.193793 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630edd4-5f0a-4d6c-b58e-4980f17c3dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:06.194070 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630edd4-5f0a-4d6c-b58e-4980f17c3dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:06.194340 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630edd4-5f0a-4d6c-b58e-4980f17c3dc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:06.194980 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630edd4-5f0a-4d6c-b58e-4980f17c3dc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:06.195278 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630edd4-5f0a-4d6c-b58e-4980f17c3dc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:06.196627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630edd4-5f0a-4d6c-b58e-4980f17c3dc8 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:06.208004 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 254/512] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:06.208788 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630edd4-5f0a-4d6c-b58e-4980f17c3dc8 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:06.226214 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 259/513] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:42:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:42:06.226878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ddf87-2b01-4f24-8208-127c9a3f42db None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:06.237771 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:06.311027 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630edd4-5f0a-4d6c-b58e-4980f17c3dc8 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:06.326085 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ddf87-2b01-4f24-8208-127c9a3f42db None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:06.343717 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a685a-5e55-4b7c-ae36-f1678f465d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:06.344316 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a685a-5e55-4b7c-ae36-f1678f465d38 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:06.344590 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a685a-5e55-4b7c-ae36-f1678f465d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:06.344856 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a685a-5e55-4b7c-ae36-f1678f465d38 None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:06.345560 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a685a-5e55-4b7c-ae36-f1678f465d38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:06.345858 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a685a-5e55-4b7c-ae36-f1678f465d38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:06.347453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a685a-5e55-4b7c-ae36-f1678f465d38 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:06.358687 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 255/514] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:06.359474 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a685a-5e55-4b7c-ae36-f1678f465d38 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:06.362598 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac071601-0bb3-4c89-9c9d-ee00d3cbd689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:06.363218 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac071601-0bb3-4c89-9c9d-ee00d3cbd689 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:06.363537 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac071601-0bb3-4c89-9c9d-ee00d3cbd689 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:06.363817 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac071601-0bb3-4c89-9c9d-ee00d3cbd689 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:06.371073 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac071601-0bb3-4c89-9c9d-ee00d3cbd689 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:06.372493 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac071601-0bb3-4c89-9c9d-ee00d3cbd689 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:06.383657 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-ac071601-0bb3-4c89-9c9d-ee00d3cbd689 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 07 10:42:06.383657 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:06.383657 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:06.383657 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:06.383657 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:06.383657 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:06.383657 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:06.383657 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:06.383657 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:06.383657 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:06.383657 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:06.383657 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:06.383657 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:42:06.383657 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:42:06.383657 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:42:06.383657 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:42:06.384706 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:06.384706 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:06.384706 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:42:06.384706 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:06.384706 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:42:06.384706 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:06.384706 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:06.384706 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:06.384706 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:06.384706 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:06.384706 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:06.384706 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:06.384706 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:06.384706 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:06.384706 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:06.384706 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:06.384706 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:06.384706 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:06.385670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:06.385670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:06.385670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:42:06.385670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:42:06.385670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:42:06.385670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:42:06.385670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:42:06.385670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:42:06.385670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 07 10:42:06.385670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:06.385670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 260/515] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:42:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:06.385670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac071601-0bb3-4c89-9c9d-ee00d3cbd689 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:06.411886 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:06.462419 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:06.468025 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a685a-5e55-4b7c-ae36-f1678f465d38 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:06.493798 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac071601-0bb3-4c89-9c9d-ee00d3cbd689 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:06.502128 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49f95c-bac4-4394-a40b-b7e0b07b1ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:06.502754 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49f95c-bac4-4394-a40b-b7e0b07b1ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:06.503037 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49f95c-bac4-4394-a40b-b7e0b07b1ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:06.503305 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49f95c-bac4-4394-a40b-b7e0b07b1ba3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:06.513087 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49f95c-bac4-4394-a40b-b7e0b07b1ba3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:06.514636 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49f95c-bac4-4394-a40b-b7e0b07b1ba3 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:06.527504 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a48ab8-7b0a-448c-b896-1c96d4846876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:06.528112 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a48ab8-7b0a-448c-b896-1c96d4846876 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:06.528394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a48ab8-7b0a-448c-b896-1c96d4846876 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:06.528658 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a48ab8-7b0a-448c-b896-1c96d4846876 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:06.529274 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-0f49f95c-bac4-4394-a40b-b7e0b07b1ba3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:06.529274 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:06.529274 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:06.529274 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:06.529274 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:06.529274 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:06.529274 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:06.529274 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:06.529274 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:06.529274 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:06.529274 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:06.529274 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:06.529274 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:06.529274 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:06.529274 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:06.529274 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:06.530394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:06.530394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:06.530394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:06.530394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:06.530394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:06.530394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:06.530394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:06.530394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:06.530394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:06.530394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:06.530394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:06.530394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:06.530394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:06.530394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:06.530394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:06.530394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:06.530394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:06.531250 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:06.531250 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:06.531250 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:06.531250 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 256/516] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:06.531250 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49f95c-bac4-4394-a40b-b7e0b07b1ba3 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:06.541874 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a48ab8-7b0a-448c-b896-1c96d4846876 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:06.543296 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a48ab8-7b0a-448c-b896-1c96d4846876 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:06.554088 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-00a48ab8-7b0a-448c-b896-1c96d4846876 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 10:42:06.554088 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:06.554088 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:06.554088 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:06.554088 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:06.554088 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:06.554088 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:06.554088 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:06.554088 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:06.554088 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:06.554088 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:06.554088 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:06.554088 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:42:06.554088 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:42:06.554088 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:42:06.554088 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:42:06.554953 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:06.554953 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:06.554953 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:42:06.554953 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:06.554953 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:42:06.554953 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:06.554953 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:06.554953 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:06.554953 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:06.554953 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:06.554953 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:06.554953 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:06.554953 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:06.554953 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:06.554953 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:06.554953 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:06.554953 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:06.554953 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:06.555854 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:06.555854 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:06.555854 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:42:06.555854 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:42:06.555854 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:42:06.555854 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:42:06.555854 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:42:06.555854 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:42:06.555854 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 10:42:06.555854 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:06.555854 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 261/517] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 7 10:42:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:06.556733 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a48ab8-7b0a-448c-b896-1c96d4846876 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:06.628820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:06.635751 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49f95c-bac4-4394-a40b-b7e0b07b1ba3 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:06.655094 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a48ab8-7b0a-448c-b896-1c96d4846876 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:06.668406 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723dea1-a6fc-4eb7-9a9e-377e1c573669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:06.669024 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723dea1-a6fc-4eb7-9a9e-377e1c573669 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:06.669297 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723dea1-a6fc-4eb7-9a9e-377e1c573669 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:06.669597 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723dea1-a6fc-4eb7-9a9e-377e1c573669 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:06.679848 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723dea1-a6fc-4eb7-9a9e-377e1c573669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:06.681524 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723dea1-a6fc-4eb7-9a9e-377e1c573669 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:06.682714 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:06.690623 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e2acf-f6d3-4fdd-ab13-8aa0cd3d0570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:06.691213 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e2acf-f6d3-4fdd-ab13-8aa0cd3d0570 None admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:06.691485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e2acf-f6d3-4fdd-ab13-8aa0cd3d0570 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:06.691756 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e2acf-f6d3-4fdd-ab13-8aa0cd3d0570 None admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:06.692387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e2acf-f6d3-4fdd-ab13-8aa0cd3d0570 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:06.693831 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e2acf-f6d3-4fdd-ab13-8aa0cd3d0570 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:06.696423 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-d723dea1-a6fc-4eb7-9a9e-377e1c573669 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:06.696423 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:06.696423 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:06.696423 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:06.696423 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:06.696423 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:06.696423 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:06.696423 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:06.696423 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:06.696423 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:06.696423 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:06.696423 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:06.696423 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:06.696423 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:06.696423 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:06.696423 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:06.697461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:06.697461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:06.697461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:06.697461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:06.697461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:06.697461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:06.697461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:06.697461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:06.697461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:06.697461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:06.697461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:06.697461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:06.697461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:06.697461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:06.697461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:06.697461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:06.697461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:06.698310 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:06.698310 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:06.698310 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:06.698310 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 257/518] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:06.698794 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723dea1-a6fc-4eb7-9a9e-377e1c573669 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:06.714237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 262/519] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 7 10:42:06 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:42:06.715079 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e2acf-f6d3-4fdd-ab13-8aa0cd3d0570 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:06.819735 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723dea1-a6fc-4eb7-9a9e-377e1c573669 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:06.842212 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e2acf-f6d3-4fdd-ab13-8aa0cd3d0570 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:06.860318 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e71b0-e1e7-46f8-b3d2-ab7aa731271b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:06.861518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e71b0-e1e7-46f8-b3d2-ab7aa731271b None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:06.861848 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e71b0-e1e7-46f8-b3d2-ab7aa731271b None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:06.862107 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e71b0-e1e7-46f8-b3d2-ab7aa731271b None admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:06.862991 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e71b0-e1e7-46f8-b3d2-ab7aa731271b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:06.863290 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e71b0-e1e7-46f8-b3d2-ab7aa731271b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:06.864728 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e71b0-e1e7-46f8-b3d2-ab7aa731271b None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:06.888377 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c1728-de01-4c59-877f-2f22b8a93208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:06.889193 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c1728-de01-4c59-877f-2f22b8a93208 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:06.890029 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c1728-de01-4c59-877f-2f22b8a93208 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:06.890029 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c1728-de01-4c59-877f-2f22b8a93208 None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:06.890382 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c1728-de01-4c59-877f-2f22b8a93208 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:06.890675 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c1728-de01-4c59-877f-2f22b8a93208 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:06.892534 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c1728-de01-4c59-877f-2f22b8a93208 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:06.903503 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 258/520] 10.222.0.27 () {56 vars in 1137 bytes} [Sun Aug 7 10:42:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:06.904342 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e71b0-e1e7-46f8-b3d2-ab7aa731271b None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:06.906902 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 263/521] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:06.907879 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c1728-de01-4c59-877f-2f22b8a93208 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:06.909851 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:06.960155 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:07.013544 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e71b0-e1e7-46f8-b3d2-ab7aa731271b None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:07.023082 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c1728-de01-4c59-877f-2f22b8a93208 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:07.050131 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9322c-d72f-4d93-a816-59fe37eb6631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:07.050738 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9322c-d72f-4d93-a816-59fe37eb6631 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:07.051017 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9322c-d72f-4d93-a816-59fe37eb6631 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:07.051291 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9322c-d72f-4d93-a816-59fe37eb6631 None admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:07.052023 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9322c-d72f-4d93-a816-59fe37eb6631 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:07.052328 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9322c-d72f-4d93-a816-59fe37eb6631 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:07.053844 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9322c-d72f-4d93-a816-59fe37eb6631 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:07.059435 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e90dda-3c98-4886-98de-2e656266ccef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:07.060027 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e90dda-3c98-4886-98de-2e656266ccef None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:07.060289 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e90dda-3c98-4886-98de-2e656266ccef None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:07.060548 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e90dda-3c98-4886-98de-2e656266ccef None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:07.061175 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e90dda-3c98-4886-98de-2e656266ccef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:07.061497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e90dda-3c98-4886-98de-2e656266ccef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:07.062843 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e90dda-3c98-4886-98de-2e656266ccef None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:07.072374 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 259/522] 10.222.0.27 () {56 vars in 1139 bytes} [Sun Aug 7 10:42:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:07.073552 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9322c-d72f-4d93-a816-59fe37eb6631 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:07.079389 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 264/523] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:07.080412 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e90dda-3c98-4886-98de-2e656266ccef None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:07.140352 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:07.183079 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9322c-d72f-4d93-a816-59fe37eb6631 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:07.188272 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e90dda-3c98-4886-98de-2e656266ccef None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:07.196835 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:07.222487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84edb3d1-3ee2-421d-a10c-a9c0665f232f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:07.223085 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edb3d1-3ee2-421d-a10c-a9c0665f232f None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:07.223358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edb3d1-3ee2-421d-a10c-a9c0665f232f None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:07.223623 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edb3d1-3ee2-421d-a10c-a9c0665f232f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:07.226101 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651974e-77ff-4432-9ae8-67b3c001ed6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:07.226882 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651974e-77ff-4432-9ae8-67b3c001ed6d None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:07.227973 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651974e-77ff-4432-9ae8-67b3c001ed6d None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:07.228256 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651974e-77ff-4432-9ae8-67b3c001ed6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:07.235465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7651974e-77ff-4432-9ae8-67b3c001ed6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:07.238153 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7651974e-77ff-4432-9ae8-67b3c001ed6d None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:07.250024 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-7651974e-77ff-4432-9ae8-67b3c001ed6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:07.250024 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:07.250024 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:07.250024 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:07.250024 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:07.250024 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:07.250024 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:07.250024 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:07.250024 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:07.250024 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:07.250024 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:07.250024 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:07.250024 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:42:07.250024 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:42:07.250024 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:42:07.251207 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:42:07.251207 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:07.251207 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:07.251207 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:07.251207 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:07.251207 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:07.251207 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:07.251207 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:07.251207 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:07.251207 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:07.251207 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:07.251207 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:07.251207 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:07.251207 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:07.251207 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:07.251207 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:07.251207 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:07.252296 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:42:07.252296 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:42:07.252296 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:42:07.252296 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:42:07.252296 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:42:07.252296 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:42:07.252296 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:07.252296 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:07.256019 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 265/524] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:07.256704 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651974e-77ff-4432-9ae8-67b3c001ed6d None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:07.299831 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84edb3d1-3ee2-421d-a10c-a9c0665f232f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:07.301418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84edb3d1-3ee2-421d-a10c-a9c0665f232f None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:07.366636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651974e-77ff-4432-9ae8-67b3c001ed6d None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:07.371339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:07.404468 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897b747-a886-4464-9a7c-52b9d862b3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:07.404993 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897b747-a886-4464-9a7c-52b9d862b3dc None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:07.405270 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897b747-a886-4464-9a7c-52b9d862b3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:07.405578 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897b747-a886-4464-9a7c-52b9d862b3dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:07.416046 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 260/525] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:42:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:42:07.417592 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84edb3d1-3ee2-421d-a10c-a9c0665f232f None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:07.441746 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:07.478722 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a897b747-a886-4464-9a7c-52b9d862b3dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:07.480169 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a897b747-a886-4464-9a7c-52b9d862b3dc None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:07.526498 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84edb3d1-3ee2-421d-a10c-a9c0665f232f None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:07.559836 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee1d70-7a46-419b-b5aa-c40428626ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:07.560455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee1d70-7a46-419b-b5aa-c40428626ecc None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:07.560730 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee1d70-7a46-419b-b5aa-c40428626ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:07.560997 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee1d70-7a46-419b-b5aa-c40428626ecc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:07.568355 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee1d70-7a46-419b-b5aa-c40428626ecc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:07.569982 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee1d70-7a46-419b-b5aa-c40428626ecc None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:07.581577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-e9ee1d70-7a46-419b-b5aa-c40428626ecc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:07.581577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:07.581577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:07.581577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:07.581577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:07.581577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:07.581577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:07.581577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:07.581577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:07.581577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:07.581577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:07.581577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:07.581577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:42:07.581577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:42:07.581577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:42:07.582467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:42:07.582467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:07.582467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:07.582467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:07.582467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:07.582467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:07.582467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:07.582467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:07.582467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:07.582467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:07.582467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:07.582467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:07.582467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:07.582467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:07.582467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:07.582467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:07.582467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:07.583301 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:42:07.583301 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:42:07.583301 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:42:07.583301 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:42:07.583301 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:42:07.583301 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:42:07.583301 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:07.583301 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:07.583301 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 261/526] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:07.583794 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee1d70-7a46-419b-b5aa-c40428626ecc None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:07.591750 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 266/527] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:42:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:42:07.592452 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897b747-a886-4464-9a7c-52b9d862b3dc None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:07.613488 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:07.659886 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:07.698977 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897b747-a886-4464-9a7c-52b9d862b3dc None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:07.699144 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee1d70-7a46-419b-b5aa-c40428626ecc None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:07.734459 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c5568-bdf4-43b7-ad96-9839f8984103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:07.735062 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c5568-bdf4-43b7-ad96-9839f8984103 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:07.735339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c5568-bdf4-43b7-ad96-9839f8984103 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:07.736151 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c5568-bdf4-43b7-ad96-9839f8984103 None admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:07.736442 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534f91f-fa55-45fb-8e56-c8c340a12fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:07.736844 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c5568-bdf4-43b7-ad96-9839f8984103 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:07.737050 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534f91f-fa55-45fb-8e56-c8c340a12fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:07.737154 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c5568-bdf4-43b7-ad96-9839f8984103 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:07.737348 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534f91f-fa55-45fb-8e56-c8c340a12fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:07.737608 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534f91f-fa55-45fb-8e56-c8c340a12fb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:07.738658 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897c5568-bdf4-43b7-ad96-9839f8984103 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:07.748335 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534f91f-fa55-45fb-8e56-c8c340a12fb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:07.750226 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534f91f-fa55-45fb-8e56-c8c340a12fb5 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:07.761071 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 262/528] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:42:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:07.762193 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c5568-bdf4-43b7-ad96-9839f8984103 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:07.764985 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-b534f91f-fa55-45fb-8e56-c8c340a12fb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:07.764985 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:07.764985 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:07.764985 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:07.764985 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:07.764985 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:07.764985 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:07.764985 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:07.764985 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:07.764985 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:07.764985 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:07.764985 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:07.764985 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:07.764985 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:07.764985 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:07.764985 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:07.766142 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:07.766142 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:07.766142 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:07.766142 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:07.766142 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:07.766142 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:07.766142 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:07.766142 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:07.766142 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:07.766142 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:07.766142 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:07.766142 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:07.766142 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:07.766142 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:07.766142 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:07.766142 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:07.766142 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:07.768075 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:07.768075 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:07.768075 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:07.768075 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 267/529] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:07.771763 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534f91f-fa55-45fb-8e56-c8c340a12fb5 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:07.852517 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:07.873803 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c5568-bdf4-43b7-ad96-9839f8984103 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:07.879199 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534f91f-fa55-45fb-8e56-c8c340a12fb5 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:07.900745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:07.912164 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ab659-2f9e-4123-9dad-30c78490c202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:07.912779 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ab659-2f9e-4123-9dad-30c78490c202 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:07.913065 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ab659-2f9e-4123-9dad-30c78490c202 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:07.913369 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ab659-2f9e-4123-9dad-30c78490c202 None admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:07.914086 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ab659-2f9e-4123-9dad-30c78490c202 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:07.914373 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ab659-2f9e-4123-9dad-30c78490c202 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:07.915880 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ab659-2f9e-4123-9dad-30c78490c202 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:07.915973 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1b84a-ddfc-4391-824a-b2e6c63905c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:07.916669 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1b84a-ddfc-4391-824a-b2e6c63905c6 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:07.917014 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1b84a-ddfc-4391-824a-b2e6c63905c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:07.917385 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1b84a-ddfc-4391-824a-b2e6c63905c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:07.928524 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 263/530] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:42:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:07.929587 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ab659-2f9e-4123-9dad-30c78490c202 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:07.934407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1b84a-ddfc-4391-824a-b2e6c63905c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:07.935942 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1b84a-ddfc-4391-824a-b2e6c63905c6 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:07.950512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-99b1b84a-ddfc-4391-824a-b2e6c63905c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:07.950512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:07.950512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:07.950512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:07.950512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:07.950512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:07.950512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:07.950512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:07.950512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:07.950512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:07.950512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:07.950512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:07.950512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:07.950512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:07.950512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:07.950512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:07.951608 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:07.951608 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:07.951608 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:07.951608 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:07.951608 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:07.951608 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:07.951608 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:07.951608 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:07.951608 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:07.951608 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:07.951608 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:07.951608 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:07.951608 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:07.951608 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:07.951608 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:07.951608 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:07.951608 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:07.952473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:07.952473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:07.952473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:07.952473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 268/531] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:07.952473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1b84a-ddfc-4391-824a-b2e6c63905c6 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:08.041727 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ab659-2f9e-4123-9dad-30c78490c202 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:08.061834 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1b84a-ddfc-4391-824a-b2e6c63905c6 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:08.078807 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0f659-6d85-4a8e-a996-918c8c689995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:08.079635 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0f659-6d85-4a8e-a996-918c8c689995 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:08.079912 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0f659-6d85-4a8e-a996-918c8c689995 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:08.080179 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0f659-6d85-4a8e-a996-918c8c689995 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:08.080902 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0f659-6d85-4a8e-a996-918c8c689995 None admin] RBAC: Adding query filter params (role.id=bf9e51dafeac420f89a66e78e1463982, scope.project.id=62eed8550ae3403f8a75894dbd19cf4a, user.id=f98cb7abbb8942cebb71aa98da80a05a) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:08.081206 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0f659-6d85-4a8e-a996-918c8c689995 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:08.082699 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0f659-6d85-4a8e-a996-918c8c689995 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:08.101348 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 264/532] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:42:07 2022] GET /identity/v3/role_assignments?user.id=f98cb7abbb8942cebb71aa98da80a05a&scope.project.id=62eed8550ae3403f8a75894dbd19cf4a&role.id=bf9e51dafeac420f89a66e78e1463982 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:08.101348 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0f659-6d85-4a8e-a996-918c8c689995 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:08.108371 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ef502-00be-47e1-9eb2-42c8601f8875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:08.109731 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:08.110161 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ef502-00be-47e1-9eb2-42c8601f8875 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:08.110462 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ef502-00be-47e1-9eb2-42c8601f8875 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:08.110834 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ef502-00be-47e1-9eb2-42c8601f8875 None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:08.111490 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ef502-00be-47e1-9eb2-42c8601f8875 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:08.111873 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ef502-00be-47e1-9eb2-42c8601f8875 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:08.113607 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ef502-00be-47e1-9eb2-42c8601f8875 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:08.132720 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 269/533] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:08.132720 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ef502-00be-47e1-9eb2-42c8601f8875 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:08.163990 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:08.248767 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0f659-6d85-4a8e-a996-918c8c689995 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:08.252921 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ef502-00be-47e1-9eb2-42c8601f8875 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:08.288297 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf9865-81a9-47be-98a3-9ef8c7b00009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:08.288900 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf9865-81a9-47be-98a3-9ef8c7b00009 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:08.289172 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf9865-81a9-47be-98a3-9ef8c7b00009 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:08.289489 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf9865-81a9-47be-98a3-9ef8c7b00009 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:08.290216 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf9865-81a9-47be-98a3-9ef8c7b00009 None admin] RBAC: Adding query filter params (role.id=bf9e51dafeac420f89a66e78e1463982, scope.project.id=62eed8550ae3403f8a75894dbd19cf4a, user.id=c5fca18c4ee74043a5acc9aeb297c9c7) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:08.290520 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf9865-81a9-47be-98a3-9ef8c7b00009 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:08.292063 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf9865-81a9-47be-98a3-9ef8c7b00009 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:08.298534 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84edcef-f96b-4d4a-bffc-17ea6df9edee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:08.299376 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84edcef-f96b-4d4a-bffc-17ea6df9edee None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:08.299833 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84edcef-f96b-4d4a-bffc-17ea6df9edee None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:08.300343 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84edcef-f96b-4d4a-bffc-17ea6df9edee None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:08.301180 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84edcef-f96b-4d4a-bffc-17ea6df9edee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:08.301709 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84edcef-f96b-4d4a-bffc-17ea6df9edee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:08.303295 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84edcef-f96b-4d4a-bffc-17ea6df9edee None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:08.305222 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 265/534] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:42:08 2022] GET /identity/v3/role_assignments?user.id=c5fca18c4ee74043a5acc9aeb297c9c7&scope.project.id=62eed8550ae3403f8a75894dbd19cf4a&role.id=bf9e51dafeac420f89a66e78e1463982 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:08.306259 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf9865-81a9-47be-98a3-9ef8c7b00009 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:08.319196 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 270/535] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:08.328173 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84edcef-f96b-4d4a-bffc-17ea6df9edee None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:08.406690 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:08.443145 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf9865-81a9-47be-98a3-9ef8c7b00009 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:08.482457 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f76d2-5e45-4704-ad89-3831e8171b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:08.483399 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f76d2-5e45-4704-ad89-3831e8171b49 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:08.483924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f76d2-5e45-4704-ad89-3831e8171b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:08.484362 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f76d2-5e45-4704-ad89-3831e8171b49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:08.492975 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f76d2-5e45-4704-ad89-3831e8171b49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:08.495010 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f76d2-5e45-4704-ad89-3831e8171b49 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:08.507800 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-8e2f76d2-5e45-4704-ad89-3831e8171b49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:08.507800 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:08.507800 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:08.507800 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:08.507800 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:08.507800 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:08.507800 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:08.507800 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:08.507800 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:08.507800 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:08.507800 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:08.507800 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:08.507800 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:42:08.507800 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:42:08.507800 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:42:08.508719 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:42:08.508719 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:08.508719 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:08.508719 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:08.508719 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:08.508719 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:08.508719 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:08.508719 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:08.508719 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:08.508719 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:08.508719 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:08.508719 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:08.508719 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:08.508719 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:08.508719 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:08.508719 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:08.508719 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:08.509593 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:42:08.509593 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:42:08.509593 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:42:08.509593 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:42:08.509593 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:42:08.509593 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:42:08.509593 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:08.509593 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:08.512114 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 266/536] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:08.518070 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f76d2-5e45-4704-ad89-3831e8171b49 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:08.560291 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:08.577427 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84edcef-f96b-4d4a-bffc-17ea6df9edee None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:08.644471 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c9d96-f9d2-4014-98ca-c78666073a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:08.645452 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c9d96-f9d2-4014-98ca-c78666073a47 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:08.645929 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c9d96-f9d2-4014-98ca-c78666073a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:08.646363 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c9d96-f9d2-4014-98ca-c78666073a47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:08.659636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c9d96-f9d2-4014-98ca-c78666073a47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:08.661348 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c9d96-f9d2-4014-98ca-c78666073a47 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:08.683729 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-c27c9d96-f9d2-4014-98ca-c78666073a47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:08.683729 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:08.683729 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:08.683729 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:08.683729 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:08.683729 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:08.683729 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:08.683729 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:08.683729 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:08.683729 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:08.683729 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:08.683729 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:08.683729 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:42:08.683729 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:42:08.683729 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:42:08.684640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:42:08.684640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:08.684640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:08.684640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:08.684640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:08.684640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:08.684640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:08.684640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:08.684640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:08.684640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:08.684640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:08.684640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:08.684640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:08.684640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:08.684640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:08.684640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:08.684640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:08.685505 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:42:08.685505 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:42:08.685505 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:42:08.685505 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:42:08.685505 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:42:08.685505 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:42:08.685505 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:08.685505 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:08.698926 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 271/537] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:08.706800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c9d96-f9d2-4014-98ca-c78666073a47 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:08.719425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f76d2-5e45-4704-ad89-3831e8171b49 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:08.777056 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:08.787324 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541943c-659a-4195-98d3-46b1e9dac929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:08.788142 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541943c-659a-4195-98d3-46b1e9dac929 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:08.788557 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541943c-659a-4195-98d3-46b1e9dac929 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:08.788985 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541943c-659a-4195-98d3-46b1e9dac929 None admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:08.789865 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541943c-659a-4195-98d3-46b1e9dac929 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:08.790162 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541943c-659a-4195-98d3-46b1e9dac929 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:08.791595 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541943c-659a-4195-98d3-46b1e9dac929 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:08.806856 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 267/538] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:42:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:08.813365 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e6a0e-87ab-4ef1-a02a-4b81232fcc34 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:08.813365 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e6a0e-87ab-4ef1-a02a-4b81232fcc34 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:08.813365 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e6a0e-87ab-4ef1-a02a-4b81232fcc34 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:08.813365 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 268/539] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:08.813365 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e6a0e-87ab-4ef1-a02a-4b81232fcc34 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:08.869130 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c9d96-f9d2-4014-98ca-c78666073a47 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:08.910529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb124c-3e12-407c-90b9-ebf1c2a720bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:08.911475 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb124c-3e12-407c-90b9-ebf1c2a720bd None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:08.911952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb124c-3e12-407c-90b9-ebf1c2a720bd None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:08.912534 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb124c-3e12-407c-90b9-ebf1c2a720bd None admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:08.913581 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb124c-3e12-407c-90b9-ebf1c2a720bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:08.914083 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb124c-3e12-407c-90b9-ebf1c2a720bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:08.915706 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb124c-3e12-407c-90b9-ebf1c2a720bd None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:08.930244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e6a0e-87ab-4ef1-a02a-4b81232fcc34 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:08.935748 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 272/540] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:42:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:08.937342 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf38418-99bf-45b6-8723-771915fbc6db None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:08.937931 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf38418-99bf-45b6-8723-771915fbc6db None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:08.938402 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf38418-99bf-45b6-8723-771915fbc6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:08.957924 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-faf38418-99bf-45b6-8723-771915fbc6db None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:08.959586 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-faf38418-99bf-45b6-8723-771915fbc6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:08.963311 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:08.969026 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113829f-3450-48de-8b0c-f164e795680e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:08.969709 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113829f-3450-48de-8b0c-f164e795680e None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:08.970501 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113829f-3450-48de-8b0c-f164e795680e None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:08.970861 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113829f-3450-48de-8b0c-f164e795680e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:08.971631 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113829f-3450-48de-8b0c-f164e795680e None admin] RBAC: Adding query filter params (role.id=bf9e51dafeac420f89a66e78e1463982, scope.project.id=62eed8550ae3403f8a75894dbd19cf4a, user.id=a462a891b30847c0aeadbd697652011a) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:08.972320 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113829f-3450-48de-8b0c-f164e795680e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:08.973581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113829f-3450-48de-8b0c-f164e795680e None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:08.984177 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 269/541] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:42:08 2022] GET /identity/v3/role_assignments?user.id=a462a891b30847c0aeadbd697652011a&scope.project.id=62eed8550ae3403f8a75894dbd19cf4a&role.id=bf9e51dafeac420f89a66e78e1463982 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:08.984177 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113829f-3450-48de-8b0c-f164e795680e None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:09.042152 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:09.085749 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 273/542] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:42:09.090926 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113829f-3450-48de-8b0c-f164e795680e None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:09.129969 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4717a-1a56-4403-8e87-81062ac3fd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:09.130579 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4717a-1a56-4403-8e87-81062ac3fd27 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:09.130849 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4717a-1a56-4403-8e87-81062ac3fd27 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:09.131079 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf38418-99bf-45b6-8723-771915fbc6db None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:09.131180 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4717a-1a56-4403-8e87-81062ac3fd27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:09.131834 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4717a-1a56-4403-8e87-81062ac3fd27 None admin] RBAC: Adding query filter params (role.id=bf9e51dafeac420f89a66e78e1463982, scope.project.id=62eed8550ae3403f8a75894dbd19cf4a, user.id=9b03428b48264b9da9800283496de2e4) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:09.132156 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4717a-1a56-4403-8e87-81062ac3fd27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:09.133597 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4717a-1a56-4403-8e87-81062ac3fd27 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:09.141353 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 270/543] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:42:08 2022] GET /identity/v3/role_assignments?user.id=9b03428b48264b9da9800283496de2e4&scope.project.id=62eed8550ae3403f8a75894dbd19cf4a&role.id=bf9e51dafeac420f89a66e78e1463982 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:09.270465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf38418-99bf-45b6-8723-771915fbc6db None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:09.316570 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e14b6-00e5-460b-ade4-421b5d86be53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:09.317225 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e14b6-00e5-460b-ade4-421b5d86be53 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:09.317530 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e14b6-00e5-460b-ade4-421b5d86be53 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:09.317800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e14b6-00e5-460b-ade4-421b5d86be53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:09.337354 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:09.338532 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e14b6-00e5-460b-ade4-421b5d86be53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:42:09.346405 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-038e14b6-00e5-460b-ade4-421b5d86be53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:09.346405 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:09.346405 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:09.346405 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:09.346405 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:09.346405 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:09.346405 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:09.346405 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:09.346405 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:09.346405 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:09.346405 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:09.346405 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:09.346405 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:42:09.346405 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:42:09.346405 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:42:09.346405 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:42:09.347369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:42:09.347369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:42:09.347369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:42:09.347369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:42:09.347369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:09.347369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:09.347369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:09.347369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:09.347369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:09.347369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:09.347369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:09.347369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:09.347369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:09.347369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:09.347369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:09.347369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:09.348167 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:09.348167 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:09.348167 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:09.348167 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:09.348167 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:42:09.348167 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:42:09.348167 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:42:09.348167 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:42:09.348167 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:42:09.348167 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:42:09.348167 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:09.348167 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:09.348167 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 274/544] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 7 10:42:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:42:09.358543 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4717a-1a56-4403-8e87-81062ac3fd27 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:09.490023 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4717a-1a56-4403-8e87-81062ac3fd27 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:09.513682 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:09.525067 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e5aa6-9002-46be-bb72-010d2b1256c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:09.525975 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e5aa6-9002-46be-bb72-010d2b1256c4 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:09.526518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e5aa6-9002-46be-bb72-010d2b1256c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:09.526977 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e5aa6-9002-46be-bb72-010d2b1256c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:09.527841 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e5aa6-9002-46be-bb72-010d2b1256c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:09.528356 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e5aa6-9002-46be-bb72-010d2b1256c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:09.529943 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e5aa6-9002-46be-bb72-010d2b1256c4 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:09.544511 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e14b6-00e5-460b-ade4-421b5d86be53 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:09.545084 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 271/545] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 7 10:42:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:09.699389 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e14b6-00e5-460b-ade4-421b5d86be53 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:09.740778 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a97f0-64d4-4478-856b-676fdb2cac42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:09.741432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a97f0-64d4-4478-856b-676fdb2cac42 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:09.741710 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a97f0-64d4-4478-856b-676fdb2cac42 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:09.741975 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a97f0-64d4-4478-856b-676fdb2cac42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:09.753514 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a97f0-64d4-4478-856b-676fdb2cac42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:09.754944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a97f0-64d4-4478-856b-676fdb2cac42 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:09.776363 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-a14a97f0-64d4-4478-856b-676fdb2cac42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:09.776363 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:09.776363 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:09.776363 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:09.776363 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:09.776363 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:09.776363 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:09.776363 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:09.776363 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:09.776363 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:09.776363 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:09.776363 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:09.776363 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:09.776363 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:09.776363 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:09.776363 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:09.777258 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:09.777258 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:09.777258 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:09.777258 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:09.777258 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:09.777258 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:09.777258 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:09.777258 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:09.777258 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:09.777258 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:09.777258 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:09.777258 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:09.777258 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:09.777258 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:09.777258 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:09.777258 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:09.777258 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:09.778118 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:09.778118 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:09.778118 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:09.778118 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 275/546] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:09.786393 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e5aa6-9002-46be-bb72-010d2b1256c4 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:09.930929 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e5aa6-9002-46be-bb72-010d2b1256c4 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:09.972041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303d239-1483-4edc-90f2-8947bd7fecd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:09.972644 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303d239-1483-4edc-90f2-8947bd7fecd2 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:09.972918 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303d239-1483-4edc-90f2-8947bd7fecd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:09.973188 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303d239-1483-4edc-90f2-8947bd7fecd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:09.973862 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303d239-1483-4edc-90f2-8947bd7fecd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:09.974162 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303d239-1483-4edc-90f2-8947bd7fecd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:09.975515 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303d239-1483-4edc-90f2-8947bd7fecd2 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:09.992312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 272/547] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:09.997968 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a97f0-64d4-4478-856b-676fdb2cac42 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:10.056106 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:10.104507 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a97f0-64d4-4478-856b-676fdb2cac42 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:10.139364 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952324c1-d21c-492b-a1a7-3523772f5104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:10.139985 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952324c1-d21c-492b-a1a7-3523772f5104 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:10.140261 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952324c1-d21c-492b-a1a7-3523772f5104 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:10.140606 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952324c1-d21c-492b-a1a7-3523772f5104 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:10.148879 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952324c1-d21c-492b-a1a7-3523772f5104 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:10.150336 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952324c1-d21c-492b-a1a7-3523772f5104 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:10.161485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-952324c1-d21c-492b-a1a7-3523772f5104 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 10:42:10.161485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:10.161485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:10.161485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:10.161485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:10.161485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:10.161485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:10.161485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:10.161485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:10.161485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:10.161485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:10.161485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:10.161485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:42:10.161485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:42:10.161485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:42:10.161485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:42:10.162383 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:10.162383 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:10.162383 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:42:10.162383 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:10.162383 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:42:10.162383 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:10.162383 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:10.162383 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:10.162383 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:10.162383 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:10.162383 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:10.162383 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:10.162383 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:10.162383 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:10.162383 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:10.162383 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:10.162383 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:10.162383 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:10.163800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:10.163800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:10.163800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:42:10.163800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:42:10.163800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:42:10.163800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:42:10.163800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:42:10.163800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:42:10.163800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 10:42:10.163800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:10.163800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 276/548] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:42:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:10.170521 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303d239-1483-4edc-90f2-8947bd7fecd2 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:10.226743 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:10.298448 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303d239-1483-4edc-90f2-8947bd7fecd2 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:10.356935 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46984d3e-e76b-4cb5-9abb-2f1343b3adf4 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:10.357501 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46984d3e-e76b-4cb5-9abb-2f1343b3adf4 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:10.357986 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46984d3e-e76b-4cb5-9abb-2f1343b3adf4 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:10.359797 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06fb394-57e8-44f7-83cc-94d75e728b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:10.360202 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 277/549] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 10:42:10.361347 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fb394-57e8-44f7-83cc-94d75e728b12 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:10.361347 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fb394-57e8-44f7-83cc-94d75e728b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:10.361347 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fb394-57e8-44f7-83cc-94d75e728b12 None admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:10.364366 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06fb394-57e8-44f7-83cc-94d75e728b12 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:10.364366 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06fb394-57e8-44f7-83cc-94d75e728b12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:10.364366 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06fb394-57e8-44f7-83cc-94d75e728b12 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:10.365702 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87627e98-0e39-439f-9a94-d1621e5b301c None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:10.365979 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87627e98-0e39-439f-9a94-d1621e5b301c None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:10.366249 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87627e98-0e39-439f-9a94-d1621e5b301c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:10.383596 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 273/550] 10.222.0.27 () {56 vars in 1135 bytes} [Sun Aug 7 10:42:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:10.394636 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06fb394-57e8-44f7-83cc-94d75e728b12 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:10.402160 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-87627e98-0e39-439f-9a94-d1621e5b301c None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:10.403342 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-87627e98-0e39-439f-9a94-d1621e5b301c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:10.486881 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 278/551] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:42:10.521033 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87627e98-0e39-439f-9a94-d1621e5b301c None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:10.555966 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06fb394-57e8-44f7-83cc-94d75e728b12 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:10.558677 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:10.592530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465520aa-5da9-439d-b363-aa8555f02b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:10.593433 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465520aa-5da9-439d-b363-aa8555f02b8e None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:10.593951 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465520aa-5da9-439d-b363-aa8555f02b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:10.594364 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465520aa-5da9-439d-b363-aa8555f02b8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:10.611350 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:10.669630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465520aa-5da9-439d-b363-aa8555f02b8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:10.671337 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465520aa-5da9-439d-b363-aa8555f02b8e None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:10.764192 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87627e98-0e39-439f-9a94-d1621e5b301c None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:10.770413 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:10.778823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 274/552] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:42:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:42:10.780520 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465520aa-5da9-439d-b363-aa8555f02b8e None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:10.821636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6f4ea-209c-4524-9fa4-009bc7e34398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:10.822260 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6f4ea-209c-4524-9fa4-009bc7e34398 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:10.822533 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6f4ea-209c-4524-9fa4-009bc7e34398 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:10.822804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6f4ea-209c-4524-9fa4-009bc7e34398 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:10.834547 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6f4ea-209c-4524-9fa4-009bc7e34398 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:42:10.840671 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-94f6f4ea-209c-4524-9fa4-009bc7e34398 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:10.840671 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:10.840671 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:10.840671 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:10.840671 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:10.840671 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:10.840671 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:10.840671 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:10.840671 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:10.840671 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:10.840671 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:10.840671 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:10.840671 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:42:10.840671 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:42:10.840671 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:42:10.840671 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:42:10.842143 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:42:10.842143 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:42:10.842143 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:42:10.842143 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:42:10.842143 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:10.842143 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:10.842143 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:10.842143 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:10.842143 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:10.842143 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:10.842143 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:10.842143 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:10.842143 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:10.842143 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:10.842143 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:10.842143 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:10.843230 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:10.843230 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:10.843230 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:10.843230 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:10.843230 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:42:10.843230 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:42:10.843230 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:42:10.843230 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:42:10.843230 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:42:10.843230 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:42:10.843230 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:10.843230 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:10.843230 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 279/553] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 7 10:42:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:42:10.844698 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89b326-9833-447e-a5a2-6a8e6fbf2da5 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:10.845550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89b326-9833-447e-a5a2-6a8e6fbf2da5 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:10.845885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89b326-9833-447e-a5a2-6a8e6fbf2da5 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:10.847530 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 280/554] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:10.852338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89b326-9833-447e-a5a2-6a8e6fbf2da5 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:10.895321 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465520aa-5da9-439d-b363-aa8555f02b8e None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:10.932321 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0a980-d2c8-4a2c-aea7-281addd676a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:10.933233 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0a980-d2c8-4a2c-aea7-281addd676a9 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:10.933714 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0a980-d2c8-4a2c-aea7-281addd676a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:10.934184 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0a980-d2c8-4a2c-aea7-281addd676a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:10.944502 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0a980-d2c8-4a2c-aea7-281addd676a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:10.946178 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0a980-d2c8-4a2c-aea7-281addd676a9 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:10.961288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-73f0a980-d2c8-4a2c-aea7-281addd676a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:10.961288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:10.961288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:10.961288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:10.961288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:10.961288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:10.961288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:10.961288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:10.961288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:10.961288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:10.961288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:10.961288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:10.961288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:10.961288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:10.961288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:10.961288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:10.962244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:10.962244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:10.962244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:10.962244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:10.962244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:10.962244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:10.962244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:10.962244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:10.962244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:10.962244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:10.962244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:10.962244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:10.962244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:10.962244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:10.962244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:10.962244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:10.962244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:10.963187 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:10.963187 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:10.963187 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:10.969374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89b326-9833-447e-a5a2-6a8e6fbf2da5 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:10.969748 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 275/555] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:10.972306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462223c2-97d1-48ed-817f-e2a6162ceff6 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:10.973068 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462223c2-97d1-48ed-817f-e2a6162ceff6 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:10.973604 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462223c2-97d1-48ed-817f-e2a6162ceff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:10.981776 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:10.993387 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-462223c2-97d1-48ed-817f-e2a6162ceff6 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:10.995072 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-462223c2-97d1-48ed-817f-e2a6162ceff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:11.004792 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4294f7-aef4-425c-880b-cc7e218f79de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:11.005542 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4294f7-aef4-425c-880b-cc7e218f79de None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:11.005978 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4294f7-aef4-425c-880b-cc7e218f79de None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:11.006341 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4294f7-aef4-425c-880b-cc7e218f79de None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:11.007254 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4294f7-aef4-425c-880b-cc7e218f79de None admin] RBAC: Adding query filter params (name=service) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:11.007692 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4294f7-aef4-425c-880b-cc7e218f79de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:11.009276 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4294f7-aef4-425c-880b-cc7e218f79de None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:11.019374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 281/556] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 7 10:42:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:11.020388 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4294f7-aef4-425c-880b-cc7e218f79de None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:11.045728 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:11.069427 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 276/557] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:42:11.070657 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462223c2-97d1-48ed-817f-e2a6162ceff6 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:11.155310 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4294f7-aef4-425c-880b-cc7e218f79de None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:11.173236 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462223c2-97d1-48ed-817f-e2a6162ceff6 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:11.194411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fa22c-35f0-480c-b171-02dac8ea03eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:11.195021 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fa22c-35f0-480c-b171-02dac8ea03eb None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:11.195307 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fa22c-35f0-480c-b171-02dac8ea03eb None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:11.195597 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fa22c-35f0-480c-b171-02dac8ea03eb None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:11.196335 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20fa22c-35f0-480c-b171-02dac8ea03eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:11.196637 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20fa22c-35f0-480c-b171-02dac8ea03eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:11.198914 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20fa22c-35f0-480c-b171-02dac8ea03eb None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:11.215020 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51db78-edf2-4fbb-b3ef-e67d056628aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:11.221296 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 282/558] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:11.221296 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fa22c-35f0-480c-b171-02dac8ea03eb None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:11.221657 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51db78-edf2-4fbb-b3ef-e67d056628aa None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:11.222104 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51db78-edf2-4fbb-b3ef-e67d056628aa None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:11.222104 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51db78-edf2-4fbb-b3ef-e67d056628aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:11.242947 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51db78-edf2-4fbb-b3ef-e67d056628aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:11.245100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51db78-edf2-4fbb-b3ef-e67d056628aa None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:11.249920 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:11.264600 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-ac51db78-edf2-4fbb-b3ef-e67d056628aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:11.264600 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:11.264600 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:11.264600 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:11.264600 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:11.264600 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:11.264600 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:11.264600 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:11.264600 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:11.264600 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:11.264600 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:11.264600 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:11.264600 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:11.264600 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:11.264600 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:11.264600 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:11.266091 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:11.266091 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:11.266091 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:11.266091 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:11.266091 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:11.266091 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:11.266091 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:11.266091 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:11.266091 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:11.266091 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:11.266091 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:11.266091 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:11.266091 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:11.266091 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:11.266091 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:11.266091 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:11.266091 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:11.267592 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:11.267592 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:11.267592 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:11.269984 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 277/559] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:11.271104 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51db78-edf2-4fbb-b3ef-e67d056628aa None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:11.305635 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:11.327059 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fa22c-35f0-480c-b171-02dac8ea03eb None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:11.361656 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ac8e4-ed9c-4ebd-ae3f-b715b860b532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:11.362287 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ac8e4-ed9c-4ebd-ae3f-b715b860b532 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:11.362563 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ac8e4-ed9c-4ebd-ae3f-b715b860b532 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:11.362829 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ac8e4-ed9c-4ebd-ae3f-b715b860b532 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:11.373742 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ac8e4-ed9c-4ebd-ae3f-b715b860b532 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:42:11.379395 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-074ac8e4-ed9c-4ebd-ae3f-b715b860b532 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:11.379395 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:11.379395 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:11.379395 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:11.379395 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:11.379395 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:11.379395 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:11.379395 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:11.379395 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:11.379395 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:11.379395 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:11.379395 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:11.379395 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:42:11.379395 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:42:11.379395 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:42:11.379395 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:42:11.380326 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:42:11.380326 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:42:11.380326 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:42:11.380326 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:42:11.380326 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:11.380326 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:11.380326 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:11.380326 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:11.380326 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:11.380326 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:11.380326 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:11.380326 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:11.380326 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:11.380326 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:11.380326 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:11.380326 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:11.381162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:11.381162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:11.381162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:11.381162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:11.381162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:42:11.381162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:42:11.381162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:42:11.381162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:42:11.381162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:42:11.381162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:42:11.381162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:11.381162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:11.385345 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 283/560] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 7 10:42:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:11.386440 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ac8e4-ed9c-4ebd-ae3f-b715b860b532 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:11.389552 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51db78-edf2-4fbb-b3ef-e67d056628aa None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:11.425436 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd8686-da28-45d2-9e96-f05e8d512813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:11.426366 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd8686-da28-45d2-9e96-f05e8d512813 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:11.426842 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd8686-da28-45d2-9e96-f05e8d512813 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:11.427322 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd8686-da28-45d2-9e96-f05e8d512813 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:11.434551 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd8686-da28-45d2-9e96-f05e8d512813 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:11.436313 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd8686-da28-45d2-9e96-f05e8d512813 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:11.449418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-ecdd8686-da28-45d2-9e96-f05e8d512813 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:11.449418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:11.449418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:11.449418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:11.449418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:11.449418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:11.449418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:11.449418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:11.449418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:11.449418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:11.449418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:11.449418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:11.449418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:42:11.449418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:42:11.449418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:42:11.450851 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:42:11.450851 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:11.450851 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:11.450851 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:11.450851 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:11.450851 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:11.450851 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:11.450851 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:11.450851 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:11.450851 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:11.450851 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:11.450851 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:11.450851 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:11.450851 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:11.450851 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:11.450851 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:11.450851 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:11.451802 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:42:11.451802 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:42:11.451802 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:42:11.451802 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:42:11.451802 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:42:11.451802 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:42:11.451802 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:11.451802 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:11.458973 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 278/561] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:11.460021 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd8686-da28-45d2-9e96-f05e8d512813 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:11.481790 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:11.491764 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ac8e4-ed9c-4ebd-ae3f-b715b860b532 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:11.529087 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bf6f2-ae26-4d67-9898-151756eb1657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:11.529819 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bf6f2-ae26-4d67-9898-151756eb1657 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:11.530167 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bf6f2-ae26-4d67-9898-151756eb1657 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:11.530507 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bf6f2-ae26-4d67-9898-151756eb1657 None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:11.531271 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bf6f2-ae26-4d67-9898-151756eb1657 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:11.531663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bf6f2-ae26-4d67-9898-151756eb1657 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:11.533151 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bf6f2-ae26-4d67-9898-151756eb1657 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:11.545414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 284/562] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:11.546468 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bf6f2-ae26-4d67-9898-151756eb1657 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:11.568850 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:11.580464 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd8686-da28-45d2-9e96-f05e8d512813 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:11.616902 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a43ab4-bf5b-4db9-b4d1-7ec4591a54a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:11.617783 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a43ab4-bf5b-4db9-b4d1-7ec4591a54a9 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:11.618061 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a43ab4-bf5b-4db9-b4d1-7ec4591a54a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:11.618336 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a43ab4-bf5b-4db9-b4d1-7ec4591a54a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:11.618998 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a43ab4-bf5b-4db9-b4d1-7ec4591a54a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:11.619297 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a43ab4-bf5b-4db9-b4d1-7ec4591a54a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:11.620931 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a43ab4-bf5b-4db9-b4d1-7ec4591a54a9 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:11.629959 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 279/563] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 7 10:42:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:11.630367 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a43ab4-bf5b-4db9-b4d1-7ec4591a54a9 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:11.656502 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bf6f2-ae26-4d67-9898-151756eb1657 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:11.690254 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb73628-2b68-44d8-b572-f666d11b5de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:11.691066 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb73628-2b68-44d8-b572-f666d11b5de0 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:11.691337 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb73628-2b68-44d8-b572-f666d11b5de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:11.691603 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb73628-2b68-44d8-b572-f666d11b5de0 None admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:11.692315 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb73628-2b68-44d8-b572-f666d11b5de0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:11.692616 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb73628-2b68-44d8-b572-f666d11b5de0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:11.694053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb73628-2b68-44d8-b572-f666d11b5de0 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:11.706173 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 285/564] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:42:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:11.707451 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fe6d1-82b8-4aca-b599-4e10a82859aa None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:11.707726 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fe6d1-82b8-4aca-b599-4e10a82859aa None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:11.707994 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fe6d1-82b8-4aca-b599-4e10a82859aa None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:11.709358 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 286/565] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:11.710420 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d3090-84e8-44b9-a59d-d41b7ce38c8d None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:11.710700 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d3090-84e8-44b9-a59d-d41b7ce38c8d None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:11.711062 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d3090-84e8-44b9-a59d-d41b7ce38c8d None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:11.712229 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 287/566] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:11.713152 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d3090-84e8-44b9-a59d-d41b7ce38c8d None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:11.716595 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:11.733507 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a43ab4-bf5b-4db9-b4d1-7ec4591a54a9 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:11.766945 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7215b0-f98c-41b5-8c30-b2617e89c474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:11.767557 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7215b0-f98c-41b5-8c30-b2617e89c474 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:11.767829 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7215b0-f98c-41b5-8c30-b2617e89c474 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:11.768090 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7215b0-f98c-41b5-8c30-b2617e89c474 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:11.775214 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7215b0-f98c-41b5-8c30-b2617e89c474 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:11.776632 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7215b0-f98c-41b5-8c30-b2617e89c474 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:11.788985 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-bd7215b0-f98c-41b5-8c30-b2617e89c474 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 10:42:11.788985 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:11.788985 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:11.788985 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:11.788985 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:11.788985 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:11.788985 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:11.788985 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:11.788985 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:11.788985 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:11.788985 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:11.788985 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:11.788985 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:42:11.788985 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:42:11.788985 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:42:11.788985 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:42:11.789994 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:11.789994 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:11.789994 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:42:11.789994 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:11.789994 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:42:11.789994 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:11.789994 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:11.789994 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:11.789994 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:11.789994 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:11.789994 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:11.789994 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:11.789994 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:11.789994 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:11.789994 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:11.789994 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:11.789994 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:11.789994 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:11.790920 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:11.790920 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:11.790920 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:42:11.790920 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:42:11.790920 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:42:11.790920 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:42:11.790920 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:42:11.790920 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:42:11.790920 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 10:42:11.790920 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:11.790920 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 280/567] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Aug 7 10:42:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:11.790920 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7215b0-f98c-41b5-8c30-b2617e89c474 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:11.808769 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:11.819865 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d3090-84e8-44b9-a59d-d41b7ce38c8d None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:11.853739 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c97a44-2673-43ce-9e40-14e79ed2131c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:11.854351 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c97a44-2673-43ce-9e40-14e79ed2131c None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:11.854624 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c97a44-2673-43ce-9e40-14e79ed2131c None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:11.854893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c97a44-2673-43ce-9e40-14e79ed2131c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:11.864710 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c97a44-2673-43ce-9e40-14e79ed2131c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:11.866167 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c97a44-2673-43ce-9e40-14e79ed2131c None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:11.880873 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-e3c97a44-2673-43ce-9e40-14e79ed2131c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:11.880873 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:11.880873 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:11.880873 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:11.880873 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:11.880873 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:11.880873 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:11.880873 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:11.880873 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:11.880873 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:11.880873 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:11.880873 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:11.880873 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:11.880873 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:11.880873 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:11.880873 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:11.881827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:11.881827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:11.881827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:11.881827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:11.881827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:11.881827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:11.881827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:11.881827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:11.881827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:11.881827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:11.881827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:11.881827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:11.881827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:11.881827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:11.881827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:11.881827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:11.881827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:11.882738 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:11.882738 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:11.882738 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:11.882738 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 288/568] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:11.883113 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9137def-5b21-4bd4-958b-df77c30e74f9 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:11.883342 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9137def-5b21-4bd4-958b-df77c30e74f9 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:11.883612 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9137def-5b21-4bd4-958b-df77c30e74f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:11.893822 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7215b0-f98c-41b5-8c30-b2617e89c474 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:11.901546 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-c9137def-5b21-4bd4-958b-df77c30e74f9 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:11.902752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-c9137def-5b21-4bd4-958b-df77c30e74f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:11.926692 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b4e1a-c3cd-44fa-a002-90c7b961e5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:11.927291 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b4e1a-c3cd-44fa-a002-90c7b961e5d7 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:11.927557 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b4e1a-c3cd-44fa-a002-90c7b961e5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:11.927830 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b4e1a-c3cd-44fa-a002-90c7b961e5d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:11.928551 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b4e1a-c3cd-44fa-a002-90c7b961e5d7 None admin] RBAC: Adding query filter params (role.id=bf9e51dafeac420f89a66e78e1463982, scope.project.id=62eed8550ae3403f8a75894dbd19cf4a, user.id=a7181e5118c547a3a31d2e080c25ff01) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:11.928852 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b4e1a-c3cd-44fa-a002-90c7b961e5d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:11.930377 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b4e1a-c3cd-44fa-a002-90c7b961e5d7 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:11.936017 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 281/569] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:42:11 2022] GET /identity/v3/role_assignments?user.id=a7181e5118c547a3a31d2e080c25ff01&scope.project.id=62eed8550ae3403f8a75894dbd19cf4a&role.id=bf9e51dafeac420f89a66e78e1463982 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:11.937301 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eabad7-ed4d-443f-8fc5-450104e887c2 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:11.937607 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eabad7-ed4d-443f-8fc5-450104e887c2 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:11.937879 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eabad7-ed4d-443f-8fc5-450104e887c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:11.957386 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-03eabad7-ed4d-443f-8fc5-450104e887c2 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:11.958856 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-03eabad7-ed4d-443f-8fc5-450104e887c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:11.967926 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:11.987026 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 289/570] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:42:11.987916 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9137def-5b21-4bd4-958b-df77c30e74f9 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:12.056543 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 282/571] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:42:12.057699 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eabad7-ed4d-443f-8fc5-450104e887c2 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:12.075847 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:12.118302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9137def-5b21-4bd4-958b-df77c30e74f9 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:12.154279 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933e3a3-1322-4f61-80f7-fcf359c7b7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:12.155033 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933e3a3-1322-4f61-80f7-fcf359c7b7bb None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:12.155401 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933e3a3-1322-4f61-80f7-fcf359c7b7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:12.155764 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933e3a3-1322-4f61-80f7-fcf359c7b7bb None admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:12.156591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9933e3a3-1322-4f61-80f7-fcf359c7b7bb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:12.156989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9933e3a3-1322-4f61-80f7-fcf359c7b7bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:12.158544 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9933e3a3-1322-4f61-80f7-fcf359c7b7bb None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:12.180213 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 290/572] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Aug 7 10:42:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:12.180390 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eabad7-ed4d-443f-8fc5-450104e887c2 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:12.180470 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933e3a3-1322-4f61-80f7-fcf359c7b7bb None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:12.213964 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07559cb6-9f75-4d04-862b-246f89d4c088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:12.214491 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07559cb6-9f75-4d04-862b-246f89d4c088 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:12.214766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07559cb6-9f75-4d04-862b-246f89d4c088 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:12.215033 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07559cb6-9f75-4d04-862b-246f89d4c088 None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:12.215673 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07559cb6-9f75-4d04-862b-246f89d4c088 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:12.215970 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07559cb6-9f75-4d04-862b-246f89d4c088 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:12.217403 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07559cb6-9f75-4d04-862b-246f89d4c088 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:12.226410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:12.234313 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 283/573] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:12.235003 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07559cb6-9f75-4d04-862b-246f89d4c088 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:12.283709 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933e3a3-1322-4f61-80f7-fcf359c7b7bb None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:12.304279 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:12.320001 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd128c9-a9c7-40b5-b6aa-570ebfa3818b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:12.320616 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd128c9-a9c7-40b5-b6aa-570ebfa3818b None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:12.320889 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd128c9-a9c7-40b5-b6aa-570ebfa3818b None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:12.321157 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd128c9-a9c7-40b5-b6aa-570ebfa3818b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:12.336802 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd128c9-a9c7-40b5-b6aa-570ebfa3818b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:42:12.341722 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-0dd128c9-a9c7-40b5-b6aa-570ebfa3818b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:12.341722 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:12.341722 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:12.341722 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:12.341722 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:12.341722 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:12.341722 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:12.341722 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:12.341722 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:12.341722 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:12.341722 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:12.341722 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:12.341722 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:42:12.341722 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:42:12.341722 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:42:12.341722 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:42:12.342823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:42:12.342823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:42:12.342823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:42:12.342823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:42:12.342823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:12.342823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:12.342823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:12.342823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:12.342823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:12.342823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:12.342823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:12.342823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:12.342823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:12.342823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:12.342823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:12.342823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:12.343853 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:12.343853 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:12.343853 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:12.343853 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:12.343853 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:42:12.343853 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:42:12.343853 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:42:12.343853 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:42:12.343853 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:42:12.343853 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:42:12.343853 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:12.343853 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:12.344633 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07559cb6-9f75-4d04-862b-246f89d4c088 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:12.347493 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 291/574] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 7 10:42:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:12.348340 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd128c9-a9c7-40b5-b6aa-570ebfa3818b None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:12.383807 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b012e-3d33-4d5a-9b48-ac3b3da1fc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:12.384790 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b012e-3d33-4d5a-9b48-ac3b3da1fc73 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:12.385164 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b012e-3d33-4d5a-9b48-ac3b3da1fc73 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:12.385565 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b012e-3d33-4d5a-9b48-ac3b3da1fc73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:12.398867 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b012e-3d33-4d5a-9b48-ac3b3da1fc73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:42:12.403891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-479b012e-3d33-4d5a-9b48-ac3b3da1fc73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:12.403891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:12.403891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:12.403891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:12.403891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:12.403891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:12.403891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:12.403891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:12.403891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:12.403891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:12.403891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:12.403891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:12.403891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:42:12.403891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:42:12.403891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:42:12.403891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:42:12.404986 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:42:12.404986 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:42:12.404986 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:42:12.404986 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:42:12.404986 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:12.404986 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:12.404986 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:12.404986 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:12.404986 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:12.404986 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:12.404986 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:12.404986 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:12.404986 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:12.404986 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:12.404986 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:12.404986 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:12.405891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:12.405891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:12.405891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:12.405891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:12.405891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:42:12.405891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:42:12.405891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:42:12.405891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:42:12.405891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:42:12.405891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:42:12.405891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:12.405891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:12.405891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 284/575] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 7 10:42:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:12.406579 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b012e-3d33-4d5a-9b48-ac3b3da1fc73 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:12.458963 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd128c9-a9c7-40b5-b6aa-570ebfa3818b None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:12.461518 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:12.496598 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96d4e7-2b1b-40dc-afa0-caf75e13ea0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:12.497109 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96d4e7-2b1b-40dc-afa0-caf75e13ea0e None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:12.497415 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96d4e7-2b1b-40dc-afa0-caf75e13ea0e None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:12.497679 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96d4e7-2b1b-40dc-afa0-caf75e13ea0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:12.506215 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b012e-3d33-4d5a-9b48-ac3b3da1fc73 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:12.509532 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e96d4e7-2b1b-40dc-afa0-caf75e13ea0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:12.510988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e96d4e7-2b1b-40dc-afa0-caf75e13ea0e None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:12.526858 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-7e96d4e7-2b1b-40dc-afa0-caf75e13ea0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:12.526858 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:12.526858 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:12.526858 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:12.526858 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:12.526858 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:12.526858 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:12.526858 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:12.526858 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:12.526858 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:12.526858 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:12.526858 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:12.526858 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:12.526858 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:12.526858 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:12.526858 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:12.527802 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:12.527802 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:12.527802 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:12.527802 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:12.527802 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:12.527802 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:12.527802 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:12.527802 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:12.527802 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:12.527802 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:12.527802 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:12.527802 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:12.527802 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:12.527802 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:12.527802 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:12.527802 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:12.527802 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:12.528726 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:12.528726 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:12.528726 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:12.528726 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 292/576] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:12.528726 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96d4e7-2b1b-40dc-afa0-caf75e13ea0e None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:12.538973 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:12.547146 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc836b-c667-4370-9704-a2cd82e191a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:12.547766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc836b-c667-4370-9704-a2cd82e191a5 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:12.548065 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc836b-c667-4370-9704-a2cd82e191a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:12.548331 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc836b-c667-4370-9704-a2cd82e191a5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:12.556075 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc836b-c667-4370-9704-a2cd82e191a5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:12.557457 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc836b-c667-4370-9704-a2cd82e191a5 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:12.569428 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-11bc836b-c667-4370-9704-a2cd82e191a5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 10:42:12.569428 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:12.569428 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:12.569428 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:12.569428 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:12.569428 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:12.569428 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:12.569428 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:12.569428 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:12.569428 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:12.569428 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:12.569428 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:12.569428 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:42:12.569428 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:42:12.569428 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:42:12.569428 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:42:12.570379 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:12.570379 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:12.570379 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:42:12.570379 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:12.570379 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:42:12.570379 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:12.570379 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:12.570379 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:12.570379 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:12.570379 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:12.570379 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:12.570379 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:12.570379 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:12.570379 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:12.570379 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:12.570379 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:12.570379 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:12.570379 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:12.575944 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:12.575944 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:12.575944 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:42:12.575944 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:42:12.575944 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:42:12.575944 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:42:12.575944 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:42:12.575944 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:42:12.575944 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 10:42:12.575944 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:12.575944 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 285/577] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:42:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:12.575944 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc836b-c667-4370-9704-a2cd82e191a5 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:12.640522 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96d4e7-2b1b-40dc-afa0-caf75e13ea0e None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:12.675944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3f1fa-7824-47c9-8660-4e91c4c2d09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:12.676552 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3f1fa-7824-47c9-8660-4e91c4c2d09d None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:12.676822 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3f1fa-7824-47c9-8660-4e91c4c2d09d None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:12.677088 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3f1fa-7824-47c9-8660-4e91c4c2d09d None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:12.677779 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee3f1fa-7824-47c9-8660-4e91c4c2d09d None admin] RBAC: Adding query filter params (name=service) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:12.678078 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee3f1fa-7824-47c9-8660-4e91c4c2d09d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:12.679428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee3f1fa-7824-47c9-8660-4e91c4c2d09d None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:12.683558 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc836b-c667-4370-9704-a2cd82e191a5 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:12.692771 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 293/578] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 7 10:42:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:12.692771 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3f1fa-7824-47c9-8660-4e91c4c2d09d None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:12.709648 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:12.721192 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156834de-593b-47e1-95f0-78e18a3290a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:12.721961 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156834de-593b-47e1-95f0-78e18a3290a7 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:12.722234 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156834de-593b-47e1-95f0-78e18a3290a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:12.722658 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156834de-593b-47e1-95f0-78e18a3290a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:12.723289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156834de-593b-47e1-95f0-78e18a3290a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:12.723586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156834de-593b-47e1-95f0-78e18a3290a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:12.724929 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156834de-593b-47e1-95f0-78e18a3290a7 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:12.739234 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 286/579] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 7 10:42:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:12.739234 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156834de-593b-47e1-95f0-78e18a3290a7 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:12.788485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:12.796238 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3f1fa-7824-47c9-8660-4e91c4c2d09d None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:12.834750 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4502c27-13c4-40a2-b52a-1f97c55e012a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:12.835394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4502c27-13c4-40a2-b52a-1f97c55e012a None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:12.835633 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4502c27-13c4-40a2-b52a-1f97c55e012a None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:12.835883 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4502c27-13c4-40a2-b52a-1f97c55e012a None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:12.842466 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4502c27-13c4-40a2-b52a-1f97c55e012a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:12.842466 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4502c27-13c4-40a2-b52a-1f97c55e012a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:12.842466 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4502c27-13c4-40a2-b52a-1f97c55e012a None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:12.858763 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 294/580] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:12.858763 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4502c27-13c4-40a2-b52a-1f97c55e012a None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:12.863454 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156834de-593b-47e1-95f0-78e18a3290a7 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:12.901293 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c398a-ffbb-4d9a-9be5-a7c0beb6ab6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:12.901924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c398a-ffbb-4d9a-9be5-a7c0beb6ab6f None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:12.902204 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c398a-ffbb-4d9a-9be5-a7c0beb6ab6f None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:12.902470 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c398a-ffbb-4d9a-9be5-a7c0beb6ab6f None admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:12.903201 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c398a-ffbb-4d9a-9be5-a7c0beb6ab6f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:12.903499 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c398a-ffbb-4d9a-9be5-a7c0beb6ab6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:12.904918 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c398a-ffbb-4d9a-9be5-a7c0beb6ab6f None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:12.927456 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 287/581] 10.222.0.27 () {56 vars in 1137 bytes} [Sun Aug 7 10:42:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:12.927456 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c398a-ffbb-4d9a-9be5-a7c0beb6ab6f None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:12.945231 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:12.970871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4502c27-13c4-40a2-b52a-1f97c55e012a None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:13.006451 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb961137-7063-47ee-b031-c9c13486bf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:13.007072 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb961137-7063-47ee-b031-c9c13486bf29 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:13.007347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb961137-7063-47ee-b031-c9c13486bf29 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:13.007614 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb961137-7063-47ee-b031-c9c13486bf29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:13.017706 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb961137-7063-47ee-b031-c9c13486bf29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:13.019135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb961137-7063-47ee-b031-c9c13486bf29 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:13.034320 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-bb961137-7063-47ee-b031-c9c13486bf29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:13.034320 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:13.034320 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:13.034320 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:13.034320 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:13.034320 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:13.034320 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:13.034320 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:13.034320 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:13.034320 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:13.034320 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:13.034320 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:13.034320 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:13.034320 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:13.034320 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:13.034320 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:13.035357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:13.035357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:13.035357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:13.035357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:13.035357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:13.035357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:13.035357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:13.035357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:13.035357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:13.035357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:13.035357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:13.035357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:13.035357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:13.035357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:13.035357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:13.035357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:13.035357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:13.041142 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:13.041142 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:13.041142 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:13.041362 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c398a-ffbb-4d9a-9be5-a7c0beb6ab6f None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:13.041454 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 295/582] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:13.041454 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb961137-7063-47ee-b031-c9c13486bf29 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:13.052539 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:13.078503 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc88af8-a6f7-48b4-80e9-3de1b492e83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:13.079133 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc88af8-a6f7-48b4-80e9-3de1b492e83f None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:13.079435 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc88af8-a6f7-48b4-80e9-3de1b492e83f None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:13.079702 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc88af8-a6f7-48b4-80e9-3de1b492e83f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:13.089809 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc88af8-a6f7-48b4-80e9-3de1b492e83f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:13.091254 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc88af8-a6f7-48b4-80e9-3de1b492e83f None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:13.107165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-afc88af8-a6f7-48b4-80e9-3de1b492e83f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:13.107165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:13.107165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:13.107165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:13.107165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:13.107165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:13.107165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:13.107165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:13.107165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:13.107165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:13.107165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:13.107165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:13.107165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:13.107165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:13.107165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:13.107165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:13.108136 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:13.108136 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:13.108136 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:13.108136 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:13.108136 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:13.108136 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:13.108136 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:13.108136 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:13.108136 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:13.108136 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:13.108136 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:13.108136 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:13.108136 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:13.108136 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:13.108136 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:13.108136 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:13.108136 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:13.109028 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:13.109028 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:13.109028 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:13.109028 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 288/583] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:13.109028 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc88af8-a6f7-48b4-80e9-3de1b492e83f None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:13.148784 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb961137-7063-47ee-b031-c9c13486bf29 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:13.179808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:13.186590 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5bc827-8183-4392-8fc7-2c4018f85f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:13.187233 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bc827-8183-4392-8fc7-2c4018f85f7e None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:13.187509 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bc827-8183-4392-8fc7-2c4018f85f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:13.187778 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bc827-8183-4392-8fc7-2c4018f85f7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:13.195870 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5bc827-8183-4392-8fc7-2c4018f85f7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:13.197335 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5bc827-8183-4392-8fc7-2c4018f85f7e None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:13.221401 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-3b5bc827-8183-4392-8fc7-2c4018f85f7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:13.221401 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:13.221401 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:13.221401 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:13.221401 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:13.221401 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:13.221401 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:13.221401 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:13.221401 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:13.221401 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:13.221401 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:13.221401 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:13.221401 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:42:13.221401 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:42:13.221401 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:42:13.222357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:42:13.222357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:13.222357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:13.222357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:13.222357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:13.222357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:13.222357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:13.222357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:13.222357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:13.222357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:13.222357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:13.222357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:13.222357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:13.222357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:13.222357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:13.222357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:13.222357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:13.223232 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:42:13.223232 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:42:13.223232 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:42:13.223232 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:42:13.223232 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:42:13.223232 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:42:13.223232 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:13.223232 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:13.223232 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 296/584] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:13.223725 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5bc827-8183-4392-8fc7-2c4018f85f7e None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:13.234260 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc88af8-a6f7-48b4-80e9-3de1b492e83f None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:13.271414 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241fc2bf-4253-4638-8423-5b3b8bc7d32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:13.272041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fc2bf-4253-4638-8423-5b3b8bc7d32f None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:13.272314 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fc2bf-4253-4638-8423-5b3b8bc7d32f None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:13.273000 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fc2bf-4253-4638-8423-5b3b8bc7d32f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:13.285147 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241fc2bf-4253-4638-8423-5b3b8bc7d32f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:13.286625 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241fc2bf-4253-4638-8423-5b3b8bc7d32f None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:13.300812 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-241fc2bf-4253-4638-8423-5b3b8bc7d32f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:13.300812 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:13.300812 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:13.300812 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:13.300812 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:13.300812 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:13.300812 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:13.300812 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:13.300812 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:13.300812 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:13.300812 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:13.300812 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:13.300812 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:13.300812 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:13.300812 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:13.300812 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:13.301784 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:13.301784 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:13.301784 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:13.301784 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:13.301784 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:13.301784 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:13.301784 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:13.301784 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:13.301784 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:13.301784 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:13.301784 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:13.301784 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:13.301784 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:13.301784 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:13.301784 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:13.301784 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:13.301784 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:13.302667 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:13.302667 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:13.302667 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:13.302667 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 289/585] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:13.302667 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241fc2bf-4253-4638-8423-5b3b8bc7d32f None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:13.320433 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:13.343104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5bc827-8183-4392-8fc7-2c4018f85f7e None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:13.380200 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54340d67-462d-420f-b872-0963817545bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:13.380805 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54340d67-462d-420f-b872-0963817545bf None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:13.381080 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54340d67-462d-420f-b872-0963817545bf None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:13.381370 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54340d67-462d-420f-b872-0963817545bf None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:13.382014 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54340d67-462d-420f-b872-0963817545bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:13.382313 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54340d67-462d-420f-b872-0963817545bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:13.383665 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54340d67-462d-420f-b872-0963817545bf None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:13.397351 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 297/586] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:13.397775 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54340d67-462d-420f-b872-0963817545bf None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:13.421037 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241fc2bf-4253-4638-8423-5b3b8bc7d32f None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:13.451027 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:13.458670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4063cf-184c-4515-ba6e-72910eeceba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:13.459274 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4063cf-184c-4515-ba6e-72910eeceba0 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:13.459554 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4063cf-184c-4515-ba6e-72910eeceba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:13.459820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4063cf-184c-4515-ba6e-72910eeceba0 None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:13.460456 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4063cf-184c-4515-ba6e-72910eeceba0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:13.460760 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4063cf-184c-4515-ba6e-72910eeceba0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:13.462143 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4063cf-184c-4515-ba6e-72910eeceba0 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:13.479296 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 290/587] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:13.480045 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4063cf-184c-4515-ba6e-72910eeceba0 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:13.504028 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54340d67-462d-420f-b872-0963817545bf None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:13.539003 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d279dc3-abdc-424d-817e-a872d8709984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:13.539608 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d279dc3-abdc-424d-817e-a872d8709984 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:13.539885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d279dc3-abdc-424d-817e-a872d8709984 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:13.540161 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d279dc3-abdc-424d-817e-a872d8709984 None admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:13.540854 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d279dc3-abdc-424d-817e-a872d8709984 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:13.541154 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d279dc3-abdc-424d-817e-a872d8709984 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:13.542612 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d279dc3-abdc-424d-817e-a872d8709984 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:13.555127 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 298/588] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:42:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:13.555890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d279dc3-abdc-424d-817e-a872d8709984 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:13.565210 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:13.599624 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4063cf-184c-4515-ba6e-72910eeceba0 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:13.639262 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a468a-5819-4018-b306-073edd326b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:13.640379 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a468a-5819-4018-b306-073edd326b23 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:13.640723 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a468a-5819-4018-b306-073edd326b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:13.641062 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a468a-5819-4018-b306-073edd326b23 None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:13.642391 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a468a-5819-4018-b306-073edd326b23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:13.642751 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a468a-5819-4018-b306-073edd326b23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:13.644212 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a468a-5819-4018-b306-073edd326b23 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:13.661744 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 291/589] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:13.661744 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a468a-5819-4018-b306-073edd326b23 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:13.671888 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d279dc3-abdc-424d-817e-a872d8709984 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:13.684434 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:13.711257 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c401f2c-08a5-4b82-98b3-05838a1cc2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:13.711882 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c401f2c-08a5-4b82-98b3-05838a1cc2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:13.712158 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c401f2c-08a5-4b82-98b3-05838a1cc2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:13.712429 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c401f2c-08a5-4b82-98b3-05838a1cc2e9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:13.720365 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c401f2c-08a5-4b82-98b3-05838a1cc2e9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:13.721919 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c401f2c-08a5-4b82-98b3-05838a1cc2e9 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:13.733859 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-3c401f2c-08a5-4b82-98b3-05838a1cc2e9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 07 10:42:13.733859 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:13.733859 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:13.733859 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:13.733859 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:13.733859 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:13.733859 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:13.733859 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:13.733859 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:13.733859 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:13.733859 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:13.733859 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:13.733859 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:42:13.733859 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:42:13.733859 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:42:13.733859 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:42:13.734827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:13.734827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:13.734827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:42:13.734827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:13.734827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:42:13.734827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:13.734827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:13.734827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:13.734827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:13.734827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:13.734827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:13.734827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:13.734827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:13.734827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:13.734827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:13.734827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:13.734827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:13.734827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:13.736294 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:13.736294 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:13.736294 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:42:13.736294 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:42:13.736294 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:42:13.736294 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:42:13.736294 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:42:13.736294 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:42:13.736294 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 07 10:42:13.736294 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:13.740395 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 299/590] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:42:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:13.741248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c401f2c-08a5-4b82-98b3-05838a1cc2e9 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:13.765058 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a468a-5819-4018-b306-073edd326b23 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:13.796359 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:13.802456 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bfbed-0dba-490d-9947-bf9fd3ca2930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:13.803084 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bfbed-0dba-490d-9947-bf9fd3ca2930 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:13.803363 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bfbed-0dba-490d-9947-bf9fd3ca2930 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:13.803800 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bfbed-0dba-490d-9947-bf9fd3ca2930 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:13.812594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193bfbed-0dba-490d-9947-bf9fd3ca2930 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:13.814117 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193bfbed-0dba-490d-9947-bf9fd3ca2930 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:13.825344 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-193bfbed-0dba-490d-9947-bf9fd3ca2930 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 10:42:13.825344 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:13.825344 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:13.825344 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:13.825344 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:13.825344 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:13.825344 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:13.825344 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:13.825344 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:13.825344 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:13.825344 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:13.825344 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:13.825344 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:42:13.825344 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:42:13.825344 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:42:13.825344 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:42:13.826308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:13.826308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:13.826308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:42:13.826308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:13.826308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:42:13.826308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:13.826308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:13.826308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:13.826308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:13.826308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:13.826308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:13.826308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:13.826308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:13.826308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:13.826308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:13.826308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:13.826308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:13.826308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:13.832895 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:13.832895 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:13.832895 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:42:13.832895 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:42:13.832895 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:42:13.832895 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:42:13.832895 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:42:13.832895 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:42:13.832895 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 10:42:13.832895 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:13.832895 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 292/591] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 7 10:42:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:13.832895 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bfbed-0dba-490d-9947-bf9fd3ca2930 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:13.854700 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c401f2c-08a5-4b82-98b3-05838a1cc2e9 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:13.889687 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea714505-6669-4a1c-b024-129971e31558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:13.890334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea714505-6669-4a1c-b024-129971e31558 None admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:13.890607 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea714505-6669-4a1c-b024-129971e31558 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:13.890872 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea714505-6669-4a1c-b024-129971e31558 None admin] PATH_INFO: `/v3/projects/62eed8550ae3403f8a75894dbd19cf4a/users/f98cb7abbb8942cebb71aa98da80a05a/roles/bf9e51dafeac420f89a66e78e1463982` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:13.907179 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea714505-6669-4a1c-b024-129971e31558 None admin] RBAC: Authorizing `identity:create_grant(project_id=62eed8550ae3403f8a75894dbd19cf4a, user_id=f98cb7abbb8942cebb71aa98da80a05a, role_id=bf9e51dafeac420f89a66e78e1463982)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:13.909203 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea714505-6669-4a1c-b024-129971e31558 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:13.932264 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 300/592] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 7 10:42:13 2022] PUT /identity/v3/projects/62eed8550ae3403f8a75894dbd19cf4a/users/f98cb7abbb8942cebb71aa98da80a05a/roles/bf9e51dafeac420f89a66e78e1463982 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:42:13.932264 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea714505-6669-4a1c-b024-129971e31558 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:13.952742 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bfbed-0dba-490d-9947-bf9fd3ca2930 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:13.957160 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:13.994962 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c205df-ffeb-4a3f-9cb9-eda2abe75614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:13.995696 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c205df-ffeb-4a3f-9cb9-eda2abe75614 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:13.996039 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c205df-ffeb-4a3f-9cb9-eda2abe75614 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:13.996373 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c205df-ffeb-4a3f-9cb9-eda2abe75614 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:14.003976 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c205df-ffeb-4a3f-9cb9-eda2abe75614 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:14.005477 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c205df-ffeb-4a3f-9cb9-eda2abe75614 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:14.018777 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-c2c205df-ffeb-4a3f-9cb9-eda2abe75614 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:14.018777 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:14.018777 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:14.018777 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:14.018777 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:14.018777 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:14.018777 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:14.018777 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:14.018777 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:14.018777 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:14.018777 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:14.018777 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:14.018777 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:42:14.018777 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:42:14.018777 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:42:14.019924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:42:14.019924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:14.019924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:14.019924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:14.019924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:14.019924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:14.019924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:14.019924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:14.019924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:14.019924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:14.019924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:14.019924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:14.019924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:14.019924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:14.019924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:14.019924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:14.019924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:14.021022 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:42:14.021022 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:42:14.021022 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:42:14.021022 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:42:14.021022 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:42:14.021022 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:42:14.021022 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:14.021022 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:14.024851 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 293/593] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:14.025816 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c205df-ffeb-4a3f-9cb9-eda2abe75614 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:14.055282 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea714505-6669-4a1c-b024-129971e31558 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:14.085885 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:14.102536 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c22fac-cf72-4f2a-b55b-4aa8804d2063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:14.103145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c22fac-cf72-4f2a-b55b-4aa8804d2063 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:14.103418 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c22fac-cf72-4f2a-b55b-4aa8804d2063 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:14.103685 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c22fac-cf72-4f2a-b55b-4aa8804d2063 None admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:14.104411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c22fac-cf72-4f2a-b55b-4aa8804d2063 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:14.104710 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c22fac-cf72-4f2a-b55b-4aa8804d2063 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:14.106145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c22fac-cf72-4f2a-b55b-4aa8804d2063 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:14.128965 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 301/594] 10.222.0.27 () {56 vars in 1137 bytes} [Sun Aug 7 10:42:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:14.130504 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fa88c-0d20-4cca-8b82-0ebf24e539e2 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:14.130782 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fa88c-0d20-4cca-8b82-0ebf24e539e2 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:14.131294 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fa88c-0d20-4cca-8b82-0ebf24e539e2 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:14.133520 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 302/595] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:14.134255 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fa88c-0d20-4cca-8b82-0ebf24e539e2 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:14.139066 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c205df-ffeb-4a3f-9cb9-eda2abe75614 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:14.174996 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3883aad-11ee-482b-ae24-264a9906538c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:14.175840 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3883aad-11ee-482b-ae24-264a9906538c None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:14.176111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3883aad-11ee-482b-ae24-264a9906538c None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:14.176374 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3883aad-11ee-482b-ae24-264a9906538c None admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:14.177101 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3883aad-11ee-482b-ae24-264a9906538c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:14.177431 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3883aad-11ee-482b-ae24-264a9906538c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:14.178848 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3883aad-11ee-482b-ae24-264a9906538c None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:14.200310 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 294/596] 10.222.0.27 () {56 vars in 1139 bytes} [Sun Aug 7 10:42:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:14.200310 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3883aad-11ee-482b-ae24-264a9906538c None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:14.227493 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:14.252886 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fa88c-0d20-4cca-8b82-0ebf24e539e2 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:14.289888 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110932a5-eef2-4753-8231-c3e472838ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:14.290480 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110932a5-eef2-4753-8231-c3e472838ded None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:14.290753 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110932a5-eef2-4753-8231-c3e472838ded None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:14.291018 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110932a5-eef2-4753-8231-c3e472838ded None admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:14.291705 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110932a5-eef2-4753-8231-c3e472838ded None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:14.292007 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110932a5-eef2-4753-8231-c3e472838ded None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:14.293429 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110932a5-eef2-4753-8231-c3e472838ded None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:14.300756 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3883aad-11ee-482b-ae24-264a9906538c None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:14.309495 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 303/597] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:42:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:14.309495 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e641a92-0a75-40dc-82fa-93bb1995a736 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:14.309495 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e641a92-0a75-40dc-82fa-93bb1995a736 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:14.309495 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e641a92-0a75-40dc-82fa-93bb1995a736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:14.314987 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:14.326940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-2e641a92-0a75-40dc-82fa-93bb1995a736 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:14.328238 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-2e641a92-0a75-40dc-82fa-93bb1995a736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:14.348641 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906aa0ce-01d5-4c24-80ff-e14383b427ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:14.349269 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906aa0ce-01d5-4c24-80ff-e14383b427ed None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:14.349575 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906aa0ce-01d5-4c24-80ff-e14383b427ed None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:14.349837 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906aa0ce-01d5-4c24-80ff-e14383b427ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:14.360373 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906aa0ce-01d5-4c24-80ff-e14383b427ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:14.362029 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906aa0ce-01d5-4c24-80ff-e14383b427ed None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:14.377655 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-906aa0ce-01d5-4c24-80ff-e14383b427ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:14.377655 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:14.377655 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:14.377655 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:14.377655 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:14.377655 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:14.377655 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:14.377655 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:14.377655 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:14.377655 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:14.377655 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:14.377655 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:14.377655 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:14.377655 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:14.377655 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:14.377655 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:14.378630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:14.378630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:14.378630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:14.378630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:14.378630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:14.378630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:14.378630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:14.378630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:14.378630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:14.378630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:14.378630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:14.378630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:14.378630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:14.378630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:14.378630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:14.378630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:14.378630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:14.379679 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:14.379679 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:14.379679 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:14.379679 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 295/598] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:14.379679 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906aa0ce-01d5-4c24-80ff-e14383b427ed None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:14.406284 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 304/599] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:42:14.407334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e641a92-0a75-40dc-82fa-93bb1995a736 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:14.474425 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:14.501265 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906aa0ce-01d5-4c24-80ff-e14383b427ed None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:14.510658 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e641a92-0a75-40dc-82fa-93bb1995a736 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:14.536685 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccba8f-bffd-4446-9159-b055572a1856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:14.537304 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccba8f-bffd-4446-9159-b055572a1856 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:14.537605 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccba8f-bffd-4446-9159-b055572a1856 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:14.537869 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccba8f-bffd-4446-9159-b055572a1856 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:14.546366 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f858b86-135a-4b2c-be44-e11844e2b9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:14.547016 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f858b86-135a-4b2c-be44-e11844e2b9de None admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:14.547517 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f858b86-135a-4b2c-be44-e11844e2b9de None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:14.547638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f858b86-135a-4b2c-be44-e11844e2b9de None admin] PATH_INFO: `/v3/projects/62eed8550ae3403f8a75894dbd19cf4a/users/c5fca18c4ee74043a5acc9aeb297c9c7/roles/bf9e51dafeac420f89a66e78e1463982` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:14.549918 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eccba8f-bffd-4446-9159-b055572a1856 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:14.551367 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eccba8f-bffd-4446-9159-b055572a1856 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:14.563247 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f858b86-135a-4b2c-be44-e11844e2b9de None admin] RBAC: Authorizing `identity:create_grant(project_id=62eed8550ae3403f8a75894dbd19cf4a, user_id=c5fca18c4ee74043a5acc9aeb297c9c7, role_id=bf9e51dafeac420f89a66e78e1463982)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:14.564764 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f858b86-135a-4b2c-be44-e11844e2b9de None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:14.565565 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-7eccba8f-bffd-4446-9159-b055572a1856 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:14.565565 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:14.565565 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:14.565565 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:14.565565 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:14.565565 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:14.565565 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:14.565565 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:14.565565 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:14.565565 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:14.565565 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:14.565565 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:14.565565 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:14.565565 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:14.565565 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:14.565565 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:14.566472 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:14.566472 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:14.566472 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:14.566472 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:14.566472 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:14.566472 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:14.566472 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:14.566472 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:14.566472 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:14.566472 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:14.566472 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:14.566472 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:14.566472 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:14.566472 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:14.566472 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:14.566472 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:14.566472 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:14.567361 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:14.567361 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:14.567361 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:14.567361 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 296/600] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:14.567990 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccba8f-bffd-4446-9159-b055572a1856 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:14.585734 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:14.586231 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 305/601] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 7 10:42:14 2022] PUT /identity/v3/projects/62eed8550ae3403f8a75894dbd19cf4a/users/c5fca18c4ee74043a5acc9aeb297c9c7/roles/bf9e51dafeac420f89a66e78e1463982 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:42:14.592891 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f858b86-135a-4b2c-be44-e11844e2b9de None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:14.707468 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccba8f-bffd-4446-9159-b055572a1856 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:14.731170 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f858b86-135a-4b2c-be44-e11844e2b9de None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:14.748830 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773087ce-d20e-4ed6-9cbc-fb75306f9f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:14.749771 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773087ce-d20e-4ed6-9cbc-fb75306f9f36 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:14.750191 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773087ce-d20e-4ed6-9cbc-fb75306f9f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:14.751429 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773087ce-d20e-4ed6-9cbc-fb75306f9f36 None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:14.752291 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773087ce-d20e-4ed6-9cbc-fb75306f9f36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:14.752789 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773087ce-d20e-4ed6-9cbc-fb75306f9f36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:14.754465 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773087ce-d20e-4ed6-9cbc-fb75306f9f36 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:14.755958 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:14.772265 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 297/602] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:14.773431 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773087ce-d20e-4ed6-9cbc-fb75306f9f36 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:14.781359 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c644b-6264-4ec9-b132-6a0a09323d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:14.781889 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c644b-6264-4ec9-b132-6a0a09323d35 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:14.782198 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c644b-6264-4ec9-b132-6a0a09323d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:14.782664 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c644b-6264-4ec9-b132-6a0a09323d35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:14.798608 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c644b-6264-4ec9-b132-6a0a09323d35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:42:14.804668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-b89c644b-6264-4ec9-b132-6a0a09323d35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:14.804668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:14.804668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:14.804668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:14.804668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:14.804668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:14.804668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:14.804668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:14.804668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:14.804668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:14.804668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:14.804668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:14.804668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:42:14.804668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:42:14.804668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:42:14.804668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:42:14.805900 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:42:14.805900 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:42:14.805900 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:42:14.805900 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:42:14.805900 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:14.805900 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:14.805900 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:14.805900 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:14.805900 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:14.805900 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:14.805900 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:14.805900 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:14.805900 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:14.805900 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:14.805900 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:14.805900 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:14.806949 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:14.806949 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:14.806949 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:14.806949 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:14.806949 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:42:14.806949 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:42:14.806949 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:42:14.806949 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:42:14.806949 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:42:14.806949 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:42:14.806949 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:14.806949 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:14.807700 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 306/603] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 7 10:42:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:14.808762 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c644b-6264-4ec9-b132-6a0a09323d35 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:14.867924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:14.897936 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773087ce-d20e-4ed6-9cbc-fb75306f9f36 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:14.933128 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c644b-6264-4ec9-b132-6a0a09323d35 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:14.944968 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b41b3-0b5f-4afb-b9c1-72e313c29ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:14.945773 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b41b3-0b5f-4afb-b9c1-72e313c29ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:14.946146 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b41b3-0b5f-4afb-b9c1-72e313c29ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:14.946518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b41b3-0b5f-4afb-b9c1-72e313c29ac8 None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:14.947388 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b41b3-0b5f-4afb-b9c1-72e313c29ac8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:14.947814 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b41b3-0b5f-4afb-b9c1-72e313c29ac8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:14.949966 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b41b3-0b5f-4afb-b9c1-72e313c29ac8 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:14.965631 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 298/604] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:14.966504 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b41b3-0b5f-4afb-b9c1-72e313c29ac8 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:14.977192 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca131ca8-ee75-4164-8dd6-cfc9129beede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:14.978404 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca131ca8-ee75-4164-8dd6-cfc9129beede None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:14.978842 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca131ca8-ee75-4164-8dd6-cfc9129beede None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:14.979280 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca131ca8-ee75-4164-8dd6-cfc9129beede None admin] PATH_INFO: `/v3/projects/service` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:14.987945 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca131ca8-ee75-4164-8dd6-cfc9129beede None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:14.990339 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca131ca8-ee75-4164-8dd6-cfc9129beede None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:15.004414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-ca131ca8-ee75-4164-8dd6-cfc9129beede None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:15.004414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:15.004414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:15.004414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:15.004414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:15.004414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:15.004414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:15.004414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:15.004414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:15.004414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:15.004414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:15.004414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:15.004414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:42:15.004414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:42:15.004414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:42:15.005520 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:42:15.005520 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:15.005520 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:15.005520 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:15.005520 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:15.005520 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:15.005520 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:15.005520 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:15.005520 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:15.005520 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:15.005520 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:15.005520 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:15.005520 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:15.005520 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:15.005520 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:15.005520 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:15.005520 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:15.006596 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:42:15.006596 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:42:15.006596 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:42:15.006596 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:42:15.006596 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:42:15.006596 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:42:15.006596 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:15.006596 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:15.012922 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 307/605] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:15.013980 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca131ca8-ee75-4164-8dd6-cfc9129beede None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:15.059684 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:15.092603 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b41b3-0b5f-4afb-b9c1-72e313c29ac8 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:15.130335 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca131ca8-ee75-4164-8dd6-cfc9129beede None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:15.135265 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98db27-be3b-4b08-a602-f35eefd4d130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:15.135989 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98db27-be3b-4b08-a602-f35eefd4d130 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:15.136362 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98db27-be3b-4b08-a602-f35eefd4d130 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:15.136724 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98db27-be3b-4b08-a602-f35eefd4d130 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:15.137517 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98db27-be3b-4b08-a602-f35eefd4d130 None admin] RBAC: Adding query filter params (name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:15.137909 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98db27-be3b-4b08-a602-f35eefd4d130 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:15.139352 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98db27-be3b-4b08-a602-f35eefd4d130 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:15.140847 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:15.151781 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 299/606] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 7 10:42:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:15.153019 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98db27-be3b-4b08-a602-f35eefd4d130 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:15.173629 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a82d82-4d27-404e-8406-5b29ddec14b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:15.174535 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a82d82-4d27-404e-8406-5b29ddec14b7 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:15.175052 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a82d82-4d27-404e-8406-5b29ddec14b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:15.175493 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a82d82-4d27-404e-8406-5b29ddec14b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:15.183425 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a82d82-4d27-404e-8406-5b29ddec14b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:15.185411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a82d82-4d27-404e-8406-5b29ddec14b7 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:15.198008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-e7a82d82-4d27-404e-8406-5b29ddec14b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:15.198008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:15.198008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:15.198008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:15.198008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:15.198008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:15.198008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:15.198008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:15.198008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:15.198008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:15.198008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:15.198008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:15.198008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:42:15.198008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:42:15.198008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:42:15.199055 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:42:15.199055 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:15.199055 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:15.199055 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:15.199055 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:15.199055 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:15.199055 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:15.199055 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:15.199055 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:15.199055 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:15.199055 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:15.199055 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:15.199055 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:15.199055 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:15.199055 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:15.199055 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:15.199055 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:15.200157 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:42:15.200157 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:42:15.200157 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:42:15.200157 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:42:15.200157 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:42:15.200157 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:42:15.200157 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:15.200157 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:15.202043 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 308/607] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:15.203060 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a82d82-4d27-404e-8406-5b29ddec14b7 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:15.275803 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98db27-be3b-4b08-a602-f35eefd4d130 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:15.308734 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:15.314985 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a82d82-4d27-404e-8406-5b29ddec14b7 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:15.317681 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b24da3-31d1-4bee-8922-5a3c9592ba4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:15.319190 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b24da3-31d1-4bee-8922-5a3c9592ba4d None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:15.319567 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b24da3-31d1-4bee-8922-5a3c9592ba4d None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:15.319931 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b24da3-31d1-4bee-8922-5a3c9592ba4d None admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:15.320726 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b24da3-31d1-4bee-8922-5a3c9592ba4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:15.321125 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b24da3-31d1-4bee-8922-5a3c9592ba4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:15.322665 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b24da3-31d1-4bee-8922-5a3c9592ba4d None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:15.342211 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 300/608] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:42:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:15.342211 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b24da3-31d1-4bee-8922-5a3c9592ba4d None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:15.364857 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a8bfc-ef44-49a8-abb7-efa7ad48d9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:15.365732 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a8bfc-ef44-49a8-abb7-efa7ad48d9c2 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:15.366227 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a8bfc-ef44-49a8-abb7-efa7ad48d9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:15.366820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a8bfc-ef44-49a8-abb7-efa7ad48d9c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:15.379465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a8bfc-ef44-49a8-abb7-efa7ad48d9c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:15.381290 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a8bfc-ef44-49a8-abb7-efa7ad48d9c2 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:15.397481 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-681a8bfc-ef44-49a8-abb7-efa7ad48d9c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:15.397481 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:15.397481 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:15.397481 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:15.397481 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:15.397481 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:15.397481 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:15.397481 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:15.397481 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:15.397481 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:15.397481 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:15.397481 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:15.397481 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:15.397481 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:15.397481 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:15.397481 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:15.398630 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:15.398630 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:15.398630 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:15.398630 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:15.398630 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:15.398630 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:15.398630 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:15.398630 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:15.398630 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:15.398630 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:15.398630 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:15.398630 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:15.398630 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:15.398630 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:15.398630 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:15.398630 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:15.398630 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:15.399725 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:15.399725 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:15.399725 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:15.401627 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 309/609] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:15.402580 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a8bfc-ef44-49a8-abb7-efa7ad48d9c2 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:15.412357 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:15.466963 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b24da3-31d1-4bee-8922-5a3c9592ba4d None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:15.513439 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb11334-272b-4359-9f59-f971ecdffe3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:15.514208 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb11334-272b-4359-9f59-f971ecdffe3c None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:15.514578 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb11334-272b-4359-9f59-f971ecdffe3c None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:15.514942 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb11334-272b-4359-9f59-f971ecdffe3c None admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:15.515724 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb11334-272b-4359-9f59-f971ecdffe3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:15.515989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a8bfc-ef44-49a8-abb7-efa7ad48d9c2 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:15.516207 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb11334-272b-4359-9f59-f971ecdffe3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:15.518283 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb11334-272b-4359-9f59-f971ecdffe3c None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:15.533482 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 301/610] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:42:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:15.534388 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb11334-272b-4359-9f59-f971ecdffe3c None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:15.554343 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250247c6-dd35-46dc-9453-7f5a4414b51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:15.555308 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250247c6-dd35-46dc-9453-7f5a4414b51c None admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:15.555941 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250247c6-dd35-46dc-9453-7f5a4414b51c None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:15.556539 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250247c6-dd35-46dc-9453-7f5a4414b51c None admin] PATH_INFO: `/v3/projects/62eed8550ae3403f8a75894dbd19cf4a/users/a462a891b30847c0aeadbd697652011a/roles/bf9e51dafeac420f89a66e78e1463982` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:15.573643 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250247c6-dd35-46dc-9453-7f5a4414b51c None admin] RBAC: Authorizing `identity:create_grant(project_id=62eed8550ae3403f8a75894dbd19cf4a, user_id=a462a891b30847c0aeadbd697652011a, role_id=bf9e51dafeac420f89a66e78e1463982)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:15.575554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250247c6-dd35-46dc-9453-7f5a4414b51c None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:15.588188 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:15.600427 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 310/611] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 7 10:42:15 2022] PUT /identity/v3/projects/62eed8550ae3403f8a75894dbd19cf4a/users/a462a891b30847c0aeadbd697652011a/roles/bf9e51dafeac420f89a66e78e1463982 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:42:15.601708 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250247c6-dd35-46dc-9453-7f5a4414b51c None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:15.650314 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb11334-272b-4359-9f59-f971ecdffe3c None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:15.669120 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:15.696366 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1d54f-3f5c-4870-8588-62cd6f0f5d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:15.697684 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1d54f-3f5c-4870-8588-62cd6f0f5d4d None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:15.699005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1d54f-3f5c-4870-8588-62cd6f0f5d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:15.699430 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1d54f-3f5c-4870-8588-62cd6f0f5d4d None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:15.701923 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1d54f-3f5c-4870-8588-62cd6f0f5d4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:15.702445 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1d54f-3f5c-4870-8588-62cd6f0f5d4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:15.705773 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf1d54f-3f5c-4870-8588-62cd6f0f5d4d None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:15.732070 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 302/612] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:15.738250 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1d54f-3f5c-4870-8588-62cd6f0f5d4d None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:15.822094 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250247c6-dd35-46dc-9453-7f5a4414b51c None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:15.868169 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef39da1-0019-4a7b-8881-f0e1cc4cd625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:15.869005 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef39da1-0019-4a7b-8881-f0e1cc4cd625 None admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:15.869411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef39da1-0019-4a7b-8881-f0e1cc4cd625 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:15.870037 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef39da1-0019-4a7b-8881-f0e1cc4cd625 None admin] PATH_INFO: `/v3/projects/62eed8550ae3403f8a75894dbd19cf4a/users/9b03428b48264b9da9800283496de2e4/roles/bf9e51dafeac420f89a66e78e1463982` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:15.888439 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef39da1-0019-4a7b-8881-f0e1cc4cd625 None admin] RBAC: Authorizing `identity:create_grant(project_id=62eed8550ae3403f8a75894dbd19cf4a, user_id=9b03428b48264b9da9800283496de2e4, role_id=bf9e51dafeac420f89a66e78e1463982)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:15.890481 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef39da1-0019-4a7b-8881-f0e1cc4cd625 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:15.904510 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1d54f-3f5c-4870-8588-62cd6f0f5d4d None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:15.909431 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 311/613] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 7 10:42:15 2022] PUT /identity/v3/projects/62eed8550ae3403f8a75894dbd19cf4a/users/9b03428b48264b9da9800283496de2e4/roles/bf9e51dafeac420f89a66e78e1463982 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:42:15.945896 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214efe6-2352-4ac7-96e5-651bedb498ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:15.946828 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214efe6-2352-4ac7-96e5-651bedb498ff None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:15.947254 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214efe6-2352-4ac7-96e5-651bedb498ff None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:15.947666 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214efe6-2352-4ac7-96e5-651bedb498ff None admin] PATH_INFO: `/v3/users/swift` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:15.956375 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214efe6-2352-4ac7-96e5-651bedb498ff None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:15.958086 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214efe6-2352-4ac7-96e5-651bedb498ff None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:15.970883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-7214efe6-2352-4ac7-96e5-651bedb498ff None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 10:42:15.970883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:15.970883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:15.970883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:15.970883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:15.970883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:15.970883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:15.970883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:15.970883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:15.970883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:15.970883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:15.970883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:15.970883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:42:15.970883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:42:15.970883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:42:15.970883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:42:15.972654 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:15.972654 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:15.972654 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:42:15.972654 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:15.972654 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:42:15.972654 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:15.972654 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:15.972654 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:15.972654 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:15.972654 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:15.972654 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:15.972654 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:15.972654 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:15.972654 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:15.972654 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:15.972654 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:15.972654 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:15.972654 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:15.974114 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:15.974114 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:15.974114 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:42:15.974114 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:42:15.974114 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:42:15.974114 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:42:15.974114 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:42:15.974114 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:42:15.974114 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 10:42:15.974114 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:15.976452 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 303/614] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:42:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:42:15.982410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef39da1-0019-4a7b-8881-f0e1cc4cd625 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:16.040470 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:16.043593 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07effde-0658-45c6-b46f-c257c28e7186 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:16.044015 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07effde-0658-45c6-b46f-c257c28e7186 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:16.044542 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07effde-0658-45c6-b46f-c257c28e7186 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:16.046951 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 304/615] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:16.058085 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91358d-f071-4c65-bb1b-0ce9b038c9fd None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:16.058390 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91358d-f071-4c65-bb1b-0ce9b038c9fd None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:16.058622 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91358d-f071-4c65-bb1b-0ce9b038c9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:16.082396 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-ef91358d-f071-4c65-bb1b-0ce9b038c9fd None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:16.083578 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ef91358d-f071-4c65-bb1b-0ce9b038c9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:16.121037 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:16.141888 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef39da1-0019-4a7b-8881-f0e1cc4cd625 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:16.174146 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 305/616] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 10:42:16.203009 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91358d-f071-4c65-bb1b-0ce9b038c9fd None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:16.224930 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6158d3-325c-4591-bd93-a7b1cfd6b1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:16.225685 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6158d3-325c-4591-bd93-a7b1cfd6b1ab None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:16.226072 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6158d3-325c-4591-bd93-a7b1cfd6b1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:16.226374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6158d3-325c-4591-bd93-a7b1cfd6b1ab None admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:16.228658 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6158d3-325c-4591-bd93-a7b1cfd6b1ab None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:16.229038 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6158d3-325c-4591-bd93-a7b1cfd6b1ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:16.230867 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6158d3-325c-4591-bd93-a7b1cfd6b1ab None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:16.253973 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 312/617] 10.222.0.27 () {56 vars in 1135 bytes} [Sun Aug 7 10:42:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:16.262784 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6158d3-325c-4591-bd93-a7b1cfd6b1ab None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:16.348175 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91358d-f071-4c65-bb1b-0ce9b038c9fd None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:16.395081 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f79e91-af1f-4357-af1a-e53f7e8e177a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:16.395848 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f79e91-af1f-4357-af1a-e53f7e8e177a None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:16.397254 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f79e91-af1f-4357-af1a-e53f7e8e177a None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:16.397254 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f79e91-af1f-4357-af1a-e53f7e8e177a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:16.409805 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f79e91-af1f-4357-af1a-e53f7e8e177a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:42:16.416251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-89f79e91-af1f-4357-af1a-e53f7e8e177a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:16.416251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:16.416251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:16.416251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:16.416251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:16.416251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:16.416251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:16.416251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:16.416251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:16.416251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:16.416251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:16.416251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:16.416251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:42:16.416251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:42:16.416251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:42:16.416251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:42:16.417191 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:42:16.417191 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:42:16.417191 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:42:16.417191 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:42:16.417191 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:16.417191 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:16.417191 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:16.417191 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:16.417191 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:16.417191 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:16.417191 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:16.417191 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:16.417191 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:16.417191 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:16.417191 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:16.417191 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:16.418526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:16.418526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:16.418526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:16.418526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:16.418526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:42:16.418526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:42:16.418526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:42:16.418526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:42:16.418526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:42:16.418526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:42:16.418526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:16.418526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:16.418526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 306/618] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 7 10:42:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:42:16.423632 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f79e91-af1f-4357-af1a-e53f7e8e177a None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:16.423908 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6158d3-325c-4591-bd93-a7b1cfd6b1ab None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:16.436407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:16.459122 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:16.477233 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6a21e-10ed-4355-8503-82ec8d913cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:16.478017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6a21e-10ed-4355-8503-82ec8d913cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:16.478392 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6a21e-10ed-4355-8503-82ec8d913cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:16.478759 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6a21e-10ed-4355-8503-82ec8d913cd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:16.510175 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6a21e-10ed-4355-8503-82ec8d913cd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:16.511794 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6a21e-10ed-4355-8503-82ec8d913cd7 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:16.547800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-9ec6a21e-10ed-4355-8503-82ec8d913cd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:16.547800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:16.547800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:16.547800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:16.547800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:16.547800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:16.547800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:16.547800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:16.547800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:16.547800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:16.547800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:16.547800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:16.547800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:16.547800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:16.547800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:16.547800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:16.548940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:16.548940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:16.548940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:16.548940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:16.548940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:16.548940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:16.548940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:16.548940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:16.548940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:16.548940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:16.548940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:16.548940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:16.548940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:16.548940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:16.548940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:16.548940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:16.548940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:16.550024 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:16.550024 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:16.550024 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:16.550024 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 313/619] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:16.550756 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f79e91-af1f-4357-af1a-e53f7e8e177a None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:16.555475 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6a21e-10ed-4355-8503-82ec8d913cd7 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:16.591371 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d9f79-e4d4-401f-9abb-4cc5f5728a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:16.592343 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d9f79-e4d4-401f-9abb-4cc5f5728a9b None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:16.593110 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d9f79-e4d4-401f-9abb-4cc5f5728a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:16.593595 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d9f79-e4d4-401f-9abb-4cc5f5728a9b None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:16.594503 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d9f79-e4d4-401f-9abb-4cc5f5728a9b None admin] RBAC: Adding query filter params (name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:16.596013 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d9f79-e4d4-401f-9abb-4cc5f5728a9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:16.597730 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d9f79-e4d4-401f-9abb-4cc5f5728a9b None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:16.608372 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 307/620] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 7 10:42:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:16.614322 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d9f79-e4d4-401f-9abb-4cc5f5728a9b None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:16.762915 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:16.766508 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6a21e-10ed-4355-8503-82ec8d913cd7 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:16.783512 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d9f79-e4d4-401f-9abb-4cc5f5728a9b None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:16.818203 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1a3dc-1c76-4715-9223-98ca04d31ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:16.818811 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1a3dc-1c76-4715-9223-98ca04d31ddb None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:16.820906 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1a3dc-1c76-4715-9223-98ca04d31ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:16.821195 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1a3dc-1c76-4715-9223-98ca04d31ddb None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:16.821880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1a3dc-1c76-4715-9223-98ca04d31ddb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:16.822180 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1a3dc-1c76-4715-9223-98ca04d31ddb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:16.823565 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1a3dc-1c76-4715-9223-98ca04d31ddb None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:16.847195 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 314/621] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:16.848410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086833d-aeeb-4427-85f8-fe5d4fabd115 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:16.848708 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086833d-aeeb-4427-85f8-fe5d4fabd115 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:16.848900 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086833d-aeeb-4427-85f8-fe5d4fabd115 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:16.850969 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 315/622] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:16.851585 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086833d-aeeb-4427-85f8-fe5d4fabd115 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:16.867406 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c360218-eab3-42b0-a555-c2335df18a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:16.869188 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c360218-eab3-42b0-a555-c2335df18a4c None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:16.869188 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c360218-eab3-42b0-a555-c2335df18a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:16.869188 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c360218-eab3-42b0-a555-c2335df18a4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:16.877006 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:16.906552 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c360218-eab3-42b0-a555-c2335df18a4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:16.906552 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c360218-eab3-42b0-a555-c2335df18a4c None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:16.941339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-5c360218-eab3-42b0-a555-c2335df18a4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:16.941339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:16.941339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:16.941339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:16.941339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:16.941339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:16.941339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:16.941339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:16.941339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:16.941339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:16.941339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:16.941339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:16.941339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:16.941339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:16.941339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:16.941339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:16.942478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:16.942478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:16.942478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:16.942478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:16.942478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:16.942478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:16.942478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:16.942478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:16.942478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:16.942478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:16.942478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:16.942478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:16.942478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:16.942478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:16.942478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:16.942478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:16.942478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:16.943552 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:16.943552 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:16.943552 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:16.946435 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 308/623] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:16.948176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5498e-2f1d-49e8-ae93-40540ec7bb55 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:16.948176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5498e-2f1d-49e8-ae93-40540ec7bb55 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:16.948176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5498e-2f1d-49e8-ae93-40540ec7bb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:16.973610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086833d-aeeb-4427-85f8-fe5d4fabd115 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:16.977223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-fdf5498e-2f1d-49e8-ae93-40540ec7bb55 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:16.978989 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-fdf5498e-2f1d-49e8-ae93-40540ec7bb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:17.011498 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ed531-a835-4b12-87ae-3923f6428919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:17.012221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ed531-a835-4b12-87ae-3923f6428919 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:17.012590 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ed531-a835-4b12-87ae-3923f6428919 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:17.012927 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ed531-a835-4b12-87ae-3923f6428919 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:17.021142 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ed531-a835-4b12-87ae-3923f6428919 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:17.022596 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ed531-a835-4b12-87ae-3923f6428919 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:17.036435 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-611ed531-a835-4b12-87ae-3923f6428919 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:17.036435 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:17.036435 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:17.036435 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:17.036435 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:17.036435 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:17.036435 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:17.036435 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:17.036435 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:17.036435 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:17.036435 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:17.036435 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:17.036435 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:42:17.036435 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:42:17.036435 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:42:17.037428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:42:17.037428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:17.037428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:17.037428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:17.037428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:17.037428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:17.037428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:17.037428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:17.037428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:17.037428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:17.037428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:17.037428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:17.037428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:17.037428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:17.037428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:17.037428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:17.037428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:17.038323 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:42:17.038323 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:42:17.038323 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:42:17.038323 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:42:17.038323 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:42:17.038323 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:42:17.038323 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:17.038323 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:17.042440 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 316/624] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:17.043287 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ed531-a835-4b12-87ae-3923f6428919 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:17.069409 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 309/625] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:42:17.070337 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5498e-2f1d-49e8-ae93-40540ec7bb55 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:17.160971 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:17.180854 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:17.196701 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5498e-2f1d-49e8-ae93-40540ec7bb55 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:17.205729 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ed531-a835-4b12-87ae-3923f6428919 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:17.248797 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e730e4-3071-4d19-b5a8-bf861d9fefe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:17.254343 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e730e4-3071-4d19-b5a8-bf861d9fefe4 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:17.254343 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e730e4-3071-4d19-b5a8-bf861d9fefe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:17.254343 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e730e4-3071-4d19-b5a8-bf861d9fefe4 None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:17.254343 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e730e4-3071-4d19-b5a8-bf861d9fefe4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:17.254343 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e730e4-3071-4d19-b5a8-bf861d9fefe4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:17.254343 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e730e4-3071-4d19-b5a8-bf861d9fefe4 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:17.256698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338cd2d-ee88-4e3e-8ddd-78d288a19135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:17.257604 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338cd2d-ee88-4e3e-8ddd-78d288a19135 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:17.258078 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338cd2d-ee88-4e3e-8ddd-78d288a19135 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:17.258556 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338cd2d-ee88-4e3e-8ddd-78d288a19135 None admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:17.259444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338cd2d-ee88-4e3e-8ddd-78d288a19135 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:17.260037 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338cd2d-ee88-4e3e-8ddd-78d288a19135 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:17.261762 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338cd2d-ee88-4e3e-8ddd-78d288a19135 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:17.268993 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 317/626] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:17.268993 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e730e4-3071-4d19-b5a8-bf861d9fefe4 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:17.279383 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 310/627] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:42:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:17.280488 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338cd2d-ee88-4e3e-8ddd-78d288a19135 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:17.390845 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e730e4-3071-4d19-b5a8-bf861d9fefe4 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:17.414633 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338cd2d-ee88-4e3e-8ddd-78d288a19135 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:17.429944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92024ae8-d3ee-4ab0-af34-116b300133ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:17.430628 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92024ae8-d3ee-4ab0-af34-116b300133ca None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:17.430909 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92024ae8-d3ee-4ab0-af34-116b300133ca None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:17.431180 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92024ae8-d3ee-4ab0-af34-116b300133ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:17.441428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:17.445927 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92024ae8-d3ee-4ab0-af34-116b300133ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:42:17.451067 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:17.452972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-92024ae8-d3ee-4ab0-af34-116b300133ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:17.452972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:17.452972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:17.452972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:17.452972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:17.452972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:17.452972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:17.452972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:17.452972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:17.452972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:17.452972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:17.452972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:17.452972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:42:17.452972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:42:17.452972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:42:17.452972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:42:17.454066 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:42:17.454066 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:42:17.454066 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:42:17.454066 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:42:17.454066 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:17.454066 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:17.454066 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:17.454066 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:17.454066 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:17.454066 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:17.454066 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:17.454066 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:17.454066 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:17.454066 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:17.454066 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:17.454066 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:17.455619 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:17.455619 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:17.455619 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:17.455619 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:17.455619 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:42:17.455619 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:42:17.455619 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:42:17.455619 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:42:17.455619 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:42:17.455619 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:42:17.455619 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:17.455619 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:17.463355 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 318/628] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 7 10:42:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:17.463355 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92024ae8-d3ee-4ab0-af34-116b300133ca None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:17.468011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411a7b1-5b8c-4da6-83c6-00033c355ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:17.468914 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411a7b1-5b8c-4da6-83c6-00033c355ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:17.469508 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411a7b1-5b8c-4da6-83c6-00033c355ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:17.470043 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411a7b1-5b8c-4da6-83c6-00033c355ea0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:17.482471 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5411a7b1-5b8c-4da6-83c6-00033c355ea0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:17.484163 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5411a7b1-5b8c-4da6-83c6-00033c355ea0 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:17.496922 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-5411a7b1-5b8c-4da6-83c6-00033c355ea0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 10:42:17.496922 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:17.496922 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:17.496922 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:17.496922 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:17.496922 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:17.496922 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:17.496922 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:17.496922 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:17.496922 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:17.496922 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:17.496922 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:17.496922 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:42:17.496922 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:42:17.496922 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:42:17.496922 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:42:17.497908 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:17.497908 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:17.497908 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:42:17.497908 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:17.497908 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:42:17.497908 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:17.497908 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:17.497908 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:17.497908 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:17.497908 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:17.497908 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:17.497908 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:17.497908 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:17.497908 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:17.497908 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:17.497908 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:17.497908 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:17.497908 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:17.498844 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:17.498844 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:17.498844 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:42:17.498844 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:42:17.498844 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:42:17.498844 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:42:17.498844 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:42:17.498844 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:42:17.498844 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 10:42:17.498844 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:17.501386 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 311/629] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Aug 7 10:42:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:17.502433 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411a7b1-5b8c-4da6-83c6-00033c355ea0 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:17.580881 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92024ae8-d3ee-4ab0-af34-116b300133ca None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:17.614977 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411a7b1-5b8c-4da6-83c6-00033c355ea0 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:17.618458 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff920915-7b95-4a2d-b51d-46bfb0cd28f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:17.619117 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff920915-7b95-4a2d-b51d-46bfb0cd28f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:17.619395 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff920915-7b95-4a2d-b51d-46bfb0cd28f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:17.619934 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff920915-7b95-4a2d-b51d-46bfb0cd28f5 None admin] PATH_INFO: `/v3/projects/62eed8550ae3403f8a75894dbd19cf4a/users/a7181e5118c547a3a31d2e080c25ff01/roles/bf9e51dafeac420f89a66e78e1463982` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:17.635185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff920915-7b95-4a2d-b51d-46bfb0cd28f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=62eed8550ae3403f8a75894dbd19cf4a, user_id=a7181e5118c547a3a31d2e080c25ff01, role_id=bf9e51dafeac420f89a66e78e1463982)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:17.636672 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff920915-7b95-4a2d-b51d-46bfb0cd28f5 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:17.653120 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 319/630] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 7 10:42:17 2022] PUT /identity/v3/projects/62eed8550ae3403f8a75894dbd19cf4a/users/a7181e5118c547a3a31d2e080c25ff01/roles/bf9e51dafeac420f89a66e78e1463982 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:42:17.653828 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff920915-7b95-4a2d-b51d-46bfb0cd28f5 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:17.654363 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81229a50-d68f-4c59-881f-ffbd362578f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:17.655210 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81229a50-d68f-4c59-881f-ffbd362578f6 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:17.655732 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81229a50-d68f-4c59-881f-ffbd362578f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:17.656201 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81229a50-d68f-4c59-881f-ffbd362578f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:17.658120 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81229a50-d68f-4c59-881f-ffbd362578f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:17.658709 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81229a50-d68f-4c59-881f-ffbd362578f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:17.660384 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81229a50-d68f-4c59-881f-ffbd362578f6 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:17.671300 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 312/631] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 7 10:42:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:17.677015 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81229a50-d68f-4c59-881f-ffbd362578f6 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:17.722310 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:17.766936 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:17.838761 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff920915-7b95-4a2d-b51d-46bfb0cd28f5 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:17.849845 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81229a50-d68f-4c59-881f-ffbd362578f6 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:17.887080 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d21ef-7c3b-4ac9-ae22-88c733eddcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:17.887693 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d21ef-7c3b-4ac9-ae22-88c733eddcbf None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:17.887971 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d21ef-7c3b-4ac9-ae22-88c733eddcbf None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:17.888242 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d21ef-7c3b-4ac9-ae22-88c733eddcbf None admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:17.891087 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d21ef-7c3b-4ac9-ae22-88c733eddcbf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:17.891087 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d21ef-7c3b-4ac9-ae22-88c733eddcbf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:17.893006 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d21ef-7c3b-4ac9-ae22-88c733eddcbf None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:17.906075 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438ad05-6abc-4022-92c0-b7a393590bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:17.907077 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438ad05-6abc-4022-92c0-b7a393590bfa None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:17.907663 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438ad05-6abc-4022-92c0-b7a393590bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:17.908132 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438ad05-6abc-4022-92c0-b7a393590bfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:17.915125 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 320/632] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Aug 7 10:42:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:17.920605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d21ef-7c3b-4ac9-ae22-88c733eddcbf None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:17.922700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438ad05-6abc-4022-92c0-b7a393590bfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:17.924717 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438ad05-6abc-4022-92c0-b7a393590bfa None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:17.944916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-3438ad05-6abc-4022-92c0-b7a393590bfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:17.944916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:17.944916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:17.944916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:17.944916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:17.944916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:17.944916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:17.944916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:17.944916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:17.944916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:17.944916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:17.944916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:17.944916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:17.944916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:17.944916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:17.944916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:17.946005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:17.946005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:17.946005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:17.946005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:17.946005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:17.946005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:17.946005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:17.946005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:17.946005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:17.946005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:17.946005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:17.946005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:17.946005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:17.946005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:17.946005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:17.946005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:17.946005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:17.947098 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:17.947098 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:17.947098 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:17.948928 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 313/633] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:17.956093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438ad05-6abc-4022-92c0-b7a393590bfa None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:18.032078 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d21ef-7c3b-4ac9-ae22-88c733eddcbf None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:18.043517 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:18.070104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a0345-8b9f-4306-ab06-775b73450b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:18.070873 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a0345-8b9f-4306-ab06-775b73450b7d None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:18.071246 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a0345-8b9f-4306-ab06-775b73450b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:18.071649 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a0345-8b9f-4306-ab06-775b73450b7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:18.138131 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438ad05-6abc-4022-92c0-b7a393590bfa None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:18.140613 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:18.145959 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a0345-8b9f-4306-ab06-775b73450b7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:18.147411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0a0345-8b9f-4306-ab06-775b73450b7d None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:18.175328 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807f699-b825-45cc-b14b-30936d5ddf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:18.175988 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807f699-b825-45cc-b14b-30936d5ddf79 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:18.176265 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807f699-b825-45cc-b14b-30936d5ddf79 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:18.176539 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807f699-b825-45cc-b14b-30936d5ddf79 None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:18.177192 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807f699-b825-45cc-b14b-30936d5ddf79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:18.177530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807f699-b825-45cc-b14b-30936d5ddf79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:18.179129 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807f699-b825-45cc-b14b-30936d5ddf79 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:18.193841 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 314/634] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:18.195319 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10239a9d-1106-4a59-8954-a3a47401d032 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:18.195602 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10239a9d-1106-4a59-8954-a3a47401d032 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:18.195874 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10239a9d-1106-4a59-8954-a3a47401d032 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:18.201494 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 315/635] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:18.202449 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10239a9d-1106-4a59-8954-a3a47401d032 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:18.259238 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 321/636] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:42:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:42:18.260590 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be381dca-08eb-4564-8093-d370e3d2a160 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:18.260873 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be381dca-08eb-4564-8093-d370e3d2a160 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:18.261142 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be381dca-08eb-4564-8093-d370e3d2a160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:18.279429 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-be381dca-08eb-4564-8093-d370e3d2a160 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:18.280619 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-be381dca-08eb-4564-8093-d370e3d2a160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:18.282732 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:18.319109 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10239a9d-1106-4a59-8954-a3a47401d032 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:18.357040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a68191-3f43-41b0-8322-2c3e41c64ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:18.358016 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a68191-3f43-41b0-8322-2c3e41c64ace None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:18.358439 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a68191-3f43-41b0-8322-2c3e41c64ace None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:18.358855 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a68191-3f43-41b0-8322-2c3e41c64ace None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:18.367298 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a68191-3f43-41b0-8322-2c3e41c64ace None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:18.373413 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 322/637] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:42:18.373413 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be381dca-08eb-4564-8093-d370e3d2a160 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:18.375724 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a68191-3f43-41b0-8322-2c3e41c64ace None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:18.398055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-15a68191-3f43-41b0-8322-2c3e41c64ace None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 10:42:18.398055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:18.398055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:18.398055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:18.398055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:18.398055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:18.398055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:18.398055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:18.398055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:18.398055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:18.398055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:18.398055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:18.398055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:42:18.398055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:42:18.398055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:42:18.398055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:42:18.399238 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:18.399238 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:18.399238 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:42:18.399238 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:18.399238 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:42:18.399238 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:18.399238 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:18.399238 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:18.399238 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:18.399238 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:18.399238 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:18.399238 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:18.399238 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:18.399238 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:18.399238 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:18.399238 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:18.399238 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:18.399238 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:18.400365 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:18.400365 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:18.400365 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:42:18.400365 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:42:18.400365 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:42:18.400365 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:42:18.400365 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:42:18.400365 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:42:18.400365 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 10:42:18.400365 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:18.402409 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 316/638] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:42:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:18.407972 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a68191-3f43-41b0-8322-2c3e41c64ace None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:18.438806 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:18.471519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be381dca-08eb-4564-8093-d370e3d2a160 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:18.506865 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e414bc-528b-499e-8a66-d0205e8d5ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:18.507680 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e414bc-528b-499e-8a66-d0205e8d5ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:18.507861 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e414bc-528b-499e-8a66-d0205e8d5ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:18.508134 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e414bc-528b-499e-8a66-d0205e8d5ce2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:18.515193 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:18.520648 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e414bc-528b-499e-8a66-d0205e8d5ce2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:18.523109 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e414bc-528b-499e-8a66-d0205e8d5ce2 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:18.523238 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a68191-3f43-41b0-8322-2c3e41c64ace None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:18.540361 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-85e414bc-528b-499e-8a66-d0205e8d5ce2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:18.540361 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:18.540361 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:18.540361 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:18.540361 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:18.540361 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:18.540361 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:18.540361 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:18.540361 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:18.540361 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:18.540361 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:18.540361 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:18.540361 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:18.540361 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:18.540361 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:18.540361 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:18.542010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:18.542010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:18.542010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:18.542010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:18.542010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:18.542010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:18.542010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:18.542010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:18.542010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:18.542010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:18.542010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:18.542010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:18.542010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:18.542010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:18.542010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:18.542010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:18.542010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:18.543426 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:18.543426 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:18.543426 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:18.545936 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 323/639] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:18.546780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e414bc-528b-499e-8a66-d0205e8d5ce2 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:18.564893 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d92074-8cd9-41b5-931d-d23976af4ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:18.565660 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d92074-8cd9-41b5-931d-d23976af4ddc None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:18.566001 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d92074-8cd9-41b5-931d-d23976af4ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:18.566331 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d92074-8cd9-41b5-931d-d23976af4ddc None admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:18.567127 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d92074-8cd9-41b5-931d-d23976af4ddc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:18.567494 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d92074-8cd9-41b5-931d-d23976af4ddc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:18.568993 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d92074-8cd9-41b5-931d-d23976af4ddc None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:18.586847 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 317/640] 10.222.0.27 () {56 vars in 1137 bytes} [Sun Aug 7 10:42:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:18.588175 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33927787-5c7e-4370-8f93-94823189b03c None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:18.588457 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33927787-5c7e-4370-8f93-94823189b03c None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:18.588725 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33927787-5c7e-4370-8f93-94823189b03c None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:18.589936 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 318/641] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:18.590616 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33927787-5c7e-4370-8f93-94823189b03c None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:18.658266 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e414bc-528b-499e-8a66-d0205e8d5ce2 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:18.679966 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:18.694128 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5227b4-238e-4de8-952c-605a6d1f8bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:18.694693 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5227b4-238e-4de8-952c-605a6d1f8bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:18.694972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5227b4-238e-4de8-952c-605a6d1f8bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:18.695243 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5227b4-238e-4de8-952c-605a6d1f8bf0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:18.702160 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33927787-5c7e-4370-8f93-94823189b03c None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:18.705750 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5227b4-238e-4de8-952c-605a6d1f8bf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:42:18.710836 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-ca5227b4-238e-4de8-952c-605a6d1f8bf0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:18.710836 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:18.710836 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:18.710836 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:18.710836 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:18.710836 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:18.710836 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:18.710836 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:18.710836 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:18.710836 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:18.710836 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:18.710836 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:18.710836 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:42:18.710836 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:42:18.710836 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:42:18.710836 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:42:18.711835 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:42:18.711835 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:42:18.711835 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:42:18.711835 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:42:18.711835 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:18.711835 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:18.711835 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:18.711835 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:18.711835 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:18.711835 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:18.711835 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:18.711835 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:18.711835 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:18.711835 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:18.711835 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:18.711835 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:18.712693 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:18.712693 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:18.712693 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:18.712693 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:18.712693 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:42:18.712693 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:42:18.712693 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:42:18.712693 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:42:18.712693 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:42:18.712693 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:42:18.712693 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:18.712693 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:18.712693 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 324/642] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 7 10:42:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:18.712693 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5227b4-238e-4de8-952c-605a6d1f8bf0 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:18.743508 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fdf8b-ff79-4b00-a06e-1d80825c43a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:18.744100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fdf8b-ff79-4b00-a06e-1d80825c43a9 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:18.744372 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fdf8b-ff79-4b00-a06e-1d80825c43a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:18.744903 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fdf8b-ff79-4b00-a06e-1d80825c43a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:18.745572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4fdf8b-ff79-4b00-a06e-1d80825c43a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:18.745985 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4fdf8b-ff79-4b00-a06e-1d80825c43a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:18.747207 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4fdf8b-ff79-4b00-a06e-1d80825c43a9 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:18.762724 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 319/643] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:18.762724 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805884d6-cf94-473b-b59d-039ada19d823 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:18.762724 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805884d6-cf94-473b-b59d-039ada19d823 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:18.762724 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805884d6-cf94-473b-b59d-039ada19d823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:18.774930 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:18.779149 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-805884d6-cf94-473b-b59d-039ada19d823 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:18.780666 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-805884d6-cf94-473b-b59d-039ada19d823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:18.828850 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5227b4-238e-4de8-952c-605a6d1f8bf0 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:18.851947 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 320/644] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:42:18.862303 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805884d6-cf94-473b-b59d-039ada19d823 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:18.868446 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824339a2-639d-434d-bdc6-86d13f649a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:18.869054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824339a2-639d-434d-bdc6-86d13f649a49 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:18.869344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824339a2-639d-434d-bdc6-86d13f649a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:18.869868 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824339a2-639d-434d-bdc6-86d13f649a49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:18.943901 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:18.952963 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824339a2-639d-434d-bdc6-86d13f649a49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:18.954406 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824339a2-639d-434d-bdc6-86d13f649a49 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:18.976990 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805884d6-cf94-473b-b59d-039ada19d823 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:19.005412 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:19.015884 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50e8a9-1d11-42b5-90c1-1331ec6f0399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:19.016492 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50e8a9-1d11-42b5-90c1-1331ec6f0399 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:19.017288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50e8a9-1d11-42b5-90c1-1331ec6f0399 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:19.017596 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50e8a9-1d11-42b5-90c1-1331ec6f0399 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:19.018271 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50e8a9-1d11-42b5-90c1-1331ec6f0399 None admin] RBAC: Adding query filter params (name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:19.018569 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50e8a9-1d11-42b5-90c1-1331ec6f0399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:19.019943 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50e8a9-1d11-42b5-90c1-1331ec6f0399 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:19.029921 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 321/645] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 7 10:42:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:19.030811 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50e8a9-1d11-42b5-90c1-1331ec6f0399 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:19.061365 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 325/646] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:42:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:42:19.062216 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824339a2-639d-434d-bdc6-86d13f649a49 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:19.144751 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50e8a9-1d11-42b5-90c1-1331ec6f0399 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:19.167278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824339a2-639d-434d-bdc6-86d13f649a49 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:19.179460 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0c8cd-f986-4aa9-8147-ad8e4ce3357c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:19.180111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0c8cd-f986-4aa9-8147-ad8e4ce3357c None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:19.180386 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0c8cd-f986-4aa9-8147-ad8e4ce3357c None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:19.180651 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0c8cd-f986-4aa9-8147-ad8e4ce3357c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:19.182608 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:19.188469 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e0c8cd-f986-4aa9-8147-ad8e4ce3357c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:19.190226 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e0c8cd-f986-4aa9-8147-ad8e4ce3357c None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:19.201407 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-64e0c8cd-f986-4aa9-8147-ad8e4ce3357c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:19.201407 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:19.201407 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:19.201407 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:19.201407 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:19.201407 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:19.201407 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:19.201407 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:19.201407 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:19.201407 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:19.201407 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:19.201407 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:19.201407 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:42:19.201407 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:42:19.201407 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:42:19.202462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:42:19.202462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:19.202462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:19.202462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:19.202462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:19.202462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:19.202462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:19.202462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:19.202462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:19.202462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:19.202462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:19.202462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:19.202462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:19.202462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:19.202462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:19.202462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:19.202462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:19.203487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:42:19.203487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:42:19.203487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:42:19.203487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:42:19.203487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:42:19.203487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:42:19.203487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:19.203487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:19.203487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 322/647] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:19.203487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0c8cd-f986-4aa9-8147-ad8e4ce3357c None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:19.210746 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d40c7-44a2-46af-88c3-9d258a9240db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:19.211370 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d40c7-44a2-46af-88c3-9d258a9240db None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:19.211644 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d40c7-44a2-46af-88c3-9d258a9240db None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:19.211911 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d40c7-44a2-46af-88c3-9d258a9240db None admin] PATH_INFO: `/v3/roles/service` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:19.222532 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d40c7-44a2-46af-88c3-9d258a9240db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:42:19.227486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-734d40c7-44a2-46af-88c3-9d258a9240db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:19.227486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:19.227486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:19.227486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:19.227486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:19.227486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:19.227486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:19.227486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:19.227486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:19.227486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:19.227486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:19.227486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:19.227486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:42:19.227486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:42:19.227486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:42:19.227486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:42:19.228387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:42:19.228387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:42:19.228387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:42:19.228387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:42:19.228387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:19.228387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:19.228387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:19.228387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:19.228387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:19.228387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:19.228387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:19.228387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:19.228387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:19.228387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:19.228387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:19.228387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:19.229223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:19.229223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:19.229223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:19.229223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:19.229223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:42:19.229223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:42:19.229223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:42:19.229223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:42:19.229223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:42:19.229223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:42:19.229223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:19.229223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:19.229223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 326/648] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 7 10:42:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:19.229958 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d40c7-44a2-46af-88c3-9d258a9240db None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:19.242418 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:19.319776 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0c8cd-f986-4aa9-8147-ad8e4ce3357c None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:19.335222 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d40c7-44a2-46af-88c3-9d258a9240db None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:19.361212 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51a269-eb47-4b6a-a6e5-b74f8d730b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:19.361877 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51a269-eb47-4b6a-a6e5-b74f8d730b84 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:19.362270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51a269-eb47-4b6a-a6e5-b74f8d730b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:19.362545 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51a269-eb47-4b6a-a6e5-b74f8d730b84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:19.370836 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827c130-9598-43ef-93bc-8d14b7075e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:19.371842 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827c130-9598-43ef-93bc-8d14b7075e64 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:19.372130 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827c130-9598-43ef-93bc-8d14b7075e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:19.372401 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827c130-9598-43ef-93bc-8d14b7075e64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:19.373491 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a51a269-eb47-4b6a-a6e5-b74f8d730b84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:19.375265 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a51a269-eb47-4b6a-a6e5-b74f8d730b84 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:19.383575 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827c130-9598-43ef-93bc-8d14b7075e64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:19.384996 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827c130-9598-43ef-93bc-8d14b7075e64 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:19.390533 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-2a51a269-eb47-4b6a-a6e5-b74f8d730b84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:19.390533 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:19.390533 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:19.390533 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:19.390533 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:19.390533 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:19.390533 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:19.390533 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:19.390533 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:19.390533 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:19.390533 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:19.390533 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:19.390533 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:19.390533 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:19.390533 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:19.390533 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:19.391449 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:19.391449 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:19.391449 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:19.391449 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:19.391449 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:19.391449 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:19.391449 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:19.391449 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:19.391449 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:19.391449 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:19.391449 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:19.391449 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:19.391449 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:19.391449 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:19.391449 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:19.391449 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:19.391449 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:19.392591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:19.392591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:19.392591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:19.392591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 323/649] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:19.392591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51a269-eb47-4b6a-a6e5-b74f8d730b84 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:19.403860 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-5827c130-9598-43ef-93bc-8d14b7075e64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:19.403860 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:19.403860 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:19.403860 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:19.403860 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:19.403860 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:19.403860 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:19.403860 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:19.403860 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:19.403860 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:19.403860 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:19.403860 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:19.403860 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:19.403860 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:19.403860 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:19.403860 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:19.404808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:19.404808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:19.404808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:19.404808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:19.404808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:19.404808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:19.404808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:19.404808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:19.404808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:19.404808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:19.404808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:19.404808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:19.404808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:19.404808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:19.404808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:19.404808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:19.404808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:19.405766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:19.405766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:19.405766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:19.409915 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 327/650] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:19.410907 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827c130-9598-43ef-93bc-8d14b7075e64 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:19.443306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:19.473580 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:19.500761 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51a269-eb47-4b6a-a6e5-b74f8d730b84 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:19.515209 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827c130-9598-43ef-93bc-8d14b7075e64 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:19.536244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c569d4f-ed91-4be8-98a6-0931eced28ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:19.537491 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c569d4f-ed91-4be8-98a6-0931eced28ba None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:19.537916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c569d4f-ed91-4be8-98a6-0931eced28ba None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:19.538308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c569d4f-ed91-4be8-98a6-0931eced28ba None admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:19.539030 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c569d4f-ed91-4be8-98a6-0931eced28ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:19.539456 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c569d4f-ed91-4be8-98a6-0931eced28ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:19.541239 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c569d4f-ed91-4be8-98a6-0931eced28ba None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:19.551152 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc3e28-19b2-4f0f-a229-d34a6c473b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:19.551811 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc3e28-19b2-4f0f-a229-d34a6c473b33 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:19.552093 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc3e28-19b2-4f0f-a229-d34a6c473b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:19.552365 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc3e28-19b2-4f0f-a229-d34a6c473b33 None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:19.553028 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc3e28-19b2-4f0f-a229-d34a6c473b33 None admin] RBAC: Adding query filter params (name=service) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:19.553347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc3e28-19b2-4f0f-a229-d34a6c473b33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:19.559239 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 324/651] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:42:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:19.559373 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc3e28-19b2-4f0f-a229-d34a6c473b33 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:19.559466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c569d4f-ed91-4be8-98a6-0931eced28ba None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:19.572974 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 328/652] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 7 10:42:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:19.572974 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc3e28-19b2-4f0f-a229-d34a6c473b33 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:19.671733 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c569d4f-ed91-4be8-98a6-0931eced28ba None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:19.675264 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc3e28-19b2-4f0f-a229-d34a6c473b33 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:19.679511 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:19.701927 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:19.710779 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff823e-d249-4247-a8b3-4f3a5232d068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:19.711381 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff823e-d249-4247-a8b3-4f3a5232d068 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:19.711662 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff823e-d249-4247-a8b3-4f3a5232d068 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:19.711932 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff823e-d249-4247-a8b3-4f3a5232d068 None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:19.712578 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff823e-d249-4247-a8b3-4f3a5232d068 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:19.712880 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff823e-d249-4247-a8b3-4f3a5232d068 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:19.713912 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b562763-08c5-4ec7-8ee2-04eabf9d2cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:19.714274 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff823e-d249-4247-a8b3-4f3a5232d068 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:19.714511 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b562763-08c5-4ec7-8ee2-04eabf9d2cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:19.714787 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b562763-08c5-4ec7-8ee2-04eabf9d2cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:19.715054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b562763-08c5-4ec7-8ee2-04eabf9d2cb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:19.715690 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b562763-08c5-4ec7-8ee2-04eabf9d2cb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:19.715987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b562763-08c5-4ec7-8ee2-04eabf9d2cb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:19.717339 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b562763-08c5-4ec7-8ee2-04eabf9d2cb2 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:19.730027 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 325/653] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:19.730027 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff823e-d249-4247-a8b3-4f3a5232d068 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:19.733930 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 329/654] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:19.737466 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b562763-08c5-4ec7-8ee2-04eabf9d2cb2 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:19.835567 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff823e-d249-4247-a8b3-4f3a5232d068 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:19.841751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b562763-08c5-4ec7-8ee2-04eabf9d2cb2 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:19.871273 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12666591-824b-414c-a18a-1d5075e813a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:19.871884 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12666591-824b-414c-a18a-1d5075e813a6 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:19.872159 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12666591-824b-414c-a18a-1d5075e813a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:19.872425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12666591-824b-414c-a18a-1d5075e813a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:19.873214 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12666591-824b-414c-a18a-1d5075e813a6 None admin] RBAC: Adding query filter params (role.id=bf9e51dafeac420f89a66e78e1463982, scope.project.id=62eed8550ae3403f8a75894dbd19cf4a, user.id=f98cb7abbb8942cebb71aa98da80a05a) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:19.873524 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12666591-824b-414c-a18a-1d5075e813a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:19.874940 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12666591-824b-414c-a18a-1d5075e813a6 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:19.877590 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51431399-ae29-4747-8a48-8827628edbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:19.878375 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51431399-ae29-4747-8a48-8827628edbf7 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:19.878800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51431399-ae29-4747-8a48-8827628edbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:19.879228 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51431399-ae29-4747-8a48-8827628edbf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:19.880884 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 326/655] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:42:19 2022] GET /identity/v3/role_assignments?user.id=f98cb7abbb8942cebb71aa98da80a05a&scope.project.id=62eed8550ae3403f8a75894dbd19cf4a&role.id=bf9e51dafeac420f89a66e78e1463982 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:19.881698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12666591-824b-414c-a18a-1d5075e813a6 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:19.900803 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51431399-ae29-4747-8a48-8827628edbf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:19.902667 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51431399-ae29-4747-8a48-8827628edbf7 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:19.920871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-51431399-ae29-4747-8a48-8827628edbf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:19.920871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:19.920871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:19.920871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:19.920871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:19.920871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:19.920871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:19.920871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:19.920871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:19.920871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:19.920871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:19.920871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:19.920871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:19.920871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:19.920871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:19.920871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:19.922102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:19.922102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:19.922102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:19.922102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:19.922102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:19.922102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:19.922102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:19.922102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:19.922102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:19.922102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:19.922102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:19.922102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:19.922102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:19.922102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:19.922102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:19.922102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:19.922102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:19.923698 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:19.923698 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:19.923698 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:19.924697 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:19.926055 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 330/656] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:19.927087 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51431399-ae29-4747-8a48-8827628edbf7 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:19.967162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:20.020497 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12666591-824b-414c-a18a-1d5075e813a6 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:20.043499 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51431399-ae29-4747-8a48-8827628edbf7 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:20.066121 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e162870-7941-4a4a-b32b-4d140d116262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:20.067604 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e162870-7941-4a4a-b32b-4d140d116262 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:20.067604 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e162870-7941-4a4a-b32b-4d140d116262 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:20.067793 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e162870-7941-4a4a-b32b-4d140d116262 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:20.078428 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e162870-7941-4a4a-b32b-4d140d116262 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:20.080463 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e162870-7941-4a4a-b32b-4d140d116262 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:20.084456 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e12a84-6bbf-44f1-b5a8-211ed4cfcfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:20.085692 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e12a84-6bbf-44f1-b5a8-211ed4cfcfe3 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:20.085976 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e12a84-6bbf-44f1-b5a8-211ed4cfcfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:20.086249 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e12a84-6bbf-44f1-b5a8-211ed4cfcfe3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:20.091747 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-2e162870-7941-4a4a-b32b-4d140d116262 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 07 10:42:20.091747 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:20.091747 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:20.091747 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:20.091747 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:20.091747 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:20.091747 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:20.091747 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:20.091747 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:20.091747 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:20.091747 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:20.091747 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:20.091747 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:42:20.091747 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:42:20.091747 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:42:20.091747 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:42:20.092683 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:20.092683 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:20.092683 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:42:20.092683 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:20.092683 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:42:20.092683 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:20.092683 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:20.092683 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:20.092683 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:20.092683 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:20.092683 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:20.092683 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:20.092683 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:20.092683 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:20.092683 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:20.092683 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:20.092683 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:20.092683 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:20.093685 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:20.093685 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:20.093685 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:42:20.093685 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:42:20.093685 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:42:20.093685 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:42:20.093685 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:42:20.093685 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:42:20.093685 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 07 10:42:20.093685 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:20.093685 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 327/657] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:42:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:20.094277 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfff23d-db71-420c-a2bc-e9132947cc95 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:20.100614 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfff23d-db71-420c-a2bc-e9132947cc95 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:20.100758 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e12a84-6bbf-44f1-b5a8-211ed4cfcfe3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:20.100839 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfff23d-db71-420c-a2bc-e9132947cc95 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:20.100839 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 328/658] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:20.100996 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e12a84-6bbf-44f1-b5a8-211ed4cfcfe3 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:20.101067 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfff23d-db71-420c-a2bc-e9132947cc95 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:20.109538 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-91e12a84-6bbf-44f1-b5a8-211ed4cfcfe3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:20.109538 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:20.109538 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:20.109538 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:20.109538 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:20.109538 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:20.109538 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:20.109538 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:20.109538 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:20.109538 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:20.109538 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:20.109538 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:20.109538 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:42:20.109538 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:42:20.109538 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:42:20.110502 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:42:20.110502 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:20.110502 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:20.110502 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:20.110502 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:20.110502 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:20.110502 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:20.110502 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:20.110502 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:20.110502 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:20.110502 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:20.110502 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:20.110502 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:20.110502 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:20.110502 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:20.110502 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:20.110502 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:20.111404 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:42:20.111404 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:42:20.111404 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:42:20.111404 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:42:20.111404 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:42:20.111404 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:42:20.111404 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:20.111404 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:20.113325 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 331/659] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:20.114285 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e12a84-6bbf-44f1-b5a8-211ed4cfcfe3 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:20.200369 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:20.211464 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfff23d-db71-420c-a2bc-e9132947cc95 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:20.219441 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:20.225921 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e12a84-6bbf-44f1-b5a8-211ed4cfcfe3 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:20.249417 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd8b20-d417-442c-b3b2-2c37c32d56f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:20.249964 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd8b20-d417-442c-b3b2-2c37c32d56f7 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:20.250239 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd8b20-d417-442c-b3b2-2c37c32d56f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:20.250504 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd8b20-d417-442c-b3b2-2c37c32d56f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:20.251672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd8b20-d417-442c-b3b2-2c37c32d56f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:20.251971 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd8b20-d417-442c-b3b2-2c37c32d56f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:20.253397 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd8b20-d417-442c-b3b2-2c37c32d56f7 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:20.262422 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0cdd5c-dd05-4084-812d-0848863f21ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:20.263032 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cdd5c-dd05-4084-812d-0848863f21ce None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:20.263305 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cdd5c-dd05-4084-812d-0848863f21ce None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:20.263571 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cdd5c-dd05-4084-812d-0848863f21ce None admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:20.264301 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0cdd5c-dd05-4084-812d-0848863f21ce None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:20.264603 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0cdd5c-dd05-4084-812d-0848863f21ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:20.269761 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 329/660] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:20.269923 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0cdd5c-dd05-4084-812d-0848863f21ce None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:20.270026 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d7431-a1fe-4fbb-a30c-5cb98fcf1c4f None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:20.270026 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d7431-a1fe-4fbb-a30c-5cb98fcf1c4f None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:20.270026 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d7431-a1fe-4fbb-a30c-5cb98fcf1c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:20.285505 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-8e8d7431-a1fe-4fbb-a30c-5cb98fcf1c4f None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:20.286640 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-8e8d7431-a1fe-4fbb-a30c-5cb98fcf1c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:20.288105 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 332/661] 10.222.0.27 () {56 vars in 1137 bytes} [Sun Aug 7 10:42:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:20.288729 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0cdd5c-dd05-4084-812d-0848863f21ce None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:20.366349 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 330/662] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:42:20.374242 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d7431-a1fe-4fbb-a30c-5cb98fcf1c4f None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:20.399600 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0cdd5c-dd05-4084-812d-0848863f21ce None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:20.438905 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b0c23-44cc-40a8-8911-fea91a06d6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:20.439504 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b0c23-44cc-40a8-8911-fea91a06d6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:20.439866 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b0c23-44cc-40a8-8911-fea91a06d6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:20.440113 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b0c23-44cc-40a8-8911-fea91a06d6c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:20.440718 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b0c23-44cc-40a8-8911-fea91a06d6c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:20.441018 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b0c23-44cc-40a8-8911-fea91a06d6c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:20.442596 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b0c23-44cc-40a8-8911-fea91a06d6c0 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:20.459363 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 333/663] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:42:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:20.459363 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b0c23-44cc-40a8-8911-fea91a06d6c0 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:20.466634 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:20.473731 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:20.490777 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d7431-a1fe-4fbb-a30c-5cb98fcf1c4f None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:20.528074 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce61335-14ec-4728-b66d-589f05728315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:20.528774 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce61335-14ec-4728-b66d-589f05728315 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:20.529116 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce61335-14ec-4728-b66d-589f05728315 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:20.529483 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce61335-14ec-4728-b66d-589f05728315 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:20.537563 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce61335-14ec-4728-b66d-589f05728315 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:20.539060 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce61335-14ec-4728-b66d-589f05728315 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:20.551176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-5ce61335-14ec-4728-b66d-589f05728315 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 10:42:20.551176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:20.551176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:20.551176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:20.551176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:20.551176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:20.551176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:20.551176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:20.551176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:20.551176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:20.551176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:20.551176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:20.551176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:42:20.551176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:42:20.551176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:42:20.551176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:42:20.552115 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:20.552115 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:20.552115 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:42:20.552115 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:20.552115 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:42:20.552115 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:20.552115 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:20.552115 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:20.552115 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:20.552115 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:20.552115 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:20.552115 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:20.552115 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:20.552115 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:20.552115 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:20.552115 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:20.552115 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:20.552115 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:20.553065 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:20.553065 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:20.553065 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:42:20.553065 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:42:20.553065 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:42:20.553065 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:42:20.553065 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:42:20.553065 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:42:20.553065 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 10:42:20.553065 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:20.553065 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 331/664] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 7 10:42:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:20.554232 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce61335-14ec-4728-b66d-589f05728315 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:20.566744 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b0c23-44cc-40a8-8911-fea91a06d6c0 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:20.600889 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743f893-99e9-414e-9907-c1a108f687d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:20.601528 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743f893-99e9-414e-9907-c1a108f687d5 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:20.601803 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743f893-99e9-414e-9907-c1a108f687d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:20.602071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743f893-99e9-414e-9907-c1a108f687d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:20.671161 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743f893-99e9-414e-9907-c1a108f687d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:20.671591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce61335-14ec-4728-b66d-589f05728315 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:20.672588 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743f893-99e9-414e-9907-c1a108f687d5 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:20.688613 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:20.712782 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc963838-ae65-4c88-a1d8-f9558c0d3e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:20.713431 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc963838-ae65-4c88-a1d8-f9558c0d3e34 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:20.713707 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc963838-ae65-4c88-a1d8-f9558c0d3e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:20.713968 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc963838-ae65-4c88-a1d8-f9558c0d3e34 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:20.723150 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:20.726881 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc963838-ae65-4c88-a1d8-f9558c0d3e34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:42:20.731883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-cc963838-ae65-4c88-a1d8-f9558c0d3e34 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:20.731883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:20.731883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:20.731883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:20.731883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:20.731883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:20.731883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:20.731883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:20.731883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:20.731883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:20.731883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:20.731883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:20.731883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:42:20.731883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:42:20.731883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:42:20.731883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:42:20.732823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:42:20.732823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:42:20.732823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:42:20.732823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:42:20.732823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:20.732823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:20.732823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:20.732823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:20.732823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:20.732823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:20.732823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:20.732823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:20.732823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:20.732823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:20.732823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:20.732823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:20.733699 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:20.733699 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:20.733699 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:20.733699 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:20.733699 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:42:20.733699 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:42:20.733699 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:42:20.733699 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:42:20.733699 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:42:20.733699 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:42:20.733699 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:20.733699 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:20.733699 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 332/665] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 7 10:42:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:20.734394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc963838-ae65-4c88-a1d8-f9558c0d3e34 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:20.788520 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 334/666] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:42:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:42:20.789682 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743f893-99e9-414e-9907-c1a108f687d5 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:20.842099 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc963838-ae65-4c88-a1d8-f9558c0d3e34 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:20.877208 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b535f0-956b-468b-aea6-c36be0143647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:20.877952 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b535f0-956b-468b-aea6-c36be0143647 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:20.878222 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b535f0-956b-468b-aea6-c36be0143647 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:20.878599 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b535f0-956b-468b-aea6-c36be0143647 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:20.879215 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b535f0-956b-468b-aea6-c36be0143647 None admin] RBAC: Adding query filter params (role.id=bf9e51dafeac420f89a66e78e1463982, scope.project.id=62eed8550ae3403f8a75894dbd19cf4a, user.id=c5fca18c4ee74043a5acc9aeb297c9c7) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:20.879516 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b535f0-956b-468b-aea6-c36be0143647 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:20.880931 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b535f0-956b-468b-aea6-c36be0143647 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:20.897344 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 333/667] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:42:20 2022] GET /identity/v3/role_assignments?user.id=c5fca18c4ee74043a5acc9aeb297c9c7&scope.project.id=62eed8550ae3403f8a75894dbd19cf4a&role.id=bf9e51dafeac420f89a66e78e1463982 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:20.897344 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b535f0-956b-468b-aea6-c36be0143647 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:20.914001 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743f893-99e9-414e-9907-c1a108f687d5 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:20.935714 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:20.956502 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:20.964402 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3149dc-66e6-4cdf-aa05-b029aa2fff95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:20.965331 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3149dc-66e6-4cdf-aa05-b029aa2fff95 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:20.965623 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3149dc-66e6-4cdf-aa05-b029aa2fff95 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:20.965894 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3149dc-66e6-4cdf-aa05-b029aa2fff95 None admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:20.966969 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3149dc-66e6-4cdf-aa05-b029aa2fff95 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:20.967276 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3149dc-66e6-4cdf-aa05-b029aa2fff95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:20.970343 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3149dc-66e6-4cdf-aa05-b029aa2fff95 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:20.997098 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 335/668] 10.222.0.27 () {56 vars in 1139 bytes} [Sun Aug 7 10:42:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:20.998044 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3149dc-66e6-4cdf-aa05-b029aa2fff95 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:21.007542 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b535f0-956b-468b-aea6-c36be0143647 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:21.053128 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ed2f5-d4ac-49b7-bcfb-ac887a59a2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:21.053713 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ed2f5-d4ac-49b7-bcfb-ac887a59a2df None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:21.054707 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ed2f5-d4ac-49b7-bcfb-ac887a59a2df None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:21.054987 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ed2f5-d4ac-49b7-bcfb-ac887a59a2df None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:21.055677 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ed2f5-d4ac-49b7-bcfb-ac887a59a2df None admin] RBAC: Adding query filter params (name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:21.056045 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ed2f5-d4ac-49b7-bcfb-ac887a59a2df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:21.058507 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ed2f5-d4ac-49b7-bcfb-ac887a59a2df None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:21.071843 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 334/669] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 7 10:42:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:21.072661 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ed2f5-d4ac-49b7-bcfb-ac887a59a2df None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:21.129389 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3149dc-66e6-4cdf-aa05-b029aa2fff95 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:21.177140 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b430ad9-a302-40e9-be2b-2803a75266f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:21.177140 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b430ad9-a302-40e9-be2b-2803a75266f5 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:21.177140 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b430ad9-a302-40e9-be2b-2803a75266f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:21.177140 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b430ad9-a302-40e9-be2b-2803a75266f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:21.191050 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b430ad9-a302-40e9-be2b-2803a75266f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:21.192745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b430ad9-a302-40e9-be2b-2803a75266f5 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:21.193266 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ed2f5-d4ac-49b7-bcfb-ac887a59a2df None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:21.211910 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-4b430ad9-a302-40e9-be2b-2803a75266f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:21.211910 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:21.211910 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:21.211910 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:21.211910 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:21.211910 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:21.211910 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:21.211910 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:21.211910 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:21.211910 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:21.211910 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:21.211910 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:21.211910 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:21.211910 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:21.211910 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:21.211910 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:21.212893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:21.212893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:21.212893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:21.212893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:21.212893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:21.212893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:21.212893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:21.212893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:21.212893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:21.212893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:21.212893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:21.212893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:21.212893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:21.212893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:21.212893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:21.212893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:21.212893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:21.213982 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:21.213982 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:21.213982 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:21.213982 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 336/670] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:21.217848 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b430ad9-a302-40e9-be2b-2803a75266f5 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:21.233542 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc667d-d3fe-4a8d-b6e4-fadaecd8b38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:21.234152 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc667d-d3fe-4a8d-b6e4-fadaecd8b38c None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:21.234435 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc667d-d3fe-4a8d-b6e4-fadaecd8b38c None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:21.234710 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc667d-d3fe-4a8d-b6e4-fadaecd8b38c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:21.251070 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:21.261690 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:21.307651 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc667d-d3fe-4a8d-b6e4-fadaecd8b38c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:21.309245 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc667d-d3fe-4a8d-b6e4-fadaecd8b38c None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:21.355662 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b430ad9-a302-40e9-be2b-2803a75266f5 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:21.400082 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ba26a-fe3e-4f04-acc8-6c8762827612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:21.400717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ba26a-fe3e-4f04-acc8-6c8762827612 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:21.400993 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ba26a-fe3e-4f04-acc8-6c8762827612 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:21.401262 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ba26a-fe3e-4f04-acc8-6c8762827612 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:21.413461 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ba26a-fe3e-4f04-acc8-6c8762827612 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:21.415180 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ba26a-fe3e-4f04-acc8-6c8762827612 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:21.432598 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 335/671] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:42:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:42:21.432598 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc667d-d3fe-4a8d-b6e4-fadaecd8b38c None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:21.435253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-c33ba26a-fe3e-4f04-acc8-6c8762827612 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:21.435253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:21.435253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:21.435253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:21.435253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:21.435253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:21.435253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:21.435253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:21.435253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:21.435253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:21.435253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:21.435253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:21.435253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:21.435253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:21.435253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:21.435253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:21.436270 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:21.436270 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:21.436270 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:21.436270 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:21.436270 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:21.436270 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:21.436270 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:21.436270 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:21.436270 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:21.436270 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:21.436270 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:21.436270 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:21.436270 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:21.436270 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:21.436270 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:21.436270 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:21.436270 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:21.437178 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:21.437178 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:21.437178 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:21.439286 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 337/672] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:21.440372 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ba26a-fe3e-4f04-acc8-6c8762827612 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:21.475891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:21.539545 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:21.540875 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc667d-d3fe-4a8d-b6e4-fadaecd8b38c None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:21.573870 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ba26a-fe3e-4f04-acc8-6c8762827612 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:21.577512 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a88ff-3091-4282-8761-52f58e49b2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:21.577874 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a88ff-3091-4282-8761-52f58e49b2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:21.578302 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a88ff-3091-4282-8761-52f58e49b2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:21.578669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a88ff-3091-4282-8761-52f58e49b2b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:21.580014 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a88ff-3091-4282-8761-52f58e49b2b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:21.580424 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a88ff-3091-4282-8761-52f58e49b2b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:21.581912 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a88ff-3091-4282-8761-52f58e49b2b8 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:21.597583 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 336/673] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:21.598573 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a88ff-3091-4282-8761-52f58e49b2b8 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:21.618228 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441a4ba-1f5f-45a1-b2ca-7c144286be2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:21.619503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441a4ba-1f5f-45a1-b2ca-7c144286be2a None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:21.620175 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441a4ba-1f5f-45a1-b2ca-7c144286be2a None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:21.620604 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441a4ba-1f5f-45a1-b2ca-7c144286be2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:21.642904 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441a4ba-1f5f-45a1-b2ca-7c144286be2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:21.645701 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441a4ba-1f5f-45a1-b2ca-7c144286be2a None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:21.668452 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-e441a4ba-1f5f-45a1-b2ca-7c144286be2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:21.668452 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:21.668452 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:21.668452 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:21.668452 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:21.668452 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:21.668452 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:21.668452 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:21.668452 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:21.668452 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:21.668452 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:21.668452 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:21.668452 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:21.668452 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:21.668452 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:21.668452 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:21.669737 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:21.669737 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:21.669737 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:21.669737 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:21.669737 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:21.669737 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:21.669737 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:21.669737 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:21.669737 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:21.669737 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:21.669737 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:21.669737 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:21.669737 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:21.669737 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:21.669737 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:21.669737 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:21.669737 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:21.670851 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:21.670851 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:21.670851 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:21.671428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 338/674] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:21.672300 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441a4ba-1f5f-45a1-b2ca-7c144286be2a None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:21.696067 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:21.713268 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a88ff-3091-4282-8761-52f58e49b2b8 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:21.761801 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702a43b-89a9-41a1-ba4a-bf6ae0346a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:21.763070 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702a43b-89a9-41a1-ba4a-bf6ae0346a60 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:21.763418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702a43b-89a9-41a1-ba4a-bf6ae0346a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:21.763761 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702a43b-89a9-41a1-ba4a-bf6ae0346a60 None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:21.764772 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702a43b-89a9-41a1-ba4a-bf6ae0346a60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:21.765157 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702a43b-89a9-41a1-ba4a-bf6ae0346a60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:21.766997 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702a43b-89a9-41a1-ba4a-bf6ae0346a60 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:21.785229 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 337/675] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:21.786192 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702a43b-89a9-41a1-ba4a-bf6ae0346a60 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:21.800594 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441a4ba-1f5f-45a1-b2ca-7c144286be2a None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:21.828969 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:21.838086 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc6697-8295-4ef5-b4ed-00692c52e98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:21.838967 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc6697-8295-4ef5-b4ed-00692c52e98a None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:21.839484 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc6697-8295-4ef5-b4ed-00692c52e98a None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:21.839942 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc6697-8295-4ef5-b4ed-00692c52e98a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:21.847569 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc6697-8295-4ef5-b4ed-00692c52e98a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:21.849253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc6697-8295-4ef5-b4ed-00692c52e98a None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:21.860989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-04cc6697-8295-4ef5-b4ed-00692c52e98a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:21.860989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:21.860989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:21.860989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:21.860989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:21.860989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:21.860989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:21.860989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:21.860989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:21.860989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:21.860989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:21.860989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:21.860989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:42:21.860989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:42:21.860989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:42:21.862094 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:42:21.862094 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:21.862094 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:21.862094 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:21.862094 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:21.862094 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:21.862094 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:21.862094 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:21.862094 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:21.862094 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:21.862094 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:21.862094 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:21.862094 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:21.862094 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:21.862094 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:21.862094 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:21.862094 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:21.862984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:42:21.862984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:42:21.862984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:42:21.862984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:42:21.862984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:42:21.862984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:42:21.862984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:21.862984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:21.870054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 339/676] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:21.871095 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc6697-8295-4ef5-b4ed-00692c52e98a None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:21.916807 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702a43b-89a9-41a1-ba4a-bf6ae0346a60 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:21.965512 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1906a1-efe8-41c6-91dd-d74cecd73e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:21.966127 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1906a1-efe8-41c6-91dd-d74cecd73e16 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:21.966404 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1906a1-efe8-41c6-91dd-d74cecd73e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:21.966676 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1906a1-efe8-41c6-91dd-d74cecd73e16 None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:21.967862 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1906a1-efe8-41c6-91dd-d74cecd73e16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:21.968176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1906a1-efe8-41c6-91dd-d74cecd73e16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:21.970448 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1906a1-efe8-41c6-91dd-d74cecd73e16 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:21.980671 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc6697-8295-4ef5-b4ed-00692c52e98a None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:21.986066 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 338/677] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:21.986926 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1906a1-efe8-41c6-91dd-d74cecd73e16 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:22.001370 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:22.020429 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4281feb-c465-42c3-9e85-6dc16802550e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:22.021056 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4281feb-c465-42c3-9e85-6dc16802550e None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:22.021570 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4281feb-c465-42c3-9e85-6dc16802550e None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:22.021680 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4281feb-c465-42c3-9e85-6dc16802550e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:22.029532 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4281feb-c465-42c3-9e85-6dc16802550e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:22.031073 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4281feb-c465-42c3-9e85-6dc16802550e None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:22.047445 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-e4281feb-c465-42c3-9e85-6dc16802550e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 10:42:22.047445 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:22.047445 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:22.047445 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:22.047445 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:22.047445 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:22.047445 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:22.047445 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:22.047445 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:22.047445 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:22.047445 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:22.047445 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:22.047445 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:42:22.047445 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:42:22.047445 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:42:22.047445 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:42:22.048410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:22.048410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:22.048410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:42:22.048410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:22.048410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:42:22.048410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:22.048410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:22.048410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:22.048410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:22.048410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:22.048410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:22.048410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:22.048410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:22.048410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:22.048410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:22.048410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:22.048410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:22.048410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:22.049379 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:22.049379 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:22.049379 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:42:22.049379 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:42:22.049379 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:42:22.049379 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:42:22.049379 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:42:22.049379 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:42:22.049379 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 10:42:22.049379 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:22.049379 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 340/678] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:42:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:22.049989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4281feb-c465-42c3-9e85-6dc16802550e None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:22.104970 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1906a1-efe8-41c6-91dd-d74cecd73e16 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:22.105377 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:22.140513 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e926be-b718-480c-ab45-e689df782ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:22.141248 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e926be-b718-480c-ab45-e689df782ebb None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:22.142125 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e926be-b718-480c-ab45-e689df782ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:22.142448 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e926be-b718-480c-ab45-e689df782ebb None admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:22.143231 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e926be-b718-480c-ab45-e689df782ebb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:22.143547 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e926be-b718-480c-ab45-e689df782ebb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:22.145037 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e926be-b718-480c-ab45-e689df782ebb None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:22.159687 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 339/679] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:42:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:22.160969 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0d82c-8536-4650-97b4-964eaf3f0c65 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:22.161251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0d82c-8536-4650-97b4-964eaf3f0c65 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:22.161553 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0d82c-8536-4650-97b4-964eaf3f0c65 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:22.166819 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 340/680] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:22.167334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4281feb-c465-42c3-9e85-6dc16802550e None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:22.167784 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0d82c-8536-4650-97b4-964eaf3f0c65 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:22.208702 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4cd70-4097-45cb-abdd-ecdc1999c62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:22.209711 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4cd70-4097-45cb-abdd-ecdc1999c62c None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:22.210166 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4cd70-4097-45cb-abdd-ecdc1999c62c None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:22.210612 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4cd70-4097-45cb-abdd-ecdc1999c62c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:22.217764 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c4cd70-4097-45cb-abdd-ecdc1999c62c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:22.219395 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c4cd70-4097-45cb-abdd-ecdc1999c62c None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:22.231248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-14c4cd70-4097-45cb-abdd-ecdc1999c62c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:22.231248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:22.231248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:22.231248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:22.231248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:22.231248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:22.231248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:22.231248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:22.231248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:22.231248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:22.231248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:22.231248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:22.231248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:42:22.231248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:42:22.231248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:42:22.232240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:42:22.232240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:22.232240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:22.232240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:22.232240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:22.232240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:22.232240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:22.232240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:22.232240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:22.232240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:22.232240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:22.232240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:22.232240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:22.232240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:22.232240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:22.232240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:22.232240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:22.233185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:42:22.233185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:42:22.233185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:42:22.233185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:42:22.233185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:42:22.233185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:42:22.233185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:22.233185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:22.233185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 341/681] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:22.233185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4cd70-4097-45cb-abdd-ecdc1999c62c None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:22.248016 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:22.287148 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0d82c-8536-4650-97b4-964eaf3f0c65 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:22.324058 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a7f06-4f1c-4f22-8f94-bc85d0478d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:22.324687 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a7f06-4f1c-4f22-8f94-bc85d0478d30 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:22.324963 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a7f06-4f1c-4f22-8f94-bc85d0478d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:22.325232 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a7f06-4f1c-4f22-8f94-bc85d0478d30 None admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:22.325996 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a7f06-4f1c-4f22-8f94-bc85d0478d30 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:22.326296 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a7f06-4f1c-4f22-8f94-bc85d0478d30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:22.327783 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a7f06-4f1c-4f22-8f94-bc85d0478d30 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:22.344428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4cd70-4097-45cb-abdd-ecdc1999c62c None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:22.353390 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:22.358767 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 341/682] 10.222.0.27 () {56 vars in 1135 bytes} [Sun Aug 7 10:42:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:22.359959 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261d86f-3766-4251-ac95-5b1bd5095435 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:22.360240 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261d86f-3766-4251-ac95-5b1bd5095435 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:22.361111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261d86f-3766-4251-ac95-5b1bd5095435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:22.378373 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-7261d86f-3766-4251-ac95-5b1bd5095435 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:22.379548 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-7261d86f-3766-4251-ac95-5b1bd5095435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:22.381904 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fefb7ec-956b-47ff-a340-f1ecb6fe4029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:22.382501 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefb7ec-956b-47ff-a340-f1ecb6fe4029 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:22.382777 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefb7ec-956b-47ff-a340-f1ecb6fe4029 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:22.383045 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefb7ec-956b-47ff-a340-f1ecb6fe4029 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:22.383771 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fefb7ec-956b-47ff-a340-f1ecb6fe4029 None admin] RBAC: Adding query filter params (role.id=bf9e51dafeac420f89a66e78e1463982, scope.project.id=62eed8550ae3403f8a75894dbd19cf4a, user.id=a462a891b30847c0aeadbd697652011a) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:22.384075 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fefb7ec-956b-47ff-a340-f1ecb6fe4029 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:22.385496 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fefb7ec-956b-47ff-a340-f1ecb6fe4029 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:22.391229 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 342/683] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:42:22 2022] GET /identity/v3/role_assignments?user.id=a462a891b30847c0aeadbd697652011a&scope.project.id=62eed8550ae3403f8a75894dbd19cf4a&role.id=bf9e51dafeac420f89a66e78e1463982 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:22.392020 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fefb7ec-956b-47ff-a340-f1ecb6fe4029 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:22.484606 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 342/684] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:42:22.486315 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261d86f-3766-4251-ac95-5b1bd5095435 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:22.524177 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fefb7ec-956b-47ff-a340-f1ecb6fe4029 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:22.562237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a205afd-cd23-4be9-a8ff-aed4c3134408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:22.562845 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a205afd-cd23-4be9-a8ff-aed4c3134408 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:22.563119 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a205afd-cd23-4be9-a8ff-aed4c3134408 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:22.563382 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a205afd-cd23-4be9-a8ff-aed4c3134408 None admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:22.564631 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a205afd-cd23-4be9-a8ff-aed4c3134408 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:22.564931 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a205afd-cd23-4be9-a8ff-aed4c3134408 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:22.566418 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a205afd-cd23-4be9-a8ff-aed4c3134408 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:22.570762 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:22.585703 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 343/685] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:42:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:22.586620 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a205afd-cd23-4be9-a8ff-aed4c3134408 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:22.628771 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:22.636254 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261d86f-3766-4251-ac95-5b1bd5095435 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:22.688548 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db06ba1-03bf-401b-9ea9-1ed62b478e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:22.689950 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db06ba1-03bf-401b-9ea9-1ed62b478e9a None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:22.690716 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db06ba1-03bf-401b-9ea9-1ed62b478e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:22.691193 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db06ba1-03bf-401b-9ea9-1ed62b478e9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:22.716618 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a205afd-cd23-4be9-a8ff-aed4c3134408 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:22.753280 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20023be8-81d6-47bb-a14d-6cde9bf6b885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:22.754281 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20023be8-81d6-47bb-a14d-6cde9bf6b885 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:22.754779 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20023be8-81d6-47bb-a14d-6cde9bf6b885 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:22.755260 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20023be8-81d6-47bb-a14d-6cde9bf6b885 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:22.767480 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20023be8-81d6-47bb-a14d-6cde9bf6b885 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:42:22.772642 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-20023be8-81d6-47bb-a14d-6cde9bf6b885 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:42:22.772642 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:22.772642 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:22.772642 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:22.772642 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:22.772642 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:22.772642 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:22.772642 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:22.772642 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:22.772642 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:22.772642 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:22.772642 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:22.772642 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:42:22.772642 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:42:22.772642 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:42:22.772642 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:42:22.773611 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:42:22.773611 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:42:22.773611 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:42:22.773611 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:42:22.773611 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:22.773611 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:22.773611 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:22.773611 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:22.773611 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:22.773611 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:22.773611 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:22.773611 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:22.773611 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:22.773611 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:22.773611 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:22.773611 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:22.774465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:22.774465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:22.774465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:22.774465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:22.774465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:42:22.774465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:42:22.774465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:42:22.774465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:42:22.774465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:42:22.774465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:42:22.774465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:42:22.774465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:22.776377 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db06ba1-03bf-401b-9ea9-1ed62b478e9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:22.777347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 344/686] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:42:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:22.778339 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20023be8-81d6-47bb-a14d-6cde9bf6b885 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:22.782419 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db06ba1-03bf-401b-9ea9-1ed62b478e9a None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:22.843519 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:22.879997 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:22.889623 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20023be8-81d6-47bb-a14d-6cde9bf6b885 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:22.899709 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 343/687] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:42:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:42:22.899709 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db06ba1-03bf-401b-9ea9-1ed62b478e9a None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:22.933425 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e3b77-7cdf-4c05-a965-5ccaff217dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:22.934062 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e3b77-7cdf-4c05-a965-5ccaff217dbf None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:22.934339 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e3b77-7cdf-4c05-a965-5ccaff217dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:22.934606 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e3b77-7cdf-4c05-a965-5ccaff217dbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:22.935335 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e3b77-7cdf-4c05-a965-5ccaff217dbf None admin] RBAC: Adding query filter params (role.id=bf9e51dafeac420f89a66e78e1463982, scope.project.id=62eed8550ae3403f8a75894dbd19cf4a, user.id=9b03428b48264b9da9800283496de2e4) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:22.935639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e3b77-7cdf-4c05-a965-5ccaff217dbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:22.937053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e3b77-7cdf-4c05-a965-5ccaff217dbf None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:22.949635 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 345/688] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:42:22 2022] GET /identity/v3/role_assignments?user.id=9b03428b48264b9da9800283496de2e4&scope.project.id=62eed8550ae3403f8a75894dbd19cf4a&role.id=bf9e51dafeac420f89a66e78e1463982 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:22.950935 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e3b77-7cdf-4c05-a965-5ccaff217dbf None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:23.018861 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db06ba1-03bf-401b-9ea9-1ed62b478e9a None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:23.073156 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5670e-d5d0-4bb1-b110-2031002786e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:23.074198 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5670e-d5d0-4bb1-b110-2031002786e8 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:23.074693 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5670e-d5d0-4bb1-b110-2031002786e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:23.074966 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5670e-d5d0-4bb1-b110-2031002786e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:23.075651 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5670e-d5d0-4bb1-b110-2031002786e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:23.075950 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5670e-d5d0-4bb1-b110-2031002786e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:23.077366 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5670e-d5d0-4bb1-b110-2031002786e8 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:23.089825 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 344/689] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:42:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:23.091380 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe8b25-f080-4bf0-850f-5b05709d0664 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:23.091664 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe8b25-f080-4bf0-850f-5b05709d0664 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:23.092291 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe8b25-f080-4bf0-850f-5b05709d0664 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:23.098359 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 345/690] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:23.098359 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe8b25-f080-4bf0-850f-5b05709d0664 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:23.119630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:23.145943 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e3b77-7cdf-4c05-a965-5ccaff217dbf None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:23.197652 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebd8fc-4ecb-4dd8-8ec2-31298ba1bcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:23.199196 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebd8fc-4ecb-4dd8-8ec2-31298ba1bcc0 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:23.199616 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebd8fc-4ecb-4dd8-8ec2-31298ba1bcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:23.200049 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebd8fc-4ecb-4dd8-8ec2-31298ba1bcc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:23.212155 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebd8fc-4ecb-4dd8-8ec2-31298ba1bcc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:23.213874 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebd8fc-4ecb-4dd8-8ec2-31298ba1bcc0 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:23.229341 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-caebd8fc-4ecb-4dd8-8ec2-31298ba1bcc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:23.229341 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:23.229341 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:23.229341 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:23.229341 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:23.229341 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:23.229341 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:23.229341 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:23.229341 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:23.229341 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:23.229341 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:23.229341 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:23.229341 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:23.229341 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:23.229341 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:23.229341 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:23.230475 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:23.230475 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:23.230475 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:23.230475 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:23.230475 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:23.230475 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:23.230475 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:23.230475 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:23.230475 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:23.230475 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:23.230475 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:23.230475 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:23.230475 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:23.230475 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:23.230475 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:23.230475 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:23.230475 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:23.231505 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:23.231505 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:23.231505 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:23.231672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe8b25-f080-4bf0-850f-5b05709d0664 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:23.233439 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 346/691] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:23.234918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35c4b0-97d0-47a1-83bd-b180cb855df7 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:23.235388 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35c4b0-97d0-47a1-83bd-b180cb855df7 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:23.235876 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35c4b0-97d0-47a1-83bd-b180cb855df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:23.255953 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-5d35c4b0-97d0-47a1-83bd-b180cb855df7 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:23.257517 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-5d35c4b0-97d0-47a1-83bd-b180cb855df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:23.260029 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:23.280515 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cd1da-bb8b-4e4b-a2d4-a4cd1fef8b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:23.281172 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cd1da-bb8b-4e4b-a2d4-a4cd1fef8b29 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:23.281446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cd1da-bb8b-4e4b-a2d4-a4cd1fef8b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:23.281709 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cd1da-bb8b-4e4b-a2d4-a4cd1fef8b29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:23.297793 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cd1da-bb8b-4e4b-a2d4-a4cd1fef8b29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:23.299345 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cd1da-bb8b-4e4b-a2d4-a4cd1fef8b29 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:23.322233 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-4e9cd1da-bb8b-4e4b-a2d4-a4cd1fef8b29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:23.322233 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:23.322233 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:23.322233 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:23.322233 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:23.322233 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:23.322233 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:23.322233 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:23.322233 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:23.322233 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:23.322233 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:23.322233 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:23.322233 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:23.322233 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:23.322233 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:23.322233 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:23.323270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:23.323270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:23.323270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:23.323270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:23.323270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:23.323270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:23.323270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:23.323270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:23.323270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:23.323270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:23.323270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:23.323270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:23.323270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:23.323270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:23.323270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:23.323270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:23.323270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:23.324750 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:23.324750 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:23.324750 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:23.324750 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 346/692] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:23.324750 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cd1da-bb8b-4e4b-a2d4-a4cd1fef8b29 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:23.347509 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 347/693] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:42:23.348766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35c4b0-97d0-47a1-83bd-b180cb855df7 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:23.412232 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:23.462613 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cd1da-bb8b-4e4b-a2d4-a4cd1fef8b29 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:23.476942 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35c4b0-97d0-47a1-83bd-b180cb855df7 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:23.508050 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec74320-22cc-4740-870b-ec66c545f26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:23.509356 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec74320-22cc-4740-870b-ec66c545f26b None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:23.509938 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec74320-22cc-4740-870b-ec66c545f26b None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:23.510467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec74320-22cc-4740-870b-ec66c545f26b None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:23.511516 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec74320-22cc-4740-870b-ec66c545f26b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:23.511973 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec74320-22cc-4740-870b-ec66c545f26b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:23.514590 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec74320-22cc-4740-870b-ec66c545f26b None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:23.520605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dde16d-08d1-40b2-8818-19922f70b510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:23.521857 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dde16d-08d1-40b2-8818-19922f70b510 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:23.522348 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dde16d-08d1-40b2-8818-19922f70b510 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:23.522832 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dde16d-08d1-40b2-8818-19922f70b510 None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:23.523698 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dde16d-08d1-40b2-8818-19922f70b510 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:23.524204 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dde16d-08d1-40b2-8818-19922f70b510 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:23.526247 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dde16d-08d1-40b2-8818-19922f70b510 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:23.534978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 347/694] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:23.534978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec74320-22cc-4740-870b-ec66c545f26b None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:23.537896 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:23.544426 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 348/695] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:23.545449 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dde16d-08d1-40b2-8818-19922f70b510 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:23.657526 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dde16d-08d1-40b2-8818-19922f70b510 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:23.671382 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec74320-22cc-4740-870b-ec66c545f26b None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:23.700846 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2509ec7-c32c-4c62-927c-366118fbd54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:23.701602 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2509ec7-c32c-4c62-927c-366118fbd54d None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:23.701882 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2509ec7-c32c-4c62-927c-366118fbd54d None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:23.702211 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2509ec7-c32c-4c62-927c-366118fbd54d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:23.709570 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:23.711818 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2509ec7-c32c-4c62-927c-366118fbd54d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:23.713489 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2509ec7-c32c-4c62-927c-366118fbd54d None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:23.719397 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01154c11-2fb3-40fc-accc-b91e429af55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:23.720332 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01154c11-2fb3-40fc-accc-b91e429af55b None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:23.721091 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01154c11-2fb3-40fc-accc-b91e429af55b None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:23.721601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01154c11-2fb3-40fc-accc-b91e429af55b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:23.722399 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01154c11-2fb3-40fc-accc-b91e429af55b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:23.723958 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01154c11-2fb3-40fc-accc-b91e429af55b None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:23.726131 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-b2509ec7-c32c-4c62-927c-366118fbd54d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:23.726131 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:23.726131 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:23.726131 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:23.726131 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:23.726131 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:23.726131 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:23.726131 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:23.726131 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:23.726131 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:23.726131 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:23.726131 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:23.726131 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:42:23.726131 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:42:23.726131 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:42:23.727053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:42:23.727053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:23.727053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:23.727053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:23.727053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:23.727053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:23.727053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:23.727053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:23.727053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:23.727053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:23.727053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:23.727053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:23.727053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:23.727053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:23.727053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:23.727053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:23.727053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:23.728054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:42:23.728054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:42:23.728054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:42:23.728054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:42:23.728054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:42:23.728054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:42:23.728054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:23.728054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:23.732065 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 349/696] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:23.733109 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2509ec7-c32c-4c62-927c-366118fbd54d None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:23.740674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-01154c11-2fb3-40fc-accc-b91e429af55b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 10:42:23.740674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:23.740674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 10:42:23.740674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 10:42:23.740674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 10:42:23.740674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 10:42:23.740674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 10:42:23.740674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:23.740674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 10:42:23.740674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:23.740674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 10:42:23.740674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:23.740674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:23.740674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:23.740674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:23.740674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:23.740674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:23.741766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:23.741766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:23.741766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:23.741766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:23.741766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:23.741766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:23.741766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 10:42:23.741766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 10:42:23.741766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 10:42:23.741766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 10:42:23.741766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:23.741766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:23.741766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:23.741766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:23.741766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:23.741766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:23.742646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:23.742646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:23.742646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:23.742646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:23.742646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:23.742646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:23.742646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:23.742646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:23.742646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:23.742646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:23.742646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 10:42:23.742646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:23.742646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 10:42:23.742646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:23.746265 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 348/697] 10.222.0.27 () {56 vars in 1129 bytes} [Sun Aug 7 10:42:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:23.747727 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01154c11-2fb3-40fc-accc-b91e429af55b None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:23.803367 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:23.862607 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2509ec7-c32c-4c62-927c-366118fbd54d None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:23.862939 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01154c11-2fb3-40fc-accc-b91e429af55b None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:23.897809 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36021eed-da43-4392-b92d-0872e654acaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:23.898421 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36021eed-da43-4392-b92d-0872e654acaa None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:23.898701 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36021eed-da43-4392-b92d-0872e654acaa None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:23.898973 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36021eed-da43-4392-b92d-0872e654acaa None admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:23.899734 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36021eed-da43-4392-b92d-0872e654acaa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:23.899958 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36021eed-da43-4392-b92d-0872e654acaa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:23.901485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36021eed-da43-4392-b92d-0872e654acaa None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:23.909850 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f1fbb-5e98-4b30-83f9-ba28acc7aac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:23.910729 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f1fbb-5e98-4b30-83f9-ba28acc7aac4 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:23.911696 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f1fbb-5e98-4b30-83f9-ba28acc7aac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:23.912462 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f1fbb-5e98-4b30-83f9-ba28acc7aac4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:23.919098 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 349/698] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:42:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:23.919966 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36021eed-da43-4392-b92d-0872e654acaa None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:23.921527 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f1fbb-5e98-4b30-83f9-ba28acc7aac4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:23.924513 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f1fbb-5e98-4b30-83f9-ba28acc7aac4 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:23.940242 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-073f1fbb-5e98-4b30-83f9-ba28acc7aac4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 10:42:23.940242 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:23.940242 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:23.940242 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:23.940242 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:23.940242 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:23.940242 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:23.940242 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:23.940242 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:23.940242 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:23.940242 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:23.940242 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:23.940242 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:42:23.940242 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:42:23.940242 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:42:23.940242 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:42:23.941181 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:23.941181 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:23.941181 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:42:23.941181 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:23.941181 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:42:23.941181 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:23.941181 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:23.941181 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:23.941181 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:23.941181 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:23.941181 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:23.941181 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:23.941181 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:23.941181 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:23.941181 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:23.941181 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:23.941181 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:23.941181 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:23.942185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:23.942185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:23.942185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:42:23.942185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:42:23.942185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:42:23.942185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:42:23.942185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:42:23.942185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:42:23.942185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 10:42:23.942185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:23.945358 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 350/699] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Aug 7 10:42:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:23.946638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f1fbb-5e98-4b30-83f9-ba28acc7aac4 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:23.977117 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:24.044972 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36021eed-da43-4392-b92d-0872e654acaa None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:24.065946 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f1fbb-5e98-4b30-83f9-ba28acc7aac4 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:24.083567 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:24.089512 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae139a-598a-4804-bb87-ae94d3dbf264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:24.090395 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae139a-598a-4804-bb87-ae94d3dbf264 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:24.091005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae139a-598a-4804-bb87-ae94d3dbf264 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:24.091906 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae139a-598a-4804-bb87-ae94d3dbf264 None admin] PATH_INFO: `/v3/services` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:24.093022 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae139a-598a-4804-bb87-ae94d3dbf264 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:24.095989 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae139a-598a-4804-bb87-ae94d3dbf264 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:24.098197 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae139a-598a-4804-bb87-ae94d3dbf264 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:24.104488 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddd4af-3d1a-410b-97d6-d3675bab51df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:24.104798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 350/700] 10.222.0.27 () {56 vars in 1124 bytes} [Sun Aug 7 10:42:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:24.105115 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddd4af-3d1a-410b-97d6-d3675bab51df None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:24.105445 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddd4af-3d1a-410b-97d6-d3675bab51df None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:24.105720 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddd4af-3d1a-410b-97d6-d3675bab51df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:24.106448 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ddd4af-3d1a-410b-97d6-d3675bab51df None admin] RBAC: Adding query filter params (role.id=bf9e51dafeac420f89a66e78e1463982, scope.project.id=62eed8550ae3403f8a75894dbd19cf4a, user.id=a7181e5118c547a3a31d2e080c25ff01) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:24.106711 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae139a-598a-4804-bb87-ae94d3dbf264 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:24.106819 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ddd4af-3d1a-410b-97d6-d3675bab51df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:24.109371 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ddd4af-3d1a-410b-97d6-d3675bab51df None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:24.121396 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 351/701] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:42:23 2022] GET /identity/v3/role_assignments?user.id=a7181e5118c547a3a31d2e080c25ff01&scope.project.id=62eed8550ae3403f8a75894dbd19cf4a&role.id=bf9e51dafeac420f89a66e78e1463982 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:24.122439 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddd4af-3d1a-410b-97d6-d3675bab51df None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:24.308639 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae139a-598a-4804-bb87-ae94d3dbf264 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:24.330398 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddd4af-3d1a-410b-97d6-d3675bab51df None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:24.350616 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:24.380464 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd3a1f-0b80-4d36-afe8-3e2670da4d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:24.381493 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd3a1f-0b80-4d36-afe8-3e2670da4d66 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:24.381980 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd3a1f-0b80-4d36-afe8-3e2670da4d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:24.382482 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd3a1f-0b80-4d36-afe8-3e2670da4d66 None admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:24.383433 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd3a1f-0b80-4d36-afe8-3e2670da4d66 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:24.383982 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd3a1f-0b80-4d36-afe8-3e2670da4d66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:24.385743 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd3a1f-0b80-4d36-afe8-3e2670da4d66 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:24.392434 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6a645-5a65-4da5-9a76-704adad89cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:24.393050 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6a645-5a65-4da5-9a76-704adad89cde None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:24.393352 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6a645-5a65-4da5-9a76-704adad89cde None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:24.393629 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6a645-5a65-4da5-9a76-704adad89cde None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:24.394269 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6a645-5a65-4da5-9a76-704adad89cde None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:24.394724 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6a645-5a65-4da5-9a76-704adad89cde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:24.396228 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6a645-5a65-4da5-9a76-704adad89cde None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:24.404419 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 352/702] 10.222.0.27 () {56 vars in 1124 bytes} [Sun Aug 7 10:42:24 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:24.412720 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 351/703] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Aug 7 10:42:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:24.418102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6a645-5a65-4da5-9a76-704adad89cde None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:24.499446 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:24.564526 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6a645-5a65-4da5-9a76-704adad89cde None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:24.602317 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10268c30-347d-42f3-ab40-feda48943d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:24.602918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10268c30-347d-42f3-ab40-feda48943d6e None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:24.603193 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10268c30-347d-42f3-ab40-feda48943d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:24.603459 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10268c30-347d-42f3-ab40-feda48943d6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:24.628644 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dda5c2-250a-45b7-9492-4813ef654e0d None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:24.628930 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dda5c2-250a-45b7-9492-4813ef654e0d None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:24.629199 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dda5c2-250a-45b7-9492-4813ef654e0d None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:24.630733 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 352/704] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:24.636204 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae51a99-454e-4612-9e3b-b112b0f7428f None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:24.636489 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae51a99-454e-4612-9e3b-b112b0f7428f None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:24.636761 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae51a99-454e-4612-9e3b-b112b0f7428f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:24.671197 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-1ae51a99-454e-4612-9e3b-b112b0f7428f None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:24.672578 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-1ae51a99-454e-4612-9e3b-b112b0f7428f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:24.681745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10268c30-347d-42f3-ab40-feda48943d6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:24.683199 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10268c30-347d-42f3-ab40-feda48943d6e None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:24.730940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:24.759082 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 353/705] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 10:42:24.806602 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 353/706] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:42:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:42:24.810909 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae51a99-454e-4612-9e3b-b112b0f7428f None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:24.814437 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10268c30-347d-42f3-ab40-feda48943d6e None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:24.970872 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae51a99-454e-4612-9e3b-b112b0f7428f None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:24.971558 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10268c30-347d-42f3-ab40-feda48943d6e None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:24.973386 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:25.009510 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e34c06-5376-4203-9006-5a4bda649151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:25.010149 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e34c06-5376-4203-9006-5a4bda649151 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:25.010422 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e34c06-5376-4203-9006-5a4bda649151 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:25.010699 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e34c06-5376-4203-9006-5a4bda649151 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:25.024280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e34c06-5376-4203-9006-5a4bda649151 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:25.026707 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e34c06-5376-4203-9006-5a4bda649151 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:25.047083 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-53e34c06-5376-4203-9006-5a4bda649151 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:25.047083 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:25.047083 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:25.047083 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:25.047083 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:25.047083 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:25.047083 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:25.047083 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:25.047083 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:25.047083 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:25.047083 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:25.047083 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:25.047083 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:25.047083 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:25.047083 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:25.047083 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:25.048165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:25.048165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:25.048165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:25.048165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:25.048165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:25.048165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:25.048165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:25.048165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:25.048165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:25.048165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:25.048165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:25.048165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:25.048165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:25.048165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:25.048165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:25.048165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:25.048165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:25.049091 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:25.049091 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:25.049091 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:25.049091 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 354/707] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:25.058028 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b6943-f58e-457e-98b1-7d7127abd398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:25.058609 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e34c06-5376-4203-9006-5a4bda649151 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:25.058719 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b6943-f58e-457e-98b1-7d7127abd398 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:25.058929 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b6943-f58e-457e-98b1-7d7127abd398 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:25.059195 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b6943-f58e-457e-98b1-7d7127abd398 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:25.098182 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b6943-f58e-457e-98b1-7d7127abd398 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:25.099640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b6943-f58e-457e-98b1-7d7127abd398 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:25.112288 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:25.128954 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-2f0b6943-f58e-457e-98b1-7d7127abd398 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:25.128954 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:25.128954 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:25.128954 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:25.128954 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:25.128954 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:25.128954 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:25.128954 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:25.128954 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:25.128954 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:25.128954 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:25.128954 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:25.128954 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:25.128954 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:25.128954 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:25.128954 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:25.130184 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:25.130184 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:25.130184 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:25.130184 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:25.130184 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:25.130184 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:25.130184 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:25.130184 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:25.130184 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:25.130184 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:25.130184 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:25.130184 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:25.130184 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:25.130184 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:25.130184 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:25.130184 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:25.130184 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:25.131110 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:25.131110 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:25.131110 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:25.134779 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 354/708] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:25.145383 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b6943-f58e-457e-98b1-7d7127abd398 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:25.205227 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e34c06-5376-4203-9006-5a4bda649151 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:25.250779 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16856ced-f426-406a-92d4-3159a7b02dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:25.251618 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b6943-f58e-457e-98b1-7d7127abd398 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:25.251853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16856ced-f426-406a-92d4-3159a7b02dfc None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:25.252268 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16856ced-f426-406a-92d4-3159a7b02dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:25.252678 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16856ced-f426-406a-92d4-3159a7b02dfc None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:25.253777 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16856ced-f426-406a-92d4-3159a7b02dfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:25.254238 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16856ced-f426-406a-92d4-3159a7b02dfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:25.256643 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16856ced-f426-406a-92d4-3159a7b02dfc None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:25.273356 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 355/709] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:25.273356 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639e260-450e-46cf-b416-073bb233f89f None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:25.273356 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639e260-450e-46cf-b416-073bb233f89f None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:25.273356 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639e260-450e-46cf-b416-073bb233f89f None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:25.274554 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 356/710] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:25.275790 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639e260-450e-46cf-b416-073bb233f89f None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:25.298043 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:25.301192 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8399345-15ee-4c58-8f2c-2d8d53cc7b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:25.302021 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8399345-15ee-4c58-8f2c-2d8d53cc7b41 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:25.302458 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8399345-15ee-4c58-8f2c-2d8d53cc7b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:25.302935 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8399345-15ee-4c58-8f2c-2d8d53cc7b41 None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:25.304641 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8399345-15ee-4c58-8f2c-2d8d53cc7b41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:25.304982 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8399345-15ee-4c58-8f2c-2d8d53cc7b41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:25.306472 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8399345-15ee-4c58-8f2c-2d8d53cc7b41 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:25.325347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 355/711] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:25.325347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d695a-e861-4a65-a879-a0ba0f67ced0 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:25.325347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d695a-e861-4a65-a879-a0ba0f67ced0 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:25.325347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d695a-e861-4a65-a879-a0ba0f67ced0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:25.358329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-9b5d695a-e861-4a65-a879-a0ba0f67ced0 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:25.361000 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-9b5d695a-e861-4a65-a879-a0ba0f67ced0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:25.403934 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639e260-450e-46cf-b416-073bb233f89f None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:25.443335 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0556b8-b89d-4dea-8251-6db86b93d067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:25.444001 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0556b8-b89d-4dea-8251-6db86b93d067 None admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:25.444283 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0556b8-b89d-4dea-8251-6db86b93d067 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:25.444555 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0556b8-b89d-4dea-8251-6db86b93d067 None admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:25.445204 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0556b8-b89d-4dea-8251-6db86b93d067 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:25.446757 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0556b8-b89d-4dea-8251-6db86b93d067 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:25.477988 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 357/712] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 7 10:42:25 2022] POST /identity/v3/users => generated 254 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:42:25.479269 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0556b8-b89d-4dea-8251-6db86b93d067 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:25.572539 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:25.607573 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 356/713] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:42:25.631480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:25.635449 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d695a-e861-4a65-a879-a0ba0f67ced0 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:25.704391 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0556b8-b89d-4dea-8251-6db86b93d067 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:25.754800 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9994f-c0eb-434c-85a4-4294fe551ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:25.755436 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9994f-c0eb-434c-85a4-4294fe551ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:25.755714 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9994f-c0eb-434c-85a4-4294fe551ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:25.755981 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9994f-c0eb-434c-85a4-4294fe551ab3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:25.764523 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9994f-c0eb-434c-85a4-4294fe551ab3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:25.765989 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9994f-c0eb-434c-85a4-4294fe551ab3 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:25.779291 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-29c9994f-c0eb-434c-85a4-4294fe551ab3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:25.779291 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:25.779291 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:25.779291 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:25.779291 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:25.779291 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:25.779291 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:25.779291 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:25.779291 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:25.779291 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:25.779291 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:25.779291 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:25.779291 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:42:25.779291 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:42:25.779291 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:42:25.780312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:42:25.780312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:25.780312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:25.780312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:25.780312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:25.780312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:25.780312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:25.780312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:25.780312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:25.780312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:25.780312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:25.780312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:25.780312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:25.780312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:25.780312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:25.780312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:25.780312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:25.781234 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:42:25.781234 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:42:25.781234 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:42:25.781234 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:42:25.781234 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:42:25.781234 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:42:25.781234 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:25.781234 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:25.781697 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 358/714] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:25.787364 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9994f-c0eb-434c-85a4-4294fe551ab3 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:25.790712 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d695a-e861-4a65-a879-a0ba0f67ced0 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:25.841213 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4440ec9-423a-45cc-a998-8af90a9854c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:25.842342 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4440ec9-423a-45cc-a998-8af90a9854c2 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:25.842780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4440ec9-423a-45cc-a998-8af90a9854c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:25.843192 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4440ec9-423a-45cc-a998-8af90a9854c2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:25.844187 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4440ec9-423a-45cc-a998-8af90a9854c2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:25.846476 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4440ec9-423a-45cc-a998-8af90a9854c2 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:25.861263 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-b4440ec9-423a-45cc-a998-8af90a9854c2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 10:42:25.861263 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:25.861263 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 10:42:25.861263 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 10:42:25.861263 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 10:42:25.861263 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 10:42:25.861263 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 10:42:25.861263 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:25.861263 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 10:42:25.861263 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:25.861263 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 10:42:25.861263 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:25.861263 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:25.861263 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:25.861263 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:25.861263 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:25.861263 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:25.862515 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:25.862515 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:25.862515 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:25.862515 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:25.862515 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:25.862515 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:25.862515 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 10:42:25.862515 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 10:42:25.862515 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 10:42:25.862515 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 10:42:25.862515 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:25.862515 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:25.862515 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:25.862515 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:25.862515 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:25.862515 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:25.863529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:25.863529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:25.863529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:25.863529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:25.863529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:25.863529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:25.863529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:25.863529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:25.863529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:25.863529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:25.863529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 10:42:25.863529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:25.863529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 10:42:25.863529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:25.866797 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 357/715] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:25 2022] GET /identity/v3/services/network => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:42:25.872503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4440ec9-423a-45cc-a998-8af90a9854c2 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:25.914605 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9994f-c0eb-434c-85a4-4294fe551ab3 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:25.953741 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:25.969664 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:25.975520 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe233dc-c237-4267-9d11-c31da4a27e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:25.977008 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe233dc-c237-4267-9d11-c31da4a27e70 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:25.977293 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe233dc-c237-4267-9d11-c31da4a27e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:25.977587 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe233dc-c237-4267-9d11-c31da4a27e70 None admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:25.978292 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe233dc-c237-4267-9d11-c31da4a27e70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:25.978600 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe233dc-c237-4267-9d11-c31da4a27e70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:25.980058 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe233dc-c237-4267-9d11-c31da4a27e70 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:26.069676 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4440ec9-423a-45cc-a998-8af90a9854c2 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:26.146649 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 359/716] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:42:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:26.154993 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c6ba6-98f4-4205-8066-fc0128731ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:26.155870 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c6ba6-98f4-4205-8066-fc0128731ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:26.155977 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe233dc-c237-4267-9d11-c31da4a27e70 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:26.156459 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c6ba6-98f4-4205-8066-fc0128731ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:26.156920 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c6ba6-98f4-4205-8066-fc0128731ba6 None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:26.157809 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c6ba6-98f4-4205-8066-fc0128731ba6 None admin] RBAC: Adding query filter params (name=network) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:26.158299 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c6ba6-98f4-4205-8066-fc0128731ba6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:26.159860 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c6ba6-98f4-4205-8066-fc0128731ba6 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:26.173842 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 358/717] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 7 10:42:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:26.198617 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c6ba6-98f4-4205-8066-fc0128731ba6 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:26.354826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe233dc-c237-4267-9d11-c31da4a27e70 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:26.420193 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86baf78-3ecb-4e4d-95b4-de619f7cf12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:26.421172 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86baf78-3ecb-4e4d-95b4-de619f7cf12d None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:26.421522 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86baf78-3ecb-4e4d-95b4-de619f7cf12d None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:26.421972 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86baf78-3ecb-4e4d-95b4-de619f7cf12d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:26.423959 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86baf78-3ecb-4e4d-95b4-de619f7cf12d None admin] RBAC: Adding query filter params (role.id=9da6e501237c405ca021a9d9f6173caf, scope.project.id=62eed8550ae3403f8a75894dbd19cf4a, user.id=f98cb7abbb8942cebb71aa98da80a05a) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:26.424492 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86baf78-3ecb-4e4d-95b4-de619f7cf12d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:26.427806 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86baf78-3ecb-4e4d-95b4-de619f7cf12d None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:26.439460 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 360/718] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:42:26 2022] GET /identity/v3/role_assignments?user.id=f98cb7abbb8942cebb71aa98da80a05a&scope.project.id=62eed8550ae3403f8a75894dbd19cf4a&role.id=9da6e501237c405ca021a9d9f6173caf => generated 259 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:26.456142 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c6ba6-98f4-4205-8066-fc0128731ba6 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:26.529747 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:26.538855 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b6c80-74fe-4e53-b8f2-4dab5e89b4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:26.539859 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b6c80-74fe-4e53-b8f2-4dab5e89b4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:26.540581 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b6c80-74fe-4e53-b8f2-4dab5e89b4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:26.541265 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b6c80-74fe-4e53-b8f2-4dab5e89b4a0 None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:26.542495 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b6c80-74fe-4e53-b8f2-4dab5e89b4a0 None admin] RBAC: Adding query filter params (type=network) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:26.545971 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b6c80-74fe-4e53-b8f2-4dab5e89b4a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:26.549038 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b6c80-74fe-4e53-b8f2-4dab5e89b4a0 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:26.557965 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 359/719] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 7 10:42:26 2022] GET /identity/v3/services?type=network => generated 124 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:26.784516 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c60214-ff9a-468b-a833-e0b67040a0b3 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:26.784879 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c60214-ff9a-468b-a833-e0b67040a0b3 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:26.785271 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c60214-ff9a-468b-a833-e0b67040a0b3 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:26.787880 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 361/720] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:26.793593 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7db5c-3f30-49ec-95bd-d4c244c49a2b None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:26.793890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7db5c-3f30-49ec-95bd-d4c244c49a2b None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:26.794132 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7db5c-3f30-49ec-95bd-d4c244c49a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:26.813721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-b9e7db5c-3f30-49ec-95bd-d4c244c49a2b None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:26.814936 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-b9e7db5c-3f30-49ec-95bd-d4c244c49a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:26.921396 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 360/721] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:42:26.942104 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c60214-ff9a-468b-a833-e0b67040a0b3 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:26.956237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd8ea9-124e-41fa-9694-b4fcad043c5f None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:26.956613 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd8ea9-124e-41fa-9694-b4fcad043c5f None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:26.956851 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd8ea9-124e-41fa-9694-b4fcad043c5f None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:26.958433 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 361/722] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:26.966035 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834cc5ee-80c5-4567-9379-5c7613136d90 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:26.966316 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834cc5ee-80c5-4567-9379-5c7613136d90 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:26.966586 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834cc5ee-80c5-4567-9379-5c7613136d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:26.987903 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-834cc5ee-80c5-4567-9379-5c7613136d90 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:26.989195 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-834cc5ee-80c5-4567-9379-5c7613136d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:27.012599 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:27.069620 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c60214-ff9a-468b-a833-e0b67040a0b3 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:27.079312 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 362/723] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:42:27.102452 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834cc5ee-80c5-4567-9379-5c7613136d90 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:27.120054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b39b6-dae2-47b5-baba-1e60a50031c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:27.121468 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b39b6-dae2-47b5-baba-1e60a50031c7 None admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:27.121968 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b39b6-dae2-47b5-baba-1e60a50031c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:27.122240 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b39b6-dae2-47b5-baba-1e60a50031c7 None admin] PATH_INFO: `/v3/services` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:27.122905 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b39b6-dae2-47b5-baba-1e60a50031c7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:27.127129 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b39b6-dae2-47b5-baba-1e60a50031c7 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:27.156577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 362/724] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 7 10:42:26 2022] POST /identity/v3/services => generated 251 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:42:27.178946 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:27.249817 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834cc5ee-80c5-4567-9379-5c7613136d90 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:27.304349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994c599-c07f-436b-959a-9fa66f4a98aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:27.304983 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994c599-c07f-436b-959a-9fa66f4a98aa None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:27.305261 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994c599-c07f-436b-959a-9fa66f4a98aa None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:27.305565 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994c599-c07f-436b-959a-9fa66f4a98aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:27.318023 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994c599-c07f-436b-959a-9fa66f4a98aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:42:27.322933 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-1994c599-c07f-436b-959a-9fa66f4a98aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:42:27.322933 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:27.322933 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:27.322933 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:27.322933 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:27.322933 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:27.322933 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:27.322933 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:27.322933 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:27.322933 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:27.322933 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:27.322933 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:27.322933 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:42:27.322933 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:42:27.322933 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:42:27.322933 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:42:27.323882 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:42:27.323882 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:42:27.323882 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:42:27.323882 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:42:27.323882 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:27.323882 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:27.323882 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:27.323882 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:27.323882 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:27.323882 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:27.323882 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:27.323882 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:27.323882 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:27.323882 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:27.323882 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:27.323882 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:27.325103 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:27.325103 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:27.325103 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:27.325103 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:27.325103 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:42:27.325103 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:42:27.325103 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:42:27.325103 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:42:27.325103 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:42:27.325103 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:42:27.325103 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:42:27.325103 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:27.325103 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 363/725] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:42:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:42:27.336415 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b39b6-dae2-47b5-baba-1e60a50031c7 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:27.459704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b39b6-dae2-47b5-baba-1e60a50031c7 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:27.476971 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:27.499425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973641f8-1df5-425f-b087-623e875bada6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:27.500038 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973641f8-1df5-425f-b087-623e875bada6 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:27.500312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973641f8-1df5-425f-b087-623e875bada6 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:27.500581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973641f8-1df5-425f-b087-623e875bada6 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:27.501894 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973641f8-1df5-425f-b087-623e875bada6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:27.502195 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973641f8-1df5-425f-b087-623e875bada6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:27.503626 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973641f8-1df5-425f-b087-623e875bada6 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:27.514148 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 363/726] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:42:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:27.519789 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994c599-c07f-436b-959a-9fa66f4a98aa None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:27.623926 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:27.631566 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994c599-c07f-436b-959a-9fa66f4a98aa None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:27.667918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909298b-605d-42fd-8536-1cfeed2f0a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:27.668540 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909298b-605d-42fd-8536-1cfeed2f0a32 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:27.668817 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909298b-605d-42fd-8536-1cfeed2f0a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:27.669086 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909298b-605d-42fd-8536-1cfeed2f0a32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:27.680163 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909298b-605d-42fd-8536-1cfeed2f0a32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:27.681621 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909298b-605d-42fd-8536-1cfeed2f0a32 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:27.696576 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-4909298b-605d-42fd-8536-1cfeed2f0a32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:27.696576 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:27.696576 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:27.696576 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:27.696576 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:27.696576 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:27.696576 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:27.696576 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:27.696576 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:27.696576 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:27.696576 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:27.696576 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:27.696576 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:27.696576 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:27.696576 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:27.696576 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:27.697550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:27.697550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:27.697550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:27.697550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:27.697550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:27.697550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:27.697550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:27.697550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:27.697550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:27.697550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:27.697550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:27.697550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:27.697550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:27.697550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:27.697550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:27.697550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:27.697550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:27.699065 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:27.699065 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:27.699065 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:27.699065 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 364/727] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:27.705698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973641f8-1df5-425f-b087-623e875bada6 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:27.817270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973641f8-1df5-425f-b087-623e875bada6 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:27.852521 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d80b89-cf46-4342-801d-afb559345123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:27.853126 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d80b89-cf46-4342-801d-afb559345123 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:27.853431 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d80b89-cf46-4342-801d-afb559345123 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:27.853704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d80b89-cf46-4342-801d-afb559345123 None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:27.854347 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d80b89-cf46-4342-801d-afb559345123 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:27.854647 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d80b89-cf46-4342-801d-afb559345123 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:27.856015 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d80b89-cf46-4342-801d-afb559345123 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:27.868425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 364/728] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:27.874267 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909298b-605d-42fd-8536-1cfeed2f0a32 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:28.008028 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909298b-605d-42fd-8536-1cfeed2f0a32 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:28.060435 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad2374-b266-4b3b-87be-94d0ebcf3be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:28.061067 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad2374-b266-4b3b-87be-94d0ebcf3be6 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:28.061357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad2374-b266-4b3b-87be-94d0ebcf3be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:28.061630 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad2374-b266-4b3b-87be-94d0ebcf3be6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:28.074336 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad2374-b266-4b3b-87be-94d0ebcf3be6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:28.075762 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad2374-b266-4b3b-87be-94d0ebcf3be6 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:28.090651 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-c2ad2374-b266-4b3b-87be-94d0ebcf3be6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 10:42:28.090651 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:28.090651 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:28.090651 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:28.090651 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:28.090651 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:28.090651 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:28.090651 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:28.090651 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:28.090651 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:28.090651 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:28.090651 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:28.090651 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:42:28.090651 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:42:28.090651 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:42:28.090651 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:42:28.091721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:28.091721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:28.091721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:42:28.091721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:28.091721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:42:28.091721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:28.091721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:28.091721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:28.091721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:28.091721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:28.091721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:28.091721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:28.091721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:28.091721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:28.091721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:28.091721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:28.091721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:28.091721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:28.093277 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:28.093277 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:28.093277 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:42:28.093277 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:42:28.093277 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:42:28.093277 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:42:28.093277 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:42:28.093277 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:42:28.093277 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 10:42:28.093277 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:28.093277 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 365/729] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:42:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:28.098333 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d80b89-cf46-4342-801d-afb559345123 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:28.120503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36c2c8-74bc-47f1-8fc2-dde1725d0a0f None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:28.120833 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36c2c8-74bc-47f1-8fc2-dde1725d0a0f None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:28.121036 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36c2c8-74bc-47f1-8fc2-dde1725d0a0f None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:28.124060 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 366/730] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 10:42:28.131396 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04fed8-0ffa-4c9e-8172-148c81577377 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:28.131631 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04fed8-0ffa-4c9e-8172-148c81577377 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:28.131861 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04fed8-0ffa-4c9e-8172-148c81577377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:28.162766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-8f04fed8-0ffa-4c9e-8172-148c81577377 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:28.167913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-8f04fed8-0ffa-4c9e-8172-148c81577377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:28.170123 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:28.171280 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:28.243851 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d80b89-cf46-4342-801d-afb559345123 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:28.306471 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 367/731] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:28 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 10:42:28.309753 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8d608-e020-4651-a920-2033f6483c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:28.310400 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8d608-e020-4651-a920-2033f6483c2d None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:28.310682 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8d608-e020-4651-a920-2033f6483c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:28.311001 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8d608-e020-4651-a920-2033f6483c2d None admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:28.311744 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8d608-e020-4651-a920-2033f6483c2d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:28.312043 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8d608-e020-4651-a920-2033f6483c2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:28.314039 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8d608-e020-4651-a920-2033f6483c2d None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:28.336295 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04fed8-0ffa-4c9e-8172-148c81577377 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:28.353883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 365/732] 10.222.0.27 () {56 vars in 1135 bytes} [Sun Aug 7 10:42:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:28.359563 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8d608-e020-4651-a920-2033f6483c2d None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:28.530753 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04fed8-0ffa-4c9e-8172-148c81577377 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:28.574369 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:28.578752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c559ab7-31c9-4d2f-938b-7ebea0f12b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:28.579807 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c559ab7-31c9-4d2f-938b-7ebea0f12b57 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:28.580290 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c559ab7-31c9-4d2f-938b-7ebea0f12b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:28.580780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c559ab7-31c9-4d2f-938b-7ebea0f12b57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:28.588892 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:28.593880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c559ab7-31c9-4d2f-938b-7ebea0f12b57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:42:28.596156 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8d608-e020-4651-a920-2033f6483c2d None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:28.600174 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-2c559ab7-31c9-4d2f-938b-7ebea0f12b57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:28.600174 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:28.600174 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:28.600174 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:28.600174 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:28.600174 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:28.600174 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:28.600174 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:28.600174 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:28.600174 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:28.600174 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:28.600174 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:28.600174 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:42:28.600174 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:42:28.600174 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:42:28.600174 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:42:28.601104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:42:28.601104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:42:28.601104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:42:28.601104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:42:28.601104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:28.601104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:28.601104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:28.601104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:28.601104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:28.601104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:28.601104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:28.601104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:28.601104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:28.601104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:28.601104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:28.601104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:28.602260 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:28.602260 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:28.602260 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:28.602260 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:28.602260 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:42:28.602260 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:42:28.602260 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:42:28.602260 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:42:28.602260 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:42:28.602260 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:42:28.602260 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:28.602260 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:28.605591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 368/733] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 7 10:42:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:42:28.613816 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c559ab7-31c9-4d2f-938b-7ebea0f12b57 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:28.659217 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8dcd2-0c0a-436f-a43f-d30a5027765f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:28.659865 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8dcd2-0c0a-436f-a43f-d30a5027765f None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:28.660170 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8dcd2-0c0a-436f-a43f-d30a5027765f None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:28.660447 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8dcd2-0c0a-436f-a43f-d30a5027765f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:28.789192 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8dcd2-0c0a-436f-a43f-d30a5027765f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:28.790591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8dcd2-0c0a-436f-a43f-d30a5027765f None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:28.792824 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c559ab7-31c9-4d2f-938b-7ebea0f12b57 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:28.853109 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd67d9-444b-4d40-848a-a63a91613b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:28.853740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd67d9-444b-4d40-848a-a63a91613b86 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:28.854014 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd67d9-444b-4d40-848a-a63a91613b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:28.854620 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd67d9-444b-4d40-848a-a63a91613b86 None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:28.855430 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd67d9-444b-4d40-848a-a63a91613b86 None admin] RBAC: Adding query filter params (name=service) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:28.855731 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd67d9-444b-4d40-848a-a63a91613b86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:28.857186 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd67d9-444b-4d40-848a-a63a91613b86 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:28.866582 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 369/734] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 7 10:42:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:28.877885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd67d9-444b-4d40-848a-a63a91613b86 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:28.965715 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:29.007854 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:29.016996 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd67d9-444b-4d40-848a-a63a91613b86 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:29.025037 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 366/735] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:42:28 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 10:42:29.030169 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8dcd2-0c0a-436f-a43f-d30a5027765f None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:29.058854 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faad89c-786e-46dd-9e2e-0b1492d5e0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:29.059462 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faad89c-786e-46dd-9e2e-0b1492d5e0fe None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:29.059737 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faad89c-786e-46dd-9e2e-0b1492d5e0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:29.059994 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faad89c-786e-46dd-9e2e-0b1492d5e0fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:29.072485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faad89c-786e-46dd-9e2e-0b1492d5e0fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:29.074103 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faad89c-786e-46dd-9e2e-0b1492d5e0fe None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:29.089394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-6faad89c-786e-46dd-9e2e-0b1492d5e0fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:29.089394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:29.089394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:29.089394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:29.089394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:29.089394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:29.089394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:29.089394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:29.089394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:29.089394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:29.089394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:29.089394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:29.089394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:29.089394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:29.089394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:29.089394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:29.090407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:29.090407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:29.090407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:29.090407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:29.090407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:29.090407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:29.090407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:29.090407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:29.090407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:29.090407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:29.090407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:29.090407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:29.090407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:29.090407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:29.090407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:29.090407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:29.090407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:29.091627 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:29.091627 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:29.091627 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:29.091627 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 370/736] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:42:29.099561 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faad89c-786e-46dd-9e2e-0b1492d5e0fe None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:29.182907 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8dcd2-0c0a-436f-a43f-d30a5027765f None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:29.206259 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faad89c-786e-46dd-9e2e-0b1492d5e0fe None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:29.218102 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266245b-1dc4-488e-a6f9-5651f05a337c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:29.218727 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266245b-1dc4-488e-a6f9-5651f05a337c None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:29.219001 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266245b-1dc4-488e-a6f9-5651f05a337c None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:29.219267 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266245b-1dc4-488e-a6f9-5651f05a337c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:29.221440 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:29.232768 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266245b-1dc4-488e-a6f9-5651f05a337c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:29.234377 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266245b-1dc4-488e-a6f9-5651f05a337c None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:29.247219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa6154-0cb7-4ccb-8073-9807cd523d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:29.248144 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa6154-0cb7-4ccb-8073-9807cd523d07 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:29.248641 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa6154-0cb7-4ccb-8073-9807cd523d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:29.249128 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa6154-0cb7-4ccb-8073-9807cd523d07 None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:29.250010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa6154-0cb7-4ccb-8073-9807cd523d07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:29.250131 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-7266245b-1dc4-488e-a6f9-5651f05a337c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:29.250131 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:29.250131 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:29.250131 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:29.250131 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:29.250131 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:29.250131 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:29.250131 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:29.250131 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:29.250131 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:29.250131 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:29.250131 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:29.250131 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:29.250131 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:29.250131 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:29.250131 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:29.251561 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:29.251561 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:29.251561 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:29.251561 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:29.251561 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:29.251561 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:29.251561 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:29.251561 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:29.251561 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:29.251561 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:29.251561 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:29.251561 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:29.251561 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:29.251561 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:29.251561 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:29.251561 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:29.251561 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:29.253061 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:29.253061 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:29.253061 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:29.253061 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 367/737] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:29.253332 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633dfbf-3469-4aa1-97c1-d77b092b08a8 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:29.253554 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633dfbf-3469-4aa1-97c1-d77b092b08a8 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:29.253783 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633dfbf-3469-4aa1-97c1-d77b092b08a8 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:29.254276 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa6154-0cb7-4ccb-8073-9807cd523d07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:29.258979 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 368/738] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:29.258979 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633dfbf-3469-4aa1-97c1-d77b092b08a8 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:29.260069 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa6154-0cb7-4ccb-8073-9807cd523d07 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:29.273461 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 371/739] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:29.274946 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085dbd4-486f-41ea-bfb6-c88c5924c5e2 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:29.275379 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085dbd4-486f-41ea-bfb6-c88c5924c5e2 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:29.275795 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085dbd4-486f-41ea-bfb6-c88c5924c5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:29.294550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-f085dbd4-486f-41ea-bfb6-c88c5924c5e2 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:29.295954 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-f085dbd4-486f-41ea-bfb6-c88c5924c5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:29.317921 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:29.376012 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633dfbf-3469-4aa1-97c1-d77b092b08a8 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:29.384956 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 372/740] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:29 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 10:42:29.386177 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085dbd4-486f-41ea-bfb6-c88c5924c5e2 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:29.424887 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42113b38-c020-43f7-a583-2b15d87d419d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:29.425539 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42113b38-c020-43f7-a583-2b15d87d419d None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:29.425820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42113b38-c020-43f7-a583-2b15d87d419d None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:29.426089 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42113b38-c020-43f7-a583-2b15d87d419d None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:29.426746 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42113b38-c020-43f7-a583-2b15d87d419d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:29.427043 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42113b38-c020-43f7-a583-2b15d87d419d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:29.428422 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42113b38-c020-43f7-a583-2b15d87d419d None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:29.441815 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 369/741] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:29.443128 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72756c63-b20c-487c-81f7-3bc30818cc9d None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:29.443415 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72756c63-b20c-487c-81f7-3bc30818cc9d None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:29.443681 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72756c63-b20c-487c-81f7-3bc30818cc9d None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:29.448791 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 370/742] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:29.448791 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72756c63-b20c-487c-81f7-3bc30818cc9d None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:29.504456 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085dbd4-486f-41ea-bfb6-c88c5924c5e2 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:29.506176 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:29.543182 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac6627-ace9-4ef5-8000-3bb8786d60ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:29.543804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac6627-ace9-4ef5-8000-3bb8786d60ef None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:29.544071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac6627-ace9-4ef5-8000-3bb8786d60ef None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:29.544343 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac6627-ace9-4ef5-8000-3bb8786d60ef None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:29.552063 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac6627-ace9-4ef5-8000-3bb8786d60ef None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:29.553516 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac6627-ace9-4ef5-8000-3bb8786d60ef None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:29.558001 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72756c63-b20c-487c-81f7-3bc30818cc9d None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:29.565147 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-dbac6627-ace9-4ef5-8000-3bb8786d60ef None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 10:42:29.565147 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:29.565147 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:29.565147 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:29.565147 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:29.565147 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:29.565147 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:29.565147 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:29.565147 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:29.565147 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:29.565147 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:29.565147 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:29.565147 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:42:29.565147 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:42:29.565147 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:42:29.565147 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:42:29.566274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:29.566274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:29.566274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:42:29.566274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:29.566274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:42:29.566274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:29.566274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:29.566274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:29.566274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:29.566274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:29.566274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:29.566274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:29.566274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:29.566274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:29.566274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:29.566274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:29.566274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:29.566274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:29.567224 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:29.567224 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:29.567224 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:42:29.567224 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:42:29.567224 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:42:29.567224 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:42:29.567224 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:42:29.567224 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:42:29.567224 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 10:42:29.567224 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:29.567224 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 373/743] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Aug 7 10:42:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:29.567849 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac6627-ace9-4ef5-8000-3bb8786d60ef None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:29.574634 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:29.602261 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d516cd7-004b-4430-90de-c5d5fe5ed60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:29.602864 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d516cd7-004b-4430-90de-c5d5fe5ed60e None admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:29.603191 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d516cd7-004b-4430-90de-c5d5fe5ed60e None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:29.603460 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d516cd7-004b-4430-90de-c5d5fe5ed60e None admin] PATH_INFO: `/v3/services` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:29.604100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d516cd7-004b-4430-90de-c5d5fe5ed60e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:29.605582 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d516cd7-004b-4430-90de-c5d5fe5ed60e None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:29.633346 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 371/744] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 7 10:42:29 2022] POST /identity/v3/services => generated 240 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:42:29.633346 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66cad8-bfec-4039-9db5-762c1cf47d4a None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:29.633346 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66cad8-bfec-4039-9db5-762c1cf47d4a None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:29.633346 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66cad8-bfec-4039-9db5-762c1cf47d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:29.660981 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-5a66cad8-bfec-4039-9db5-762c1cf47d4a None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:29.663270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-5a66cad8-bfec-4039-9db5-762c1cf47d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:29.683704 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac6627-ace9-4ef5-8000-3bb8786d60ef None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:29.742042 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b13cd-77e1-48be-8f31-e4f2d0a638b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:29.742745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b13cd-77e1-48be-8f31-e4f2d0a638b1 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:29.743061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b13cd-77e1-48be-8f31-e4f2d0a638b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:29.743333 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b13cd-77e1-48be-8f31-e4f2d0a638b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:29.754077 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b13cd-77e1-48be-8f31-e4f2d0a638b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:29.756499 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b13cd-77e1-48be-8f31-e4f2d0a638b1 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:29.765486 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 372/745] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:42:29.767400 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66cad8-bfec-4039-9db5-762c1cf47d4a None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:29.775153 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-2c3b13cd-77e1-48be-8f31-e4f2d0a638b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:29.775153 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:29.775153 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:29.775153 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:29.775153 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:29.775153 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:29.775153 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:29.775153 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:29.775153 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:29.775153 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:29.775153 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:29.775153 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:29.775153 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:42:29.775153 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:42:29.775153 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:42:29.776253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:42:29.776253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:29.776253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:29.776253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:29.776253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:29.776253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:29.776253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:29.776253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:29.776253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:29.776253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:29.776253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:29.776253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:29.776253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:29.776253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:29.776253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:29.776253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:29.776253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:29.777347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:42:29.777347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:42:29.777347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:42:29.777347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:42:29.777347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:42:29.777347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:42:29.777347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:29.777347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:29.777347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 374/746] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:29.784085 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b13cd-77e1-48be-8f31-e4f2d0a638b1 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:29.808825 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:29.884115 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:29.887922 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66cad8-bfec-4039-9db5-762c1cf47d4a None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:29.903242 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b13cd-77e1-48be-8f31-e4f2d0a638b1 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:29.925702 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65330151-17de-4e77-83a6-41064e81a30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:29.926312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65330151-17de-4e77-83a6-41064e81a30e None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:29.926588 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65330151-17de-4e77-83a6-41064e81a30e None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:29.926858 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65330151-17de-4e77-83a6-41064e81a30e None admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:29.927610 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65330151-17de-4e77-83a6-41064e81a30e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:29.927887 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65330151-17de-4e77-83a6-41064e81a30e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:29.929304 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65330151-17de-4e77-83a6-41064e81a30e None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:29.944572 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6659c7-a54a-4695-9cda-119b331a4fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:29.945481 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6659c7-a54a-4695-9cda-119b331a4fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:29.946194 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6659c7-a54a-4695-9cda-119b331a4fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:29.946659 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6659c7-a54a-4695-9cda-119b331a4fc6 None admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:29.947553 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6659c7-a54a-4695-9cda-119b331a4fc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:29.947700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 373/747] 10.222.0.27 () {56 vars in 1149 bytes} [Sun Aug 7 10:42:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:29.948145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6659c7-a54a-4695-9cda-119b331a4fc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:29.948528 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65330151-17de-4e77-83a6-41064e81a30e None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:29.949957 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6659c7-a54a-4695-9cda-119b331a4fc6 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:29.970249 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 375/748] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:42:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:29.971798 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364190c-100c-4515-a503-1789858be6fe None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:29.972300 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364190c-100c-4515-a503-1789858be6fe None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:29.972748 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364190c-100c-4515-a503-1789858be6fe None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:29.974525 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 376/749] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:29.975417 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364190c-100c-4515-a503-1789858be6fe None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:30.059106 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65330151-17de-4e77-83a6-41064e81a30e None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:30.061191 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:30.084429 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364190c-100c-4515-a503-1789858be6fe None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:30.096404 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862061d-1299-4643-a242-6cc3e9b4ddcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:30.097258 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862061d-1299-4643-a242-6cc3e9b4ddcb None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:30.097705 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862061d-1299-4643-a242-6cc3e9b4ddcb None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:30.098118 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862061d-1299-4643-a242-6cc3e9b4ddcb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:30.108526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862061d-1299-4643-a242-6cc3e9b4ddcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:42:30.113810 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-6862061d-1299-4643-a242-6cc3e9b4ddcb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:42:30.113810 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:30.113810 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:30.113810 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:30.113810 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:30.113810 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:30.113810 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:30.113810 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:30.113810 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:30.113810 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:30.113810 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:30.113810 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:30.113810 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:42:30.113810 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:42:30.113810 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:42:30.113810 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:42:30.114729 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:42:30.114729 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:42:30.114729 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:42:30.114729 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:42:30.114729 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:30.114729 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:30.114729 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:30.114729 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:30.114729 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:30.114729 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:30.114729 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:30.114729 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:30.114729 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:30.114729 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:30.114729 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:30.114729 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:30.115557 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:30.115557 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:30.115557 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:30.115557 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:30.115557 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:42:30.115557 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:42:30.115557 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:42:30.115557 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:42:30.115557 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:42:30.115557 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:42:30.115557 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:42:30.115557 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:30.115557 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 374/750] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:42:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:30.116241 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862061d-1299-4643-a242-6cc3e9b4ddcb None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:30.125652 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16146e-2801-410a-ba26-3428ab5eba9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:30.126298 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16146e-2801-410a-ba26-3428ab5eba9e None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:30.126579 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16146e-2801-410a-ba26-3428ab5eba9e None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:30.126856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16146e-2801-410a-ba26-3428ab5eba9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:30.140580 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:30.200753 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16146e-2801-410a-ba26-3428ab5eba9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:30.202232 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16146e-2801-410a-ba26-3428ab5eba9e None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:30.229145 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862061d-1299-4643-a242-6cc3e9b4ddcb None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:30.266333 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b7896-28b0-443c-8544-7ef0c2b1f92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:30.266928 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b7896-28b0-443c-8544-7ef0c2b1f92c None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:30.267202 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b7896-28b0-443c-8544-7ef0c2b1f92c None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:30.267464 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b7896-28b0-443c-8544-7ef0c2b1f92c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:30.268182 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b7896-28b0-443c-8544-7ef0c2b1f92c None admin] RBAC: Adding query filter params (role.id=9da6e501237c405ca021a9d9f6173caf, scope.project.id=62eed8550ae3403f8a75894dbd19cf4a, user.id=a7181e5118c547a3a31d2e080c25ff01) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:30.268478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b7896-28b0-443c-8544-7ef0c2b1f92c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:30.269916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b7896-28b0-443c-8544-7ef0c2b1f92c None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:30.275592 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 375/751] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:42:30 2022] GET /identity/v3/role_assignments?user.id=a7181e5118c547a3a31d2e080c25ff01&scope.project.id=62eed8550ae3403f8a75894dbd19cf4a&role.id=9da6e501237c405ca021a9d9f6173caf => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:30.276541 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8333717-48d3-4fb7-babb-98d59881cc29 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:30.276819 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8333717-48d3-4fb7-babb-98d59881cc29 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:30.277082 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8333717-48d3-4fb7-babb-98d59881cc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:30.296174 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-f8333717-48d3-4fb7-babb-98d59881cc29 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:30.297450 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-f8333717-48d3-4fb7-babb-98d59881cc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:30.302804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:30.339185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 377/752] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:42:29 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 10:42:30.340440 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16146e-2801-410a-ba26-3428ab5eba9e None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:30.390205 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 376/753] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:42:30.390205 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8333717-48d3-4fb7-babb-98d59881cc29 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:30.410305 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:30.488892 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16146e-2801-410a-ba26-3428ab5eba9e None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:30.512128 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8333717-48d3-4fb7-babb-98d59881cc29 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:30.528733 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4bf591-066b-429e-8475-2cf563e1321f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:30.529358 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4bf591-066b-429e-8475-2cf563e1321f None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:30.529641 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4bf591-066b-429e-8475-2cf563e1321f None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:30.529910 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4bf591-066b-429e-8475-2cf563e1321f None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:30.530856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4bf591-066b-429e-8475-2cf563e1321f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:30.531155 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4bf591-066b-429e-8475-2cf563e1321f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:30.532715 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4bf591-066b-429e-8475-2cf563e1321f None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:30.543509 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 378/754] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:42:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:30.544539 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4bf591-066b-429e-8475-2cf563e1321f None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:30.551934 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c494e8-7fff-48c0-8599-faeb1988df1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:30.552829 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c494e8-7fff-48c0-8599-faeb1988df1d None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:30.553296 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c494e8-7fff-48c0-8599-faeb1988df1d None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:30.553791 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c494e8-7fff-48c0-8599-faeb1988df1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:30.568599 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c494e8-7fff-48c0-8599-faeb1988df1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:30.570723 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c494e8-7fff-48c0-8599-faeb1988df1d None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:30.589626 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-14c494e8-7fff-48c0-8599-faeb1988df1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:30.589626 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:30.589626 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:30.589626 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:30.589626 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:30.589626 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:30.589626 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:30.589626 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:30.589626 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:30.589626 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:30.589626 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:30.589626 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:30.589626 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:30.589626 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:30.589626 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:30.589626 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:30.590978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:30.590978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:30.590978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:30.590978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:30.590978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:30.590978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:30.590978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:30.590978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:30.590978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:30.590978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:30.590978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:30.590978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:30.590978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:30.590978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:30.590978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:30.590978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:30.590978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:30.591871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:30.591871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:30.591871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:30.595799 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 377/755] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:30.596642 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c494e8-7fff-48c0-8599-faeb1988df1d None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:30.600321 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:30.660673 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:30.667051 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4bf591-066b-429e-8475-2cf563e1321f None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:30.701841 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c494e8-7fff-48c0-8599-faeb1988df1d None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:30.703751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3703ba-b562-4845-a614-0ac5ec125bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:30.704520 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3703ba-b562-4845-a614-0ac5ec125bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:30.704801 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3703ba-b562-4845-a614-0ac5ec125bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:30.705167 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3703ba-b562-4845-a614-0ac5ec125bb6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:30.705831 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3703ba-b562-4845-a614-0ac5ec125bb6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:30.707243 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3703ba-b562-4845-a614-0ac5ec125bb6 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:30.716497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-ee3703ba-b562-4845-a614-0ac5ec125bb6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 10:42:30.716497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:30.716497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 10:42:30.716497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 10:42:30.716497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 10:42:30.716497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 10:42:30.716497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 10:42:30.716497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:30.716497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 10:42:30.716497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:30.716497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 10:42:30.716497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:30.716497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:30.716497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:30.716497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:30.716497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:30.716497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:30.717531 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:30.717531 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:30.717531 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:30.717531 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:30.717531 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:30.717531 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:30.717531 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 10:42:30.717531 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 10:42:30.717531 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 10:42:30.717531 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 10:42:30.717531 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:30.717531 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:30.717531 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:30.717531 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:30.717531 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:30.717531 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:30.718483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:30.718483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:30.718483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:30.718483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:30.718483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:30.718483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:30.718483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:30.718483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:30.718483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:30.718483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:30.718483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 10:42:30.718483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:30.718483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 10:42:30.718483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:30.723793 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 379/756] 10.222.0.27 () {56 vars in 1129 bytes} [Sun Aug 7 10:42:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:30.724815 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3703ba-b562-4845-a614-0ac5ec125bb6 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:30.742723 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725239f-489e-4230-9f32-5e13b4afd989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:30.743351 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725239f-489e-4230-9f32-5e13b4afd989 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:30.743621 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725239f-489e-4230-9f32-5e13b4afd989 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:30.743897 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725239f-489e-4230-9f32-5e13b4afd989 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:30.760162 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725239f-489e-4230-9f32-5e13b4afd989 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:30.762188 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725239f-489e-4230-9f32-5e13b4afd989 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:30.781859 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-3725239f-489e-4230-9f32-5e13b4afd989 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:30.781859 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:30.781859 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:30.781859 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:30.781859 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:30.781859 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:30.781859 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:30.781859 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:30.781859 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:30.781859 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:30.781859 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:30.781859 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:30.781859 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:30.781859 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:30.781859 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:30.781859 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:30.783399 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:30.783399 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:30.783399 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:30.783399 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:30.783399 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:30.783399 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:30.783399 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:30.783399 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:30.783399 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:30.783399 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:30.783399 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:30.783399 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:30.783399 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:30.783399 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:30.783399 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:30.783399 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:30.783399 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:30.784317 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:30.784317 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:30.784317 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:30.786764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 378/757] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:30.788599 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725239f-489e-4230-9f32-5e13b4afd989 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:30.836564 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3703ba-b562-4845-a614-0ac5ec125bb6 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:30.839872 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:30.876419 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e760a2c-ea3d-49fe-9716-79edf6af6585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:30.877025 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e760a2c-ea3d-49fe-9716-79edf6af6585 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:30.877298 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e760a2c-ea3d-49fe-9716-79edf6af6585 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:30.877605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e760a2c-ea3d-49fe-9716-79edf6af6585 None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:30.878324 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e760a2c-ea3d-49fe-9716-79edf6af6585 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:30.878620 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e760a2c-ea3d-49fe-9716-79edf6af6585 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:30.880029 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e760a2c-ea3d-49fe-9716-79edf6af6585 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:30.892203 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 380/758] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:30.893086 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e760a2c-ea3d-49fe-9716-79edf6af6585 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:30.918663 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725239f-489e-4230-9f32-5e13b4afd989 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:30.933661 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:30.955927 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f60bd-0b2f-4551-a93d-0bd6b4cde4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:30.956646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f60bd-0b2f-4551-a93d-0bd6b4cde4ae None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:30.956930 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f60bd-0b2f-4551-a93d-0bd6b4cde4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:30.957205 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f60bd-0b2f-4551-a93d-0bd6b4cde4ae None admin] PATH_INFO: `/v3/services` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:30.957904 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f60bd-0b2f-4551-a93d-0bd6b4cde4ae None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:30.958209 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f60bd-0b2f-4551-a93d-0bd6b4cde4ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:30.959585 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f60bd-0b2f-4551-a93d-0bd6b4cde4ae None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:30.965105 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 379/759] 10.222.0.27 () {56 vars in 1124 bytes} [Sun Aug 7 10:42:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:30.965960 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f60bd-0b2f-4551-a93d-0bd6b4cde4ae None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:31.006649 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e760a2c-ea3d-49fe-9716-79edf6af6585 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:31.050178 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a957b17-c987-41e8-ad47-56e9ab5ce686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:31.051282 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a957b17-c987-41e8-ad47-56e9ab5ce686 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:31.051827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a957b17-c987-41e8-ad47-56e9ab5ce686 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:31.052105 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a957b17-c987-41e8-ad47-56e9ab5ce686 None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:31.052753 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a957b17-c987-41e8-ad47-56e9ab5ce686 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:31.053055 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a957b17-c987-41e8-ad47-56e9ab5ce686 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:31.054624 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a957b17-c987-41e8-ad47-56e9ab5ce686 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:31.071150 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 381/760] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:31.072129 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a957b17-c987-41e8-ad47-56e9ab5ce686 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:31.095840 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f60bd-0b2f-4551-a93d-0bd6b4cde4ae None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:31.102795 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:31.137703 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff7750-57f4-4836-8f55-cd880c339f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:31.138848 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff7750-57f4-4836-8f55-cd880c339f11 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:31.139120 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff7750-57f4-4836-8f55-cd880c339f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:31.139383 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff7750-57f4-4836-8f55-cd880c339f11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:31.150025 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff7750-57f4-4836-8f55-cd880c339f11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:31.151474 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff7750-57f4-4836-8f55-cd880c339f11 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:31.166608 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-6bff7750-57f4-4836-8f55-cd880c339f11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:31.166608 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:31.166608 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:31.166608 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:31.166608 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:31.166608 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:31.166608 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:31.166608 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:31.166608 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:31.166608 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:31.166608 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:31.166608 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:31.166608 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:42:31.166608 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:42:31.166608 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:42:31.167548 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:42:31.167548 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:31.167548 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:31.167548 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:31.167548 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:31.167548 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:31.167548 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:31.167548 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:31.167548 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:31.167548 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:31.167548 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:31.167548 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:31.167548 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:31.167548 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:31.167548 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:31.167548 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:31.167548 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:31.168453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:42:31.168453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:42:31.168453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:42:31.168453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:42:31.168453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:42:31.168453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:42:31.168453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:31.168453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:31.168453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 380/761] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:31.171331 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff7750-57f4-4836-8f55-cd880c339f11 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:31.192384 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a957b17-c987-41e8-ad47-56e9ab5ce686 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:31.219838 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:31.240081 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca065642-eca4-4965-8e43-ccc4b83d3a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:31.240954 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca065642-eca4-4965-8e43-ccc4b83d3a7a None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:31.241659 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca065642-eca4-4965-8e43-ccc4b83d3a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:31.241944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca065642-eca4-4965-8e43-ccc4b83d3a7a None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:31.242891 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca065642-eca4-4965-8e43-ccc4b83d3a7a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:31.243203 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca065642-eca4-4965-8e43-ccc4b83d3a7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:31.245801 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca065642-eca4-4965-8e43-ccc4b83d3a7a None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:31.252278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 382/762] 10.222.0.27 () {56 vars in 1124 bytes} [Sun Aug 7 10:42:31 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:31.253132 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca065642-eca4-4965-8e43-ccc4b83d3a7a None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:31.302363 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff7750-57f4-4836-8f55-cd880c339f11 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:31.352587 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22488342-528e-4395-87c2-5a247069bb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:31.353127 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22488342-528e-4395-87c2-5a247069bb34 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:31.353497 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22488342-528e-4395-87c2-5a247069bb34 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:31.353773 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22488342-528e-4395-87c2-5a247069bb34 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:31.362213 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22488342-528e-4395-87c2-5a247069bb34 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:31.363394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22488342-528e-4395-87c2-5a247069bb34 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:31.372631 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:31.375420 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-22488342-528e-4395-87c2-5a247069bb34 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 10:42:31.375420 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:31.375420 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:31.375420 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:31.375420 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:31.375420 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:31.375420 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:31.375420 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:31.375420 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:31.375420 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:31.375420 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:31.375420 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:31.375420 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:42:31.375420 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:42:31.375420 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:42:31.375420 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:42:31.377237 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:31.377237 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:31.377237 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:42:31.377237 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:31.377237 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:42:31.377237 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:31.377237 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:31.377237 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:31.377237 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:31.377237 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:31.377237 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:31.377237 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:31.377237 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:31.377237 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:31.377237 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:31.377237 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:31.377237 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:31.377237 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:31.378201 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:31.378201 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:31.378201 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:42:31.378201 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:42:31.378201 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:42:31.378201 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:42:31.378201 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:42:31.378201 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:42:31.378201 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 10:42:31.378201 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:31.378201 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 381/763] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Aug 7 10:42:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:31.378780 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22488342-528e-4395-87c2-5a247069bb34 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:31.390258 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca065642-eca4-4965-8e43-ccc4b83d3a7a None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:31.426472 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999660fd-de29-4720-8aeb-271ecdb015a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:31.427392 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999660fd-de29-4720-8aeb-271ecdb015a8 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:31.427880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999660fd-de29-4720-8aeb-271ecdb015a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:31.428339 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999660fd-de29-4720-8aeb-271ecdb015a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:31.429216 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999660fd-de29-4720-8aeb-271ecdb015a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:31.429762 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999660fd-de29-4720-8aeb-271ecdb015a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:31.431474 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999660fd-de29-4720-8aeb-271ecdb015a8 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:31.444314 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 383/764] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:42:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:31.445620 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999660fd-de29-4720-8aeb-271ecdb015a8 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:31.486019 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:31.490949 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22488342-528e-4395-87c2-5a247069bb34 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:31.529368 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0d457-9b9e-443d-8317-ab5942f65cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:31.529916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0d457-9b9e-443d-8317-ab5942f65cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:31.530192 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0d457-9b9e-443d-8317-ab5942f65cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:31.530465 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0d457-9b9e-443d-8317-ab5942f65cc0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:31.531165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0d457-9b9e-443d-8317-ab5942f65cc0 None admin] RBAC: Adding query filter params (interface=public, service_id=f61f5e3a54864257bde04c47841cca9a, region_id=RegionOne) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:31.531470 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0d457-9b9e-443d-8317-ab5942f65cc0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:31.533541 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0d457-9b9e-443d-8317-ab5942f65cc0 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:31.545871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 382/765] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Aug 7 10:42:31 2022] GET /identity/v3/endpoints?service_id=f61f5e3a54864257bde04c47841cca9a&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:31.545871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0d457-9b9e-443d-8317-ab5942f65cc0 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:31.559926 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999660fd-de29-4720-8aeb-271ecdb015a8 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:31.596402 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e6782-646e-4547-95e5-549913f48959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:31.597619 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e6782-646e-4547-95e5-549913f48959 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:31.598093 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e6782-646e-4547-95e5-549913f48959 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:31.598553 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e6782-646e-4547-95e5-549913f48959 None admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:31.599630 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e6782-646e-4547-95e5-549913f48959 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:31.600129 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e6782-646e-4547-95e5-549913f48959 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:31.601816 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e6782-646e-4547-95e5-549913f48959 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:31.621505 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 384/766] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Aug 7 10:42:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:31.622785 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e6782-646e-4547-95e5-549913f48959 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:31.632668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:31.651723 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0d457-9b9e-443d-8317-ab5942f65cc0 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:31.691118 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff66519-5e61-4fc3-8a52-8b54e359c140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:31.692435 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff66519-5e61-4fc3-8a52-8b54e359c140 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:31.693096 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff66519-5e61-4fc3-8a52-8b54e359c140 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:31.693536 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff66519-5e61-4fc3-8a52-8b54e359c140 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:31.694408 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff66519-5e61-4fc3-8a52-8b54e359c140 None admin] RBAC: Adding query filter params (role.id=bf9e51dafeac420f89a66e78e1463982, scope.project.id=62eed8550ae3403f8a75894dbd19cf4a, user.id=e7eebb4bd7e04ff8bc4304a40cf6ba35) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:31.694858 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff66519-5e61-4fc3-8a52-8b54e359c140 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:31.697264 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff66519-5e61-4fc3-8a52-8b54e359c140 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:31.705268 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 383/767] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:42:31 2022] GET /identity/v3/role_assignments?user.id=e7eebb4bd7e04ff8bc4304a40cf6ba35&scope.project.id=62eed8550ae3403f8a75894dbd19cf4a&role.id=bf9e51dafeac420f89a66e78e1463982 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:31.706895 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff66519-5e61-4fc3-8a52-8b54e359c140 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:31.742498 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:31.768317 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e6782-646e-4547-95e5-549913f48959 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:31.812616 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952aee8b-a800-465f-8f54-9e1ff21bff92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:31.813225 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952aee8b-a800-465f-8f54-9e1ff21bff92 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:31.813706 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952aee8b-a800-465f-8f54-9e1ff21bff92 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:31.813976 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952aee8b-a800-465f-8f54-9e1ff21bff92 None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:31.814591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952aee8b-a800-465f-8f54-9e1ff21bff92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:31.815956 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952aee8b-a800-465f-8f54-9e1ff21bff92 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:31.823984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 385/768] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Aug 7 10:42:31 2022] GET /identity/v3/services => generated 772 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:31.829503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c77ec4-2bf7-4502-877c-1e39e7a57e1a None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:31.829503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c77ec4-2bf7-4502-877c-1e39e7a57e1a None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:31.829503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c77ec4-2bf7-4502-877c-1e39e7a57e1a None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:31.829503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 386/769] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:31.840360 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04c74a-1ba3-4793-9f31-13d68e66b60c None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:31.840710 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04c74a-1ba3-4793-9f31-13d68e66b60c None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:31.840900 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04c74a-1ba3-4793-9f31-13d68e66b60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:31.866222 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff66519-5e61-4fc3-8a52-8b54e359c140 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:31.868451 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-7e04c74a-1ba3-4793-9f31-13d68e66b60c None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:31.869814 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-7e04c74a-1ba3-4793-9f31-13d68e66b60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:31.911839 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb5d6b-78a0-425f-b01e-21ffc27b0e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:31.912625 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb5d6b-78a0-425f-b01e-21ffc27b0e4f None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:31.912905 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb5d6b-78a0-425f-b01e-21ffc27b0e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:31.913174 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb5d6b-78a0-425f-b01e-21ffc27b0e4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:31.929677 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb5d6b-78a0-425f-b01e-21ffc27b0e4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:31.931137 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb5d6b-78a0-425f-b01e-21ffc27b0e4f None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:31.967889 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-8bfb5d6b-78a0-425f-b01e-21ffc27b0e4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:31.967889 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:31.967889 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:31.967889 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:31.967889 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:31.967889 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:31.967889 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:31.967889 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:31.967889 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:31.967889 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:31.967889 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:31.967889 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:31.967889 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:31.967889 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:31.967889 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:31.967889 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:31.968886 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:31.968886 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:31.968886 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:31.968886 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:31.968886 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:31.968886 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:31.968886 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:31.968886 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:31.968886 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:31.968886 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:31.968886 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:31.968886 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:31.968886 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:31.968886 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:31.968886 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:31.968886 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:31.968886 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:31.969879 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:31.969879 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:31.969879 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:31.970845 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 384/770] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:31.976471 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb5d6b-78a0-425f-b01e-21ffc27b0e4f None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:31.987060 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:31.998167 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 387/771] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:42:32.024599 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04c74a-1ba3-4793-9f31-13d68e66b60c None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:32.090395 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:32.119793 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb5d6b-78a0-425f-b01e-21ffc27b0e4f None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:32.154679 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04c74a-1ba3-4793-9f31-13d68e66b60c None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:32.175204 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c685370-cae5-4e14-a45b-4b79b3f1b0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:32.176366 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c685370-cae5-4e14-a45b-4b79b3f1b0b1 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:32.178648 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c685370-cae5-4e14-a45b-4b79b3f1b0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:32.179127 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c685370-cae5-4e14-a45b-4b79b3f1b0b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:32.179977 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c685370-cae5-4e14-a45b-4b79b3f1b0b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:32.180680 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c685370-cae5-4e14-a45b-4b79b3f1b0b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:32.185357 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c685370-cae5-4e14-a45b-4b79b3f1b0b1 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:32.208145 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 385/772] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:32.213866 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c685370-cae5-4e14-a45b-4b79b3f1b0b1 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:32.230278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8eb90d-9d50-4a2d-a739-6690523cbe7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:32.231122 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8eb90d-9d50-4a2d-a739-6690523cbe7d None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:32.232700 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8eb90d-9d50-4a2d-a739-6690523cbe7d None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:32.233129 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8eb90d-9d50-4a2d-a739-6690523cbe7d None admin] PATH_INFO: `/v3/services/network` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:32.233888 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8eb90d-9d50-4a2d-a739-6690523cbe7d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:32.236614 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8eb90d-9d50-4a2d-a739-6690523cbe7d None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:32.254239 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-1a8eb90d-9d50-4a2d-a739-6690523cbe7d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 10:42:32.254239 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:32.254239 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 10:42:32.254239 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 10:42:32.254239 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 10:42:32.254239 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 10:42:32.254239 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 10:42:32.254239 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:32.254239 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 10:42:32.254239 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:32.254239 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 10:42:32.254239 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:32.254239 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:32.254239 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:32.254239 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:32.254239 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:32.254239 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:32.255473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:32.255473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:32.255473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:32.255473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:32.255473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:32.255473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:32.255473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 10:42:32.255473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 10:42:32.255473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 10:42:32.255473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 10:42:32.255473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:32.255473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:32.255473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:32.255473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:32.255473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:32.255473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:32.256497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:32.256497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:32.256497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:32.256497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:32.256497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:32.256497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:32.256497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:32.256497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:32.256497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:32.256497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:32.256497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 10:42:32.256497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:32.256497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 10:42:32.256497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:32.260450 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 388/773] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:32 2022] GET /identity/v3/services/network => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:42:32.265710 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8eb90d-9d50-4a2d-a739-6690523cbe7d None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:32.349672 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:32.414872 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c685370-cae5-4e14-a45b-4b79b3f1b0b1 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:32.423626 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8eb90d-9d50-4a2d-a739-6690523cbe7d None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:32.455606 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf7115-69e5-463e-bc35-e55fd8817f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:32.456406 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf7115-69e5-463e-bc35-e55fd8817f9f None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:32.456791 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf7115-69e5-463e-bc35-e55fd8817f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:32.457157 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf7115-69e5-463e-bc35-e55fd8817f9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:32.460056 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa23424-2a79-41cb-a20a-efd0bff74bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:32.460861 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa23424-2a79-41cb-a20a-efd0bff74bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:32.461350 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa23424-2a79-41cb-a20a-efd0bff74bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:32.461794 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa23424-2a79-41cb-a20a-efd0bff74bc5 None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:32.462612 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa23424-2a79-41cb-a20a-efd0bff74bc5 None admin] RBAC: Adding query filter params (name=network) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:32.463084 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa23424-2a79-41cb-a20a-efd0bff74bc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:32.464622 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa23424-2a79-41cb-a20a-efd0bff74bc5 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:32.464730 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf7115-69e5-463e-bc35-e55fd8817f9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:32.466342 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf7115-69e5-463e-bc35-e55fd8817f9f None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:32.468370 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:32.470800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 389/774] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 7 10:42:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:32.476914 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bd378-ee62-4652-a6b4-c616f218a38c None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:32.477458 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bd378-ee62-4652-a6b4-c616f218a38c None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:32.477908 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7bd378-ee62-4652-a6b4-c616f218a38c None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:32.479638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 390/775] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:32.480586 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bd378-ee62-4652-a6b4-c616f218a38c None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:32.491035 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-3edf7115-69e5-463e-bc35-e55fd8817f9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:32.491035 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:32.491035 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:32.491035 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:32.491035 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:32.491035 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:32.491035 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:32.491035 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:32.491035 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:32.491035 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:32.491035 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:32.491035 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:32.491035 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:42:32.491035 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:42:32.491035 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:42:32.491989 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:42:32.491989 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:32.491989 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:32.491989 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:32.491989 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:32.491989 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:32.491989 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:32.491989 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:32.491989 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:32.491989 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:32.491989 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:32.491989 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:32.491989 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:32.491989 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:32.491989 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:32.491989 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:32.491989 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:32.492881 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:42:32.492881 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:42:32.492881 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:42:32.492881 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:42:32.492881 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:42:32.492881 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:42:32.492881 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:32.492881 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:32.496988 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 386/776] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:32.498419 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30312352-1381-45f6-8a63-0773b87a5093 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:32.498699 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30312352-1381-45f6-8a63-0773b87a5093 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:32.498966 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30312352-1381-45f6-8a63-0773b87a5093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:32.518690 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-30312352-1381-45f6-8a63-0773b87a5093 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:32.520050 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-30312352-1381-45f6-8a63-0773b87a5093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:32.592925 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7bd378-ee62-4652-a6b4-c616f218a38c None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:32.597575 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 387/777] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:42:32.598633 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30312352-1381-45f6-8a63-0773b87a5093 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:32.621993 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:32.630349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d406fa-bbb4-41a4-83b9-efbc39be158d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:32.631381 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d406fa-bbb4-41a4-83b9-efbc39be158d None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:32.631984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d406fa-bbb4-41a4-83b9-efbc39be158d None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:32.632453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d406fa-bbb4-41a4-83b9-efbc39be158d None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:32.633540 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d406fa-bbb4-41a4-83b9-efbc39be158d None admin] RBAC: Adding query filter params (type=network) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:32.633868 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d406fa-bbb4-41a4-83b9-efbc39be158d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:32.635379 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d406fa-bbb4-41a4-83b9-efbc39be158d None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:32.643259 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 391/778] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 7 10:42:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:32.646280 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d406fa-bbb4-41a4-83b9-efbc39be158d None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:32.727045 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30312352-1381-45f6-8a63-0773b87a5093 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:32.750435 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d406fa-bbb4-41a4-83b9-efbc39be158d None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:32.757267 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:32.767782 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f9f34-a037-4b39-ad94-aa5ae1a67be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:32.768792 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f9f34-a037-4b39-ad94-aa5ae1a67be6 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:32.769336 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f9f34-a037-4b39-ad94-aa5ae1a67be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:32.769823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f9f34-a037-4b39-ad94-aa5ae1a67be6 None admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:32.770711 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f9f34-a037-4b39-ad94-aa5ae1a67be6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:32.771208 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f9f34-a037-4b39-ad94-aa5ae1a67be6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:32.772959 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f9f34-a037-4b39-ad94-aa5ae1a67be6 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:32.787158 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef173c9d-66f4-4282-bccb-21cc7d1803d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:32.793163 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef173c9d-66f4-4282-bccb-21cc7d1803d1 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:32.793163 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef173c9d-66f4-4282-bccb-21cc7d1803d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:32.793163 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef173c9d-66f4-4282-bccb-21cc7d1803d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:32.794305 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 388/779] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:42:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:32.796055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f9f34-a037-4b39-ad94-aa5ae1a67be6 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:32.799794 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef173c9d-66f4-4282-bccb-21cc7d1803d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:42:32.805162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-ef173c9d-66f4-4282-bccb-21cc7d1803d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:42:32.805162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:32.805162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:32.805162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:32.805162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:32.805162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:32.805162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:32.805162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:32.805162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:32.805162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:32.805162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:32.805162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:32.805162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:42:32.805162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:42:32.805162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:42:32.805162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:42:32.806121 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:42:32.806121 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:42:32.806121 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:42:32.806121 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:42:32.806121 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:32.806121 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:32.806121 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:32.806121 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:32.806121 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:32.806121 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:32.806121 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:32.806121 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:32.806121 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:32.806121 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:32.806121 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:32.806121 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:32.806973 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:32.806973 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:32.806973 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:32.806973 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:32.806973 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:42:32.806973 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:42:32.806973 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:42:32.806973 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:42:32.806973 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:42:32.806973 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:42:32.806973 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:42:32.806973 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:32.806973 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 392/780] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:42:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:32.807677 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef173c9d-66f4-4282-bccb-21cc7d1803d1 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:32.862482 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:32.913747 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef173c9d-66f4-4282-bccb-21cc7d1803d1 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:32.916267 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f9f34-a037-4b39-ad94-aa5ae1a67be6 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:32.948344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630becf-906b-4cd1-837e-29379cc42fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:32.948998 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630becf-906b-4cd1-837e-29379cc42fb3 None admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:32.949363 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630becf-906b-4cd1-837e-29379cc42fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:32.949559 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630becf-906b-4cd1-837e-29379cc42fb3 None admin] PATH_INFO: `/v3/projects/62eed8550ae3403f8a75894dbd19cf4a/users/f98cb7abbb8942cebb71aa98da80a05a/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:32.951820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630becf-906b-4cd1-837e-29379cc42fb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=62eed8550ae3403f8a75894dbd19cf4a, user_id=f98cb7abbb8942cebb71aa98da80a05a, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:32.953547 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630becf-906b-4cd1-837e-29379cc42fb3 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:32.954087 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab65e61-0cca-49bf-971e-649f05eb5422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:32.954937 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab65e61-0cca-49bf-971e-649f05eb5422 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:32.955408 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab65e61-0cca-49bf-971e-649f05eb5422 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:32.955924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab65e61-0cca-49bf-971e-649f05eb5422 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:32.956944 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab65e61-0cca-49bf-971e-649f05eb5422 None admin] RBAC: Adding query filter params (interface=public, service_id=c30d148dafff456aacbec9945e5f2194, region_id=RegionOne) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:32.957496 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab65e61-0cca-49bf-971e-649f05eb5422 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:32.958936 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab65e61-0cca-49bf-971e-649f05eb5422 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:32.969164 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 389/781] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Aug 7 10:42:32 2022] GET /identity/v3/endpoints?service_id=c30d148dafff456aacbec9945e5f2194&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:32.969164 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab65e61-0cca-49bf-971e-649f05eb5422 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:32.975191 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 393/782] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 7 10:42:32 2022] PUT /identity/v3/projects/62eed8550ae3403f8a75894dbd19cf4a/users/f98cb7abbb8942cebb71aa98da80a05a/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:42:32.976435 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630becf-906b-4cd1-837e-29379cc42fb3 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:33.099857 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630becf-906b-4cd1-837e-29379cc42fb3 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:33.116094 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:33.123497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:33.160227 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473d3f2-7af1-479c-a529-62074025db78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:33.161392 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473d3f2-7af1-479c-a529-62074025db78 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:33.161858 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473d3f2-7af1-479c-a529-62074025db78 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:33.162302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473d3f2-7af1-479c-a529-62074025db78 None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:33.163428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473d3f2-7af1-479c-a529-62074025db78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:33.166037 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473d3f2-7af1-479c-a529-62074025db78 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:33.179679 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 394/783] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Aug 7 10:42:32 2022] GET /identity/v3/services => generated 772 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:33.226914 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab65e61-0cca-49bf-971e-649f05eb5422 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:33.273791 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456bfb7-6207-4b50-9216-0916a0c929fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:33.274482 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456bfb7-6207-4b50-9216-0916a0c929fd None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:33.274763 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456bfb7-6207-4b50-9216-0916a0c929fd None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:33.275034 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456bfb7-6207-4b50-9216-0916a0c929fd None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:33.275717 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456bfb7-6207-4b50-9216-0916a0c929fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:33.276018 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456bfb7-6207-4b50-9216-0916a0c929fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:33.277428 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456bfb7-6207-4b50-9216-0916a0c929fd None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:33.287833 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 390/784] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:42:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:33.293624 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473d3f2-7af1-479c-a529-62074025db78 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:33.408790 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473d3f2-7af1-479c-a529-62074025db78 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:33.444265 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303fd28-2937-458f-ad89-a6999898aa62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:33.445010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303fd28-2937-458f-ad89-a6999898aa62 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:33.445639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303fd28-2937-458f-ad89-a6999898aa62 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:33.446199 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303fd28-2937-458f-ad89-a6999898aa62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:33.461171 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5303fd28-2937-458f-ad89-a6999898aa62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:33.462653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5303fd28-2937-458f-ad89-a6999898aa62 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:33.478069 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-5303fd28-2937-458f-ad89-a6999898aa62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:33.478069 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:33.478069 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:33.478069 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:33.478069 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:33.478069 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:33.478069 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:33.478069 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:33.478069 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:33.478069 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:33.478069 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:33.478069 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:33.478069 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:33.478069 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:33.478069 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:33.478069 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:33.479053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:33.479053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:33.479053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:33.479053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:33.479053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:33.479053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:33.479053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:33.479053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:33.479053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:33.479053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:33.479053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:33.479053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:33.479053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:33.479053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:33.479053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:33.479053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:33.479053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:33.479942 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:33.479942 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:33.479942 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:33.479942 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 395/785] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:33.485792 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456bfb7-6207-4b50-9216-0916a0c929fd None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:33.618539 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456bfb7-6207-4b50-9216-0916a0c929fd None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:33.638496 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:33.668036 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56d9ce-d279-4925-852b-4b422c11ee67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:33.668575 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56d9ce-d279-4925-852b-4b422c11ee67 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:33.668851 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56d9ce-d279-4925-852b-4b422c11ee67 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:33.669118 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56d9ce-d279-4925-852b-4b422c11ee67 None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:33.669799 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56d9ce-d279-4925-852b-4b422c11ee67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:33.670089 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56d9ce-d279-4925-852b-4b422c11ee67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:33.671450 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56d9ce-d279-4925-852b-4b422c11ee67 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:33.693560 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 391/786] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:33.699063 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303fd28-2937-458f-ad89-a6999898aa62 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:33.750524 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:33.847763 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303fd28-2937-458f-ad89-a6999898aa62 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:33.888760 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2959ca-d027-43bc-a919-159c3bc6dd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:33.889416 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2959ca-d027-43bc-a919-159c3bc6dd13 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:33.889696 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2959ca-d027-43bc-a919-159c3bc6dd13 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:33.889965 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2959ca-d027-43bc-a919-159c3bc6dd13 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:33.897839 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2959ca-d027-43bc-a919-159c3bc6dd13 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:33.899258 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2959ca-d027-43bc-a919-159c3bc6dd13 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:33.917061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-8f2959ca-d027-43bc-a919-159c3bc6dd13 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 10:42:33.917061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:33.917061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:33.917061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:33.917061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:33.917061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:33.917061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:33.917061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:33.917061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:33.917061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:33.917061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:33.917061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:33.917061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:42:33.917061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:42:33.917061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:42:33.917061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:42:33.918137 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:33.918137 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:33.918137 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:42:33.918137 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:33.918137 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:42:33.918137 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:33.918137 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:33.918137 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:33.918137 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:33.918137 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:33.918137 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:33.918137 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:33.918137 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:33.918137 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:33.918137 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:33.918137 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:33.918137 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:33.918137 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:33.919118 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:33.919118 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:33.919118 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:42:33.919118 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:42:33.919118 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:42:33.919118 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:42:33.919118 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:42:33.919118 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:42:33.919118 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 10:42:33.919118 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:33.919118 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 396/787] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:42:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:33.924759 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56d9ce-d279-4925-852b-4b422c11ee67 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:34.081503 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56d9ce-d279-4925-852b-4b422c11ee67 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:34.132388 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca4001-5140-4d92-a544-9d28738d5048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:34.132989 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca4001-5140-4d92-a544-9d28738d5048 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:34.133261 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca4001-5140-4d92-a544-9d28738d5048 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:34.133550 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca4001-5140-4d92-a544-9d28738d5048 None admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:34.134279 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca4001-5140-4d92-a544-9d28738d5048 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:34.134575 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca4001-5140-4d92-a544-9d28738d5048 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:34.136058 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca4001-5140-4d92-a544-9d28738d5048 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:34.154881 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 392/788] 10.222.0.27 () {56 vars in 1135 bytes} [Sun Aug 7 10:42:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:34.160105 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2959ca-d027-43bc-a919-159c3bc6dd13 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:34.185356 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d1658-c7ee-46d6-9e96-6315e06eb311 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:34.185638 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d1658-c7ee-46d6-9e96-6315e06eb311 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:34.185797 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d1658-c7ee-46d6-9e96-6315e06eb311 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:34.187289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 393/789] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 10:42:34.188149 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1d0e3-49c6-4dbe-beb1-0d1b509d439a None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:34.188576 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1d0e3-49c6-4dbe-beb1-0d1b509d439a None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:34.188946 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1d0e3-49c6-4dbe-beb1-0d1b509d439a None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:34.190596 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 394/790] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:34.194042 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc08cbe-744b-4aa9-84de-270a9e95306d None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:34.194312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc08cbe-744b-4aa9-84de-270a9e95306d None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:34.194576 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc08cbe-744b-4aa9-84de-270a9e95306d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:34.212912 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-0dc08cbe-744b-4aa9-84de-270a9e95306d None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:34.216043 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-0dc08cbe-744b-4aa9-84de-270a9e95306d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:34.242900 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:34.275709 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:34.289527 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2959ca-d027-43bc-a919-159c3bc6dd13 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:34.290867 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 395/791] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 10:42:34.292304 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e3aab-801d-4e0b-9185-6778dc5195d0 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:34.292780 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e3aab-801d-4e0b-9185-6778dc5195d0 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:34.293199 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e3aab-801d-4e0b-9185-6778dc5195d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:34.311562 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-ab7e3aab-801d-4e0b-9185-6778dc5195d0 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:34.312993 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ab7e3aab-801d-4e0b-9185-6778dc5195d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:34.353928 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0233383-db74-4c30-8f72-316b4e5f5542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:34.354578 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0233383-db74-4c30-8f72-316b4e5f5542 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:34.354916 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0233383-db74-4c30-8f72-316b4e5f5542 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:34.355123 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0233383-db74-4c30-8f72-316b4e5f5542 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:34.368539 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0233383-db74-4c30-8f72-316b4e5f5542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:34.370749 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0233383-db74-4c30-8f72-316b4e5f5542 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:34.396139 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-e0233383-db74-4c30-8f72-316b4e5f5542 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:34.396139 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:34.396139 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:34.396139 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:34.396139 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:34.396139 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:34.396139 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:34.396139 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:34.396139 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:34.396139 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:34.396139 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:34.396139 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:34.396139 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:34.396139 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:34.396139 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:34.396139 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:34.397274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:34.397274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:34.397274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:34.397274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:34.397274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:34.397274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:34.397274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:34.397274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:34.397274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:34.397274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:34.397274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:34.397274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:34.397274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:34.397274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:34.397274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:34.397274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:34.397274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:34.398790 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:34.398790 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:34.398790 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:34.398790 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 397/792] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:34.398790 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0233383-db74-4c30-8f72-316b4e5f5542 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:34.407921 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 396/793] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:42:34.409035 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e3aab-801d-4e0b-9185-6778dc5195d0 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:34.511659 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0233383-db74-4c30-8f72-316b4e5f5542 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:34.524945 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:34.537766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e3aab-801d-4e0b-9185-6778dc5195d0 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:34.550747 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6a017-4e30-4015-ba88-61a415274350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:34.551698 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6a017-4e30-4015-ba88-61a415274350 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:34.552134 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6a017-4e30-4015-ba88-61a415274350 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:34.552570 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6a017-4e30-4015-ba88-61a415274350 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:34.553294 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6a017-4e30-4015-ba88-61a415274350 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:34.555120 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6a017-4e30-4015-ba88-61a415274350 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:34.565008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-49e6a017-4e30-4015-ba88-61a415274350 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 10:42:34.565008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:34.565008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 10:42:34.565008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 10:42:34.565008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 10:42:34.565008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 10:42:34.565008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 10:42:34.565008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:34.565008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 10:42:34.565008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:34.565008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 10:42:34.565008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:34.565008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:34.565008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:34.565008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:34.565008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:34.565008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:34.566185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:34.566185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:34.566185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:34.566185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:34.566185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:34.566185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:34.566185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 10:42:34.566185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 10:42:34.566185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 10:42:34.566185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 10:42:34.566185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:34.566185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:34.566185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:34.566185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:34.566185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:34.566185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:34.567594 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:34.567594 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:34.567594 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:34.567594 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:34.567594 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:34.567594 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:34.567594 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:34.567594 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:34.567594 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:34.567594 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:34.567594 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 10:42:34.567594 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:34.567594 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 10:42:34.567594 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:34.571152 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 398/794] 10.222.0.27 () {56 vars in 1129 bytes} [Sun Aug 7 10:42:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:34.571940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6a017-4e30-4015-ba88-61a415274350 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:34.577795 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:34.584704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d6c09-60cb-453f-8001-5ce569a89db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:34.585661 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d6c09-60cb-453f-8001-5ce569a89db7 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:34.586603 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d6c09-60cb-453f-8001-5ce569a89db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:34.587108 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d6c09-60cb-453f-8001-5ce569a89db7 None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:34.588418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d6c09-60cb-453f-8001-5ce569a89db7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:34.589177 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d6c09-60cb-453f-8001-5ce569a89db7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:34.591546 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d6c09-60cb-453f-8001-5ce569a89db7 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:34.607744 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 397/795] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:34.609591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d6c09-60cb-453f-8001-5ce569a89db7 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:34.684488 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6a017-4e30-4015-ba88-61a415274350 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:34.721233 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc2f9a-1314-450a-a3d3-3d2239b39781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:34.721895 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc2f9a-1314-450a-a3d3-3d2239b39781 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:34.722166 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc2f9a-1314-450a-a3d3-3d2239b39781 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:34.722437 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc2f9a-1314-450a-a3d3-3d2239b39781 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:34.732868 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d6c09-60cb-453f-8001-5ce569a89db7 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:34.734044 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc2f9a-1314-450a-a3d3-3d2239b39781 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:42:34.739936 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-01cc2f9a-1314-450a-a3d3-3d2239b39781 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:34.739936 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:34.739936 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:34.739936 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:34.739936 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:34.739936 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:34.739936 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:34.739936 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:34.739936 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:34.739936 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:34.739936 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:34.739936 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:34.739936 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:42:34.739936 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:42:34.739936 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:42:34.739936 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:42:34.740861 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:42:34.740861 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:42:34.740861 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:42:34.740861 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:42:34.740861 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:34.740861 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:34.740861 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:34.740861 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:34.740861 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:34.740861 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:34.740861 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:34.740861 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:34.740861 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:34.740861 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:34.740861 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:34.740861 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:34.742173 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:34.742173 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:34.742173 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:34.742173 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:34.742173 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:42:34.742173 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:42:34.742173 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:42:34.742173 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:42:34.742173 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:42:34.742173 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:42:34.742173 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:34.742173 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:34.742173 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 399/796] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 7 10:42:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:34.743440 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc2f9a-1314-450a-a3d3-3d2239b39781 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:34.769513 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdb884-7e05-4a1c-8631-a5775972dfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:34.770054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdb884-7e05-4a1c-8631-a5775972dfe5 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:34.770424 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdb884-7e05-4a1c-8631-a5775972dfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:34.770696 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdb884-7e05-4a1c-8631-a5775972dfe5 None admin] PATH_INFO: `/v3/services` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:34.771352 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdb884-7e05-4a1c-8631-a5775972dfe5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:34.771650 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdb884-7e05-4a1c-8631-a5775972dfe5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:34.773188 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdb884-7e05-4a1c-8631-a5775972dfe5 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:34.779061 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 398/797] 10.222.0.27 () {56 vars in 1124 bytes} [Sun Aug 7 10:42:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:34.779940 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdb884-7e05-4a1c-8631-a5775972dfe5 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:34.813817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:34.815447 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:34.857463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc2f9a-1314-450a-a3d3-3d2239b39781 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:34.889606 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdb884-7e05-4a1c-8631-a5775972dfe5 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:34.893697 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f8350-c46a-416a-985c-dc149206a1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:34.894368 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f8350-c46a-416a-985c-dc149206a1fd None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:34.894649 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f8350-c46a-416a-985c-dc149206a1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:34.894920 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f8350-c46a-416a-985c-dc149206a1fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:34.901968 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f8350-c46a-416a-985c-dc149206a1fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:34.903396 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f8350-c46a-416a-985c-dc149206a1fd None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:34.914981 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-055f8350-c46a-416a-985c-dc149206a1fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:34.914981 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:34.914981 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:34.914981 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:34.914981 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:34.914981 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:34.914981 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:34.914981 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:34.914981 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:34.914981 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:34.914981 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:34.914981 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:34.914981 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:42:34.914981 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:42:34.914981 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:42:34.916062 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:42:34.916062 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:34.916062 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:34.916062 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:34.916062 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:34.916062 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:34.916062 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:34.916062 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:34.916062 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:34.916062 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:34.916062 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:34.916062 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:34.916062 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:34.916062 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:34.916062 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:34.916062 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:34.916062 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:34.917107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:42:34.917107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:42:34.917107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:42:34.917107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:42:34.917107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:42:34.917107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:42:34.917107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:34.917107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:34.920901 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 400/798] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:34.921807 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f8350-c46a-416a-985c-dc149206a1fd None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:34.929596 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca18686-7e30-40b2-9e08-d9df89917e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:34.930744 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca18686-7e30-40b2-9e08-d9df89917e55 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:34.931160 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca18686-7e30-40b2-9e08-d9df89917e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:34.931671 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca18686-7e30-40b2-9e08-d9df89917e55 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:34.932472 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca18686-7e30-40b2-9e08-d9df89917e55 None admin] RBAC: Adding query filter params (name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:34.932926 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca18686-7e30-40b2-9e08-d9df89917e55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:34.934556 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca18686-7e30-40b2-9e08-d9df89917e55 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:34.944381 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 399/799] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 7 10:42:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:34.945581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca18686-7e30-40b2-9e08-d9df89917e55 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:35.027992 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f8350-c46a-416a-985c-dc149206a1fd None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:35.032789 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:35.054298 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:35.060404 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca18686-7e30-40b2-9e08-d9df89917e55 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:35.067579 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5182e3f-7804-4156-8a26-f92fe7beb75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:35.068186 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5182e3f-7804-4156-8a26-f92fe7beb75e None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:35.068474 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5182e3f-7804-4156-8a26-f92fe7beb75e None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:35.068748 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5182e3f-7804-4156-8a26-f92fe7beb75e None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:35.069414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5182e3f-7804-4156-8a26-f92fe7beb75e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:35.069721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5182e3f-7804-4156-8a26-f92fe7beb75e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:35.071497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5182e3f-7804-4156-8a26-f92fe7beb75e None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:35.081714 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 401/800] 10.222.0.27 () {56 vars in 1124 bytes} [Sun Aug 7 10:42:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:35.082450 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5182e3f-7804-4156-8a26-f92fe7beb75e None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:35.100464 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164dbb1-cf0a-4c9c-a3ae-d431323f1439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:35.101501 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164dbb1-cf0a-4c9c-a3ae-d431323f1439 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:35.102051 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164dbb1-cf0a-4c9c-a3ae-d431323f1439 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:35.102610 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164dbb1-cf0a-4c9c-a3ae-d431323f1439 None admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:35.103513 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164dbb1-cf0a-4c9c-a3ae-d431323f1439 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:35.104005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164dbb1-cf0a-4c9c-a3ae-d431323f1439 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:35.105718 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164dbb1-cf0a-4c9c-a3ae-d431323f1439 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:35.124118 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 400/801] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:42:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:35.125241 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164dbb1-cf0a-4c9c-a3ae-d431323f1439 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:35.203018 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5182e3f-7804-4156-8a26-f92fe7beb75e None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:35.234688 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164dbb1-cf0a-4c9c-a3ae-d431323f1439 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:35.259292 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a33fa-aea9-4f29-836d-0e62d279e3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:35.259915 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a33fa-aea9-4f29-836d-0e62d279e3bc None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:35.260186 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a33fa-aea9-4f29-836d-0e62d279e3bc None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:35.260450 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a33fa-aea9-4f29-836d-0e62d279e3bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:35.274089 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69d071-8872-4f1e-a96e-ee96be189705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:35.274686 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69d071-8872-4f1e-a96e-ee96be189705 None admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:35.274960 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69d071-8872-4f1e-a96e-ee96be189705 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:35.275225 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69d071-8872-4f1e-a96e-ee96be189705 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:35.275944 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca69d071-8872-4f1e-a96e-ee96be189705 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:35.276200 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a33fa-aea9-4f29-836d-0e62d279e3bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:35.277298 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca69d071-8872-4f1e-a96e-ee96be189705 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:35.278133 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a33fa-aea9-4f29-836d-0e62d279e3bc None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:35.287266 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:35.300670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-4d0a33fa-aea9-4f29-836d-0e62d279e3bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:35.300670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:35.300670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:35.300670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:35.300670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:35.300670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:35.300670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:35.300670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:35.300670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:35.300670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:35.300670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:35.300670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:35.300670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:35.300670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:35.300670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:35.300670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:35.301763 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:35.301763 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:35.301763 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:35.301763 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:35.301763 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:35.301763 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:35.301763 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:35.301763 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:35.301763 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:35.301763 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:35.301763 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:35.301763 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:35.301763 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:35.301763 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:35.301763 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:35.301763 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:35.301763 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:35.302690 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:35.302690 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:35.302690 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:35.305741 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 402/802] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:35.306697 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a33fa-aea9-4f29-836d-0e62d279e3bc None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:35.312689 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 401/803] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:42:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:42:35.314467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69d071-8872-4f1e-a96e-ee96be189705 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:35.364916 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:35.433686 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a33fa-aea9-4f29-836d-0e62d279e3bc None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:35.454982 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69d071-8872-4f1e-a96e-ee96be189705 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:35.474475 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916f9f9-2d80-4e02-880b-05f1f473a120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:35.475140 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916f9f9-2d80-4e02-880b-05f1f473a120 None admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:35.475413 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916f9f9-2d80-4e02-880b-05f1f473a120 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:35.475675 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916f9f9-2d80-4e02-880b-05f1f473a120 None admin] PATH_INFO: `/v3/projects/62eed8550ae3403f8a75894dbd19cf4a/users/a7181e5118c547a3a31d2e080c25ff01/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:35.477816 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916f9f9-2d80-4e02-880b-05f1f473a120 None admin] RBAC: Authorizing `identity:create_grant(project_id=62eed8550ae3403f8a75894dbd19cf4a, user_id=a7181e5118c547a3a31d2e080c25ff01, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:35.479385 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916f9f9-2d80-4e02-880b-05f1f473a120 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:35.496028 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 403/804] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 7 10:42:35 2022] PUT /identity/v3/projects/62eed8550ae3403f8a75894dbd19cf4a/users/a7181e5118c547a3a31d2e080c25ff01/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:42:35.502925 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff5338-bcf1-4d83-b66f-a7e894a0d2a2 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:35.503240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff5338-bcf1-4d83-b66f-a7e894a0d2a2 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:35.503511 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff5338-bcf1-4d83-b66f-a7e894a0d2a2 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:35.505175 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 404/805] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:35.505846 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86e98d-70c5-421d-913d-2b0f2c95eecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:35.506821 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86e98d-70c5-421d-913d-2b0f2c95eecc None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:35.507324 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86e98d-70c5-421d-913d-2b0f2c95eecc None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:35.507788 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86e98d-70c5-421d-913d-2b0f2c95eecc None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:35.508722 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86e98d-70c5-421d-913d-2b0f2c95eecc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:35.509587 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86e98d-70c5-421d-913d-2b0f2c95eecc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:35.510618 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac37220-cb91-44bc-9dba-d1bf518d038e None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:35.510896 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac37220-cb91-44bc-9dba-d1bf518d038e None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:35.511163 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac37220-cb91-44bc-9dba-d1bf518d038e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:35.512088 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86e98d-70c5-421d-913d-2b0f2c95eecc None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:35.529176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 402/806] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:35.541140 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86e98d-70c5-421d-913d-2b0f2c95eecc None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:35.544514 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-0ac37220-cb91-44bc-9dba-d1bf518d038e None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:35.545783 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-0ac37220-cb91-44bc-9dba-d1bf518d038e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:35.623945 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:35.647404 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 405/807] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:42:35.675555 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac37220-cb91-44bc-9dba-d1bf518d038e None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:35.697496 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86e98d-70c5-421d-913d-2b0f2c95eecc None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:35.714011 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:35.744051 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a59c3-22a3-46fa-9695-717310a20b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:35.744685 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a59c3-22a3-46fa-9695-717310a20b24 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:35.745207 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a59c3-22a3-46fa-9695-717310a20b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:35.745512 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a59c3-22a3-46fa-9695-717310a20b24 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:35.753583 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a59c3-22a3-46fa-9695-717310a20b24 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:35.755156 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a59c3-22a3-46fa-9695-717310a20b24 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:35.768303 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-286a59c3-22a3-46fa-9695-717310a20b24 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 10:42:35.768303 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:35.768303 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:35.768303 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:35.768303 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:35.768303 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:35.768303 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:35.768303 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:35.768303 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:35.768303 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:35.768303 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:35.768303 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:35.768303 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:42:35.768303 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:42:35.768303 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:42:35.768303 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:42:35.769263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:35.769263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:35.769263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:42:35.769263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:35.769263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:42:35.769263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:35.769263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:35.769263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:35.769263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:35.769263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:35.769263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:35.769263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:35.769263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:35.769263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:35.769263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:35.769263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:35.769263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:35.769263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:35.770579 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:35.770579 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:35.770579 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:42:35.770579 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:42:35.770579 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:42:35.770579 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:42:35.770579 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:42:35.770579 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:42:35.770579 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 10:42:35.770579 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:35.770579 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 403/808] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Aug 7 10:42:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:35.784712 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811022ab-3349-412d-a7a7-ab8d9201bd44 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:35.784993 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811022ab-3349-412d-a7a7-ab8d9201bd44 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:35.785168 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811022ab-3349-412d-a7a7-ab8d9201bd44 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:35.786792 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 404/809] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 10:42:35.791822 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5697647-a259-4ac7-8775-3d1416647a23 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:35.792106 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5697647-a259-4ac7-8775-3d1416647a23 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:35.792551 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5697647-a259-4ac7-8775-3d1416647a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:35.802689 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac37220-cb91-44bc-9dba-d1bf518d038e None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:35.815205 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-d5697647-a259-4ac7-8775-3d1416647a23 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:35.816704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-d5697647-a259-4ac7-8775-3d1416647a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:35.841893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64598467-451b-48c4-ab34-9ad83eb2dcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:35.842517 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64598467-451b-48c4-ab34-9ad83eb2dcdc None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:35.843056 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64598467-451b-48c4-ab34-9ad83eb2dcdc None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:35.843378 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64598467-451b-48c4-ab34-9ad83eb2dcdc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:35.856641 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64598467-451b-48c4-ab34-9ad83eb2dcdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:42:35.862563 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-64598467-451b-48c4-ab34-9ad83eb2dcdc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:42:35.862563 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:35.862563 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:35.862563 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:35.862563 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:35.862563 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:35.862563 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:35.862563 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:35.862563 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:35.862563 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:35.862563 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:35.862563 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:35.862563 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:42:35.862563 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:42:35.862563 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:42:35.862563 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:42:35.864803 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:42:35.864803 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:42:35.864803 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:42:35.864803 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:42:35.864803 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:35.864803 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:35.864803 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:35.864803 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:35.864803 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:35.864803 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:35.864803 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:35.864803 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:35.864803 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:35.864803 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:35.864803 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:35.864803 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:35.866944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:35.866944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:35.866944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:35.866944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:35.866944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:42:35.866944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:42:35.866944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:42:35.866944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:42:35.866944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:42:35.866944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:42:35.866944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:42:35.866944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:35.866944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 406/810] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:42:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:35.866944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64598467-451b-48c4-ab34-9ad83eb2dcdc None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:35.902881 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 405/811] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:42:35.903835 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5697647-a259-4ac7-8775-3d1416647a23 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:35.951578 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:35.997745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:36.001744 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64598467-451b-48c4-ab34-9ad83eb2dcdc None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:36.030433 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5697647-a259-4ac7-8775-3d1416647a23 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:36.042795 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc320c1c-e65b-4aaf-9827-7157ae2b7ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:36.043379 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc320c1c-e65b-4aaf-9827-7157ae2b7ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:36.043664 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc320c1c-e65b-4aaf-9827-7157ae2b7ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:36.043933 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc320c1c-e65b-4aaf-9827-7157ae2b7ba5 None admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:36.044684 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc320c1c-e65b-4aaf-9827-7157ae2b7ba5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:36.044985 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc320c1c-e65b-4aaf-9827-7157ae2b7ba5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:36.046472 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc320c1c-e65b-4aaf-9827-7157ae2b7ba5 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:36.067235 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 407/812] 10.222.0.27 () {56 vars in 1149 bytes} [Sun Aug 7 10:42:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:36.068095 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc320c1c-e65b-4aaf-9827-7157ae2b7ba5 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:36.082260 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af685ee-d2cd-4f81-b703-d0bb49a771f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:36.082864 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af685ee-d2cd-4f81-b703-d0bb49a771f9 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:36.083495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af685ee-d2cd-4f81-b703-d0bb49a771f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:36.083768 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af685ee-d2cd-4f81-b703-d0bb49a771f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:36.084438 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af685ee-d2cd-4f81-b703-d0bb49a771f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:36.084740 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af685ee-d2cd-4f81-b703-d0bb49a771f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:36.086729 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af685ee-d2cd-4f81-b703-d0bb49a771f9 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:36.097744 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 406/813] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:42:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:36.098912 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af685ee-d2cd-4f81-b703-d0bb49a771f9 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:36.200663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc320c1c-e65b-4aaf-9827-7157ae2b7ba5 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:36.219795 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af685ee-d2cd-4f81-b703-d0bb49a771f9 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:36.221511 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:36.244084 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72d0e5-b1c0-4fca-b8a2-916500f342cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:36.245357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72d0e5-b1c0-4fca-b8a2-916500f342cf None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:36.245934 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72d0e5-b1c0-4fca-b8a2-916500f342cf None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:36.246340 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72d0e5-b1c0-4fca-b8a2-916500f342cf None admin] PATH_INFO: `/v3/services/network` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:36.247055 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72d0e5-b1c0-4fca-b8a2-916500f342cf None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:36.248718 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72d0e5-b1c0-4fca-b8a2-916500f342cf None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:36.256691 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3735c-41b1-42b5-a1d9-8643fca35b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:36.257340 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3735c-41b1-42b5-a1d9-8643fca35b1a None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:36.257631 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3735c-41b1-42b5-a1d9-8643fca35b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:36.257901 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3735c-41b1-42b5-a1d9-8643fca35b1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:36.259197 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-dd72d0e5-b1c0-4fca-b8a2-916500f342cf None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 10:42:36.259197 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:36.259197 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 10:42:36.259197 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 10:42:36.259197 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 10:42:36.259197 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 10:42:36.259197 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 10:42:36.259197 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:36.259197 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 10:42:36.259197 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:36.259197 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 10:42:36.259197 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:36.259197 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:36.259197 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:36.259197 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:36.259197 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:36.259197 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:36.260334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:36.260334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:36.260334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:36.260334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:36.260334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:36.260334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:36.260334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 10:42:36.260334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 10:42:36.260334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 10:42:36.260334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 10:42:36.260334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:36.260334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:36.260334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:36.260334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:36.260334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:36.260334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:36.261284 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:36.261284 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:36.261284 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:36.261284 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:36.261284 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:36.261284 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:36.261284 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:36.261284 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:36.261284 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:36.261284 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:36.261284 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 10:42:36.261284 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:36.261284 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 10:42:36.261284 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:36.263480 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 408/814] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:36 2022] GET /identity/v3/services/network => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:36.264420 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72d0e5-b1c0-4fca-b8a2-916500f342cf None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:36.275422 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3735c-41b1-42b5-a1d9-8643fca35b1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:36.276836 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3735c-41b1-42b5-a1d9-8643fca35b1a None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:36.282268 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:36.295030 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-fcb3735c-41b1-42b5-a1d9-8643fca35b1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:36.295030 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:36.295030 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:36.295030 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:36.295030 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:36.295030 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:36.295030 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:36.295030 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:36.295030 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:36.295030 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:36.295030 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:36.295030 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:36.295030 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:36.295030 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:36.295030 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:36.295030 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:36.296177 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:36.296177 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:36.296177 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:36.296177 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:36.296177 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:36.296177 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:36.296177 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:36.296177 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:36.296177 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:36.296177 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:36.296177 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:36.296177 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:36.296177 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:36.296177 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:36.296177 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:36.296177 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:36.296177 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:36.297144 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:36.297144 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:36.297144 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:36.301504 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 407/815] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:36.302387 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3735c-41b1-42b5-a1d9-8643fca35b1a None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:36.388273 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72d0e5-b1c0-4fca-b8a2-916500f342cf None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:36.413446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3735c-41b1-42b5-a1d9-8643fca35b1a None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:36.424787 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f14bd-b991-4f31-afbd-10a309b74fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:36.425607 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f14bd-b991-4f31-afbd-10a309b74fce None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:36.426037 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f14bd-b991-4f31-afbd-10a309b74fce None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:36.426438 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f14bd-b991-4f31-afbd-10a309b74fce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:36.437863 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f14bd-b991-4f31-afbd-10a309b74fce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:36.439570 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f14bd-b991-4f31-afbd-10a309b74fce None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:36.448979 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a5894-d172-4773-9ce6-0c4b713cbbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:36.449635 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a5894-d172-4773-9ce6-0c4b713cbbd7 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:36.449906 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a5894-d172-4773-9ce6-0c4b713cbbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:36.450177 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a5894-d172-4773-9ce6-0c4b713cbbd7 None admin] PATH_INFO: `/v3/services` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:36.450808 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a5894-d172-4773-9ce6-0c4b713cbbd7 None admin] RBAC: Adding query filter params (name=network) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:36.451107 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a5894-d172-4773-9ce6-0c4b713cbbd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:36.452505 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875a5894-d172-4773-9ce6-0c4b713cbbd7 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:36.456219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-b04f14bd-b991-4f31-afbd-10a309b74fce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:36.456219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:36.456219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:36.456219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:36.456219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:36.456219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:36.456219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:36.456219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:36.456219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:36.456219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:36.456219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:36.456219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:36.456219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:36.456219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:36.456219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:36.456219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:36.457308 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:36.457308 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:36.457308 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:36.457308 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:36.457308 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:36.457308 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:36.457308 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:36.457308 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:36.457308 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:36.457308 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:36.457308 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:36.457308 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:36.457308 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:36.457308 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:36.457308 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:36.457308 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:36.457308 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:36.458310 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:36.458310 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:36.458310 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:36.459876 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 409/816] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:36.460857 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f14bd-b991-4f31-afbd-10a309b74fce None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:36.462544 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 408/817] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 7 10:42:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:36.463401 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a5894-d172-4773-9ce6-0c4b713cbbd7 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:36.483748 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:36.530145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:36.570655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f14bd-b991-4f31-afbd-10a309b74fce None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:36.575175 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a5894-d172-4773-9ce6-0c4b713cbbd7 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:36.607393 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965dc688-ffda-4c91-b504-31672722f09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:36.608465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dc688-ffda-4c91-b504-31672722f09e None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:36.608947 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dc688-ffda-4c91-b504-31672722f09e None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:36.609502 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965dc688-ffda-4c91-b504-31672722f09e None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:36.610535 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965dc688-ffda-4c91-b504-31672722f09e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:36.611071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965dc688-ffda-4c91-b504-31672722f09e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:36.611902 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20b3f7-98bc-4af8-9c06-de950c59c2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:36.612579 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20b3f7-98bc-4af8-9c06-de950c59c2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:36.612928 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20b3f7-98bc-4af8-9c06-de950c59c2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:36.613230 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965dc688-ffda-4c91-b504-31672722f09e None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:36.613350 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20b3f7-98bc-4af8-9c06-de950c59c2d8 None admin] PATH_INFO: `/v3/services` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:36.614004 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20b3f7-98bc-4af8-9c06-de950c59c2d8 None admin] RBAC: Adding query filter params (type=network) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:36.614415 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20b3f7-98bc-4af8-9c06-de950c59c2d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:36.615944 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20b3f7-98bc-4af8-9c06-de950c59c2d8 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:36.631586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 409/819] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 7 10:42:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:36.631586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20b3f7-98bc-4af8-9c06-de950c59c2d8 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:36.631819 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 410/819] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:36.631819 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965dc688-ffda-4c91-b504-31672722f09e None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:36.731275 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:36.758109 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20b3f7-98bc-4af8-9c06-de950c59c2d8 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:36.765488 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965dc688-ffda-4c91-b504-31672722f09e None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:36.797790 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:36.802328 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481f16a-7b45-42ea-a13f-8a56beb1efdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:36.803579 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481f16a-7b45-42ea-a13f-8a56beb1efdc None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:36.804287 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481f16a-7b45-42ea-a13f-8a56beb1efdc None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:36.804751 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481f16a-7b45-42ea-a13f-8a56beb1efdc None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:36.805713 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481f16a-7b45-42ea-a13f-8a56beb1efdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:36.806274 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481f16a-7b45-42ea-a13f-8a56beb1efdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:36.807972 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481f16a-7b45-42ea-a13f-8a56beb1efdc None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:36.808907 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7be72a-df26-4231-a25c-ebe7c7e45ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:36.809586 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7be72a-df26-4231-a25c-ebe7c7e45ec6 None admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:36.809866 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7be72a-df26-4231-a25c-ebe7c7e45ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:36.810139 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7be72a-df26-4231-a25c-ebe7c7e45ec6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:36.811254 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7be72a-df26-4231-a25c-ebe7c7e45ec6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:36.813774 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7be72a-df26-4231-a25c-ebe7c7e45ec6 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:36.824488 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 410/820] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:36.825621 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481f16a-7b45-42ea-a13f-8a56beb1efdc None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:36.853389 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 411/821] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:42:36 2022] POST /identity/v3/endpoints => generated 337 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:42:36.853389 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7be72a-df26-4231-a25c-ebe7c7e45ec6 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:37.034790 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481f16a-7b45-42ea-a13f-8a56beb1efdc None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:37.064902 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7be72a-df26-4231-a25c-ebe7c7e45ec6 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:37.088335 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6742820-f6a1-484a-a7ff-3ec4ebdb385a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:37.088894 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6742820-f6a1-484a-a7ff-3ec4ebdb385a None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:37.089175 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6742820-f6a1-484a-a7ff-3ec4ebdb385a None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:37.089505 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6742820-f6a1-484a-a7ff-3ec4ebdb385a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:37.097658 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6742820-f6a1-484a-a7ff-3ec4ebdb385a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:37.099085 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6742820-f6a1-484a-a7ff-3ec4ebdb385a None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:37.108391 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f756df1-3c52-4749-b9b7-63f7422f8e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:37.109338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f756df1-3c52-4749-b9b7-63f7422f8e66 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:37.109814 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f756df1-3c52-4749-b9b7-63f7422f8e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:37.110346 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f756df1-3c52-4749-b9b7-63f7422f8e66 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:37.111594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-c6742820-f6a1-484a-a7ff-3ec4ebdb385a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:37.111594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:37.111594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:37.111594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:37.111594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:37.111594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:37.111594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:37.111594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:37.111594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:37.111594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:37.111594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:37.111594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:37.111594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:42:37.111594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:42:37.111594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:42:37.112458 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:42:37.112458 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:37.112458 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:37.112458 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:37.112458 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:37.112458 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:37.112458 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:37.112458 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:37.112458 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:37.112458 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:37.112458 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:37.112458 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:37.112458 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:37.112458 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:37.112458 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:37.112458 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:37.112458 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:37.113370 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:42:37.113370 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:42:37.113370 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:42:37.113370 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:42:37.113370 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:42:37.113370 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:42:37.113370 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:37.113370 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:37.117530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 411/822] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:37.118778 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6742820-f6a1-484a-a7ff-3ec4ebdb385a None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:37.122208 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f756df1-3c52-4749-b9b7-63f7422f8e66 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:37.122595 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:37.124303 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f756df1-3c52-4749-b9b7-63f7422f8e66 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:37.142823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-0f756df1-3c52-4749-b9b7-63f7422f8e66 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 10:42:37.142823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:37.142823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:37.142823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:37.142823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:37.142823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:37.142823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:37.142823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:37.142823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:37.142823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:37.142823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:37.142823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:37.142823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:42:37.142823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:42:37.142823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:42:37.142823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:42:37.143804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:37.143804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:37.143804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:42:37.143804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:37.143804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:42:37.143804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:37.143804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:37.143804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:37.143804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:37.143804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:37.143804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:37.143804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:37.143804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:37.143804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:37.143804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:37.143804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:37.143804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:37.143804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:37.144730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:37.144730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:37.144730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:42:37.144730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:42:37.144730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:42:37.144730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:42:37.144730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:42:37.144730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:42:37.144730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 10:42:37.144730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:37.147163 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 412/823] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Aug 7 10:42:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:37.156293 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f756df1-3c52-4749-b9b7-63f7422f8e66 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:37.200336 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:37.273605 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6742820-f6a1-484a-a7ff-3ec4ebdb385a None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:37.284742 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f756df1-3c52-4749-b9b7-63f7422f8e66 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:37.319597 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3061a05-8441-43c2-a59b-e2fc18610e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:37.322871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3061a05-8441-43c2-a59b-e2fc18610e63 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:37.323157 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3061a05-8441-43c2-a59b-e2fc18610e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:37.323502 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3061a05-8441-43c2-a59b-e2fc18610e63 None admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:37.324205 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3061a05-8441-43c2-a59b-e2fc18610e63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:37.324563 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3061a05-8441-43c2-a59b-e2fc18610e63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:37.326437 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3061a05-8441-43c2-a59b-e2fc18610e63 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:37.337932 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb46c8-e67d-461a-8944-51faa4a2b96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:37.339615 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb46c8-e67d-461a-8944-51faa4a2b96d None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:37.340108 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb46c8-e67d-461a-8944-51faa4a2b96d None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:37.340604 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb46c8-e67d-461a-8944-51faa4a2b96d None admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:37.342180 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb46c8-e67d-461a-8944-51faa4a2b96d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:37.342760 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb46c8-e67d-461a-8944-51faa4a2b96d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:37.344354 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb46c8-e67d-461a-8944-51faa4a2b96d None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:37.350802 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 412/824] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:42:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:37.352791 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3061a05-8441-43c2-a59b-e2fc18610e63 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:37.372725 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 413/825] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Aug 7 10:42:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:37.378935 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb46c8-e67d-461a-8944-51faa4a2b96d None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:37.429133 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:37.496761 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3061a05-8441-43c2-a59b-e2fc18610e63 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:37.500672 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:37.510599 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb46c8-e67d-461a-8944-51faa4a2b96d None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:37.535751 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de260de6-2f60-49ad-9ab4-c9b83de9d654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:37.536415 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de260de6-2f60-49ad-9ab4-c9b83de9d654 None admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:37.536695 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de260de6-2f60-49ad-9ab4-c9b83de9d654 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:37.536969 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de260de6-2f60-49ad-9ab4-c9b83de9d654 None admin] PATH_INFO: `/v3/projects/62eed8550ae3403f8a75894dbd19cf4a/users/e7eebb4bd7e04ff8bc4304a40cf6ba35/roles/bf9e51dafeac420f89a66e78e1463982` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:37.554133 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de260de6-2f60-49ad-9ab4-c9b83de9d654 None admin] RBAC: Authorizing `identity:create_grant(project_id=62eed8550ae3403f8a75894dbd19cf4a, user_id=e7eebb4bd7e04ff8bc4304a40cf6ba35, role_id=bf9e51dafeac420f89a66e78e1463982)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:37.555687 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de260de6-2f60-49ad-9ab4-c9b83de9d654 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:37.557247 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570b045-138e-4a65-94b1-82e4972239c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:37.558370 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570b045-138e-4a65-94b1-82e4972239c3 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:37.559340 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570b045-138e-4a65-94b1-82e4972239c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:37.559981 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570b045-138e-4a65-94b1-82e4972239c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:37.577495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 413/826] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 7 10:42:37 2022] PUT /identity/v3/projects/62eed8550ae3403f8a75894dbd19cf4a/users/e7eebb4bd7e04ff8bc4304a40cf6ba35/roles/bf9e51dafeac420f89a66e78e1463982 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:42:37.640643 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570b045-138e-4a65-94b1-82e4972239c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:37.642876 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570b045-138e-4a65-94b1-82e4972239c3 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:37.671497 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a5a19-3238-48cc-ba6c-01d30c59fd17 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:37.671827 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a5a19-3238-48cc-ba6c-01d30c59fd17 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:37.672045 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a5a19-3238-48cc-ba6c-01d30c59fd17 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:37.674460 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 414/827] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 10:42:37.679918 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3addc57-effd-4591-994f-9c4b8ddb6713 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:37.680222 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3addc57-effd-4591-994f-9c4b8ddb6713 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:37.680460 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3addc57-effd-4591-994f-9c4b8ddb6713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:37.699397 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-e3addc57-effd-4591-994f-9c4b8ddb6713 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:37.700667 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-e3addc57-effd-4591-994f-9c4b8ddb6713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:37.744631 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:37.753217 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 414/828] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:42:37 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 10:42:37.754507 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72f334-91ee-4b4f-abdf-cd3da2a0026e None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:37.754790 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72f334-91ee-4b4f-abdf-cd3da2a0026e None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:37.755063 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72f334-91ee-4b4f-abdf-cd3da2a0026e None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:37.756549 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 415/829] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:37.759342 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72f334-91ee-4b4f-abdf-cd3da2a0026e None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:37.783521 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 415/830] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:37 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 10:42:37.785800 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690dc12-9078-4e87-b287-f443e9ab3e6e None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:37.786267 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690dc12-9078-4e87-b287-f443e9ab3e6e None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:37.786736 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690dc12-9078-4e87-b287-f443e9ab3e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:37.808419 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-e690dc12-9078-4e87-b287-f443e9ab3e6e None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:37.810371 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-e690dc12-9078-4e87-b287-f443e9ab3e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:37.852303 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:37.873816 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72f334-91ee-4b4f-abdf-cd3da2a0026e None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:37.897427 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 416/831] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:37 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:42:37.897427 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690dc12-9078-4e87-b287-f443e9ab3e6e None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:37.908740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9b2a4-ac08-4a65-8fd3-f35e37083e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:37.909409 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9b2a4-ac08-4a65-8fd3-f35e37083e3c None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:37.909695 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9b2a4-ac08-4a65-8fd3-f35e37083e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:37.909958 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9b2a4-ac08-4a65-8fd3-f35e37083e3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:37.920655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9b2a4-ac08-4a65-8fd3-f35e37083e3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:37.922119 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9b2a4-ac08-4a65-8fd3-f35e37083e3c None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:37.937580 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-c2b9b2a4-ac08-4a65-8fd3-f35e37083e3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:37.937580 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:37.937580 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:37.937580 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:37.937580 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:37.937580 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:37.937580 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:37.937580 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:37.937580 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:37.937580 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:37.937580 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:37.937580 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:37.937580 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:37.937580 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:37.937580 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:37.937580 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:37.938636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:37.938636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:37.938636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:37.938636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:37.938636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:37.938636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:37.938636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:37.938636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:37.938636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:37.938636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:37.938636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:37.938636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:37.938636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:37.938636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:37.938636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:37.938636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:37.938636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:37.939632 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:37.939632 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:37.939632 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:37.943520 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 416/832] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:42:37.944208 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9b2a4-ac08-4a65-8fd3-f35e37083e3c None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:37.995842 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:38.007401 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690dc12-9078-4e87-b287-f443e9ab3e6e None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:38.044857 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d23186-0578-4d38-bf02-1fca00d90087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:38.045497 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d23186-0578-4d38-bf02-1fca00d90087 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:38.045775 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d23186-0578-4d38-bf02-1fca00d90087 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:38.046102 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d23186-0578-4d38-bf02-1fca00d90087 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:38.055095 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9b2a4-ac08-4a65-8fd3-f35e37083e3c None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:38.058136 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d23186-0578-4d38-bf02-1fca00d90087 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:42:38.062871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-26d23186-0578-4d38-bf02-1fca00d90087 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:42:38.062871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:38.062871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:38.062871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:38.062871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:38.062871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:38.062871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:38.062871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:38.062871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:38.062871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:38.062871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:38.062871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:38.062871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:42:38.062871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:42:38.062871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:42:38.062871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:42:38.064371 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:42:38.064371 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:42:38.064371 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:42:38.064371 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:42:38.064371 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:38.064371 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:38.064371 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:38.064371 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:38.064371 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:38.064371 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:38.064371 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:38.064371 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:38.064371 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:38.064371 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:38.064371 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:38.064371 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:38.065288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:38.065288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:38.065288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:38.065288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:38.065288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:42:38.065288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:42:38.065288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:42:38.065288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:42:38.065288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:42:38.065288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:42:38.065288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:42:38.065288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:38.065288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 417/833] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:42:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:38.066471 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d23186-0578-4d38-bf02-1fca00d90087 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:38.096225 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f79782-1eb9-42cf-8c64-9f613a377367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:38.097087 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f79782-1eb9-42cf-8c64-9f613a377367 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:38.097546 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f79782-1eb9-42cf-8c64-9f613a377367 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:38.097824 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f79782-1eb9-42cf-8c64-9f613a377367 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:38.098412 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f79782-1eb9-42cf-8c64-9f613a377367 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:38.099508 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:38.099772 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f79782-1eb9-42cf-8c64-9f613a377367 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:38.109519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-a3f79782-1eb9-42cf-8c64-9f613a377367 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 10:42:38.109519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:38.109519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 10:42:38.109519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 10:42:38.109519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 10:42:38.109519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 10:42:38.109519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 10:42:38.109519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:38.109519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 10:42:38.109519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:38.109519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 10:42:38.109519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:38.109519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:38.109519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:38.109519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:38.109519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:38.109519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:38.110644 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:38.110644 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:38.110644 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:38.110644 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:38.110644 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:38.110644 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:38.110644 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 10:42:38.110644 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 10:42:38.110644 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 10:42:38.110644 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 10:42:38.110644 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:38.110644 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:38.110644 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:38.110644 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:38.110644 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:38.110644 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:38.114512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:38.114512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:38.114512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:38.114512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:38.114512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:38.114512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:38.114512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:38.114512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:38.114512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:38.114512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:38.114512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 10:42:38.114512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:38.114512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 10:42:38.114512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:38.114512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 417/834] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 7 10:42:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:38.115320 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f79782-1eb9-42cf-8c64-9f613a377367 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:38.180501 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d23186-0578-4d38-bf02-1fca00d90087 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:38.218854 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c2820-4afa-4747-8951-728b1ca60d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:38.219976 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c2820-4afa-4747-8951-728b1ca60d8d None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:38.220255 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c2820-4afa-4747-8951-728b1ca60d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:38.220540 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c2820-4afa-4747-8951-728b1ca60d8d None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:38.221440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c2820-4afa-4747-8951-728b1ca60d8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:38.221573 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c2820-4afa-4747-8951-728b1ca60d8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:38.222843 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c2820-4afa-4747-8951-728b1ca60d8d None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:38.224428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f79782-1eb9-42cf-8c64-9f613a377367 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:38.234479 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 418/835] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:38.235122 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c2820-4afa-4747-8951-728b1ca60d8d None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:38.239537 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:38.266953 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1f782-bbed-42cf-8380-3d429c028b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:38.267563 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1f782-bbed-42cf-8380-3d429c028b03 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:38.267845 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1f782-bbed-42cf-8380-3d429c028b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:38.268117 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1f782-bbed-42cf-8380-3d429c028b03 None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:38.268780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1f782-bbed-42cf-8380-3d429c028b03 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:38.269080 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1f782-bbed-42cf-8380-3d429c028b03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:38.270493 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1f782-bbed-42cf-8380-3d429c028b03 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:38.281668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 418/836] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:42:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:38.283568 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1f782-bbed-42cf-8380-3d429c028b03 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:38.335778 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:38.348753 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c2820-4afa-4747-8951-728b1ca60d8d None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:38.386375 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c394c8c-66a8-4447-91cb-496c8751c02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:38.387416 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c394c8c-66a8-4447-91cb-496c8751c02e None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:38.388172 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c394c8c-66a8-4447-91cb-496c8751c02e None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:38.388896 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c394c8c-66a8-4447-91cb-496c8751c02e None admin] PATH_INFO: `/v3/services` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:38.389788 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c394c8c-66a8-4447-91cb-496c8751c02e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:38.390269 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c394c8c-66a8-4447-91cb-496c8751c02e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:38.390483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1f782-bbed-42cf-8380-3d429c028b03 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:38.392203 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c394c8c-66a8-4447-91cb-496c8751c02e None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:38.402227 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 419/837] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 7 10:42:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:38.402227 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c394c8c-66a8-4447-91cb-496c8751c02e None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:38.428843 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9b75f-c9c1-4bd4-9632-62ef4beb94a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:38.429274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9b75f-c9c1-4bd4-9632-62ef4beb94a0 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:38.429570 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9b75f-c9c1-4bd4-9632-62ef4beb94a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:38.429852 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f9b75f-c9c1-4bd4-9632-62ef4beb94a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:38.437034 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9b75f-c9c1-4bd4-9632-62ef4beb94a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:38.438541 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f9b75f-c9c1-4bd4-9632-62ef4beb94a0 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:38.449588 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-e7f9b75f-c9c1-4bd4-9632-62ef4beb94a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:38.449588 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:38.449588 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:38.449588 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:38.449588 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:38.449588 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:38.449588 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:38.449588 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:38.449588 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:38.449588 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:38.449588 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:38.449588 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:38.449588 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:42:38.449588 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:42:38.449588 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:42:38.450486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:42:38.450486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:38.450486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:38.450486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:38.450486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:38.450486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:38.450486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:38.450486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:38.450486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:38.450486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:38.450486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:38.450486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:38.450486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:38.450486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:38.450486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:38.450486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:38.450486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:38.451408 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:42:38.451408 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:42:38.451408 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:42:38.451408 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:42:38.451408 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:42:38.451408 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:42:38.451408 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:38.451408 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:38.451408 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 419/838] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:38.451408 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9b75f-c9c1-4bd4-9632-62ef4beb94a0 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:38.484395 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:38.508625 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c394c8c-66a8-4447-91cb-496c8751c02e None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:38.543134 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67532686-1164-41ca-9e14-168aa09a153b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:38.543758 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67532686-1164-41ca-9e14-168aa09a153b None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:38.544030 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67532686-1164-41ca-9e14-168aa09a153b None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:38.544296 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67532686-1164-41ca-9e14-168aa09a153b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:38.556060 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67532686-1164-41ca-9e14-168aa09a153b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:38.557568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67532686-1164-41ca-9e14-168aa09a153b None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:38.559902 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f9b75f-c9c1-4bd4-9632-62ef4beb94a0 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:38.571695 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-67532686-1164-41ca-9e14-168aa09a153b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:38.571695 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:38.571695 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:38.571695 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:38.571695 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:38.571695 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:38.571695 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:38.571695 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:38.571695 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:38.571695 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:38.571695 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:38.571695 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:38.571695 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:38.571695 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:38.571695 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:38.571695 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:38.573581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:38.573581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:38.573581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:38.573581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:38.573581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:38.573581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:38.573581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:38.573581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:38.573581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:38.573581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:38.573581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:38.573581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:38.573581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:38.573581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:38.573581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:38.573581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:38.573581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:38.575262 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:38.575262 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:38.575262 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:38.575262 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 420/839] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:38.575262 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67532686-1164-41ca-9e14-168aa09a153b None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:38.587805 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:38.608517 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2c796-daca-4f77-b00b-a0e731c83c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:38.609116 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2c796-daca-4f77-b00b-a0e731c83c16 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:38.609421 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2c796-daca-4f77-b00b-a0e731c83c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:38.609694 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2c796-daca-4f77-b00b-a0e731c83c16 None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:38.610594 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2c796-daca-4f77-b00b-a0e731c83c16 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:38.610726 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2c796-daca-4f77-b00b-a0e731c83c16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:38.611984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2c796-daca-4f77-b00b-a0e731c83c16 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:38.625583 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 420/840] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 7 10:42:38 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:38.625583 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2c796-daca-4f77-b00b-a0e731c83c16 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:38.707352 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67532686-1164-41ca-9e14-168aa09a153b None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:38.737083 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:38.745607 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2c796-daca-4f77-b00b-a0e731c83c16 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:38.747248 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aced295-c6ea-45b8-989f-8f41f59d184c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:38.748247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aced295-c6ea-45b8-989f-8f41f59d184c None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:38.748760 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aced295-c6ea-45b8-989f-8f41f59d184c None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:38.749165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aced295-c6ea-45b8-989f-8f41f59d184c None admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:38.750080 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aced295-c6ea-45b8-989f-8f41f59d184c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:38.750536 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aced295-c6ea-45b8-989f-8f41f59d184c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:38.752249 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aced295-c6ea-45b8-989f-8f41f59d184c None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:38.767837 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 421/841] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:42:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:38.781360 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aced295-c6ea-45b8-989f-8f41f59d184c None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:38.794037 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547f60e-014d-4975-bb76-8f20ffb739ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:38.794865 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547f60e-014d-4975-bb76-8f20ffb739ca None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:38.795243 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547f60e-014d-4975-bb76-8f20ffb739ca None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:38.795617 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547f60e-014d-4975-bb76-8f20ffb739ca None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:38.796417 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547f60e-014d-4975-bb76-8f20ffb739ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:38.796929 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547f60e-014d-4975-bb76-8f20ffb739ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:38.798568 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547f60e-014d-4975-bb76-8f20ffb739ca None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:38.812248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 421/842] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:38.818609 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547f60e-014d-4975-bb76-8f20ffb739ca None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:38.854910 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:38.903163 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aced295-c6ea-45b8-989f-8f41f59d184c None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:38.941554 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0bb96-8361-4b30-90b8-6156838102a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:38.942477 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0bb96-8361-4b30-90b8-6156838102a5 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:38.942877 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0bb96-8361-4b30-90b8-6156838102a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:38.943541 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0bb96-8361-4b30-90b8-6156838102a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:38.944660 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0bb96-8361-4b30-90b8-6156838102a5 None admin] RBAC: Adding query filter params (role.id=9da6e501237c405ca021a9d9f6173caf, scope.project.id=62eed8550ae3403f8a75894dbd19cf4a, user.id=f98cb7abbb8942cebb71aa98da80a05a) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:38.945069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0bb96-8361-4b30-90b8-6156838102a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:38.945941 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547f60e-014d-4975-bb76-8f20ffb739ca None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:38.946753 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0bb96-8361-4b30-90b8-6156838102a5 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:38.954594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 422/843] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:42:38 2022] GET /identity/v3/role_assignments?user.id=f98cb7abbb8942cebb71aa98da80a05a&scope.project.id=62eed8550ae3403f8a75894dbd19cf4a&role.id=9da6e501237c405ca021a9d9f6173caf => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:38.996011 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc72528-411a-41e0-8792-f6a82598bca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:38.996571 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc72528-411a-41e0-8792-f6a82598bca4 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:38.996848 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc72528-411a-41e0-8792-f6a82598bca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:38.997118 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc72528-411a-41e0-8792-f6a82598bca4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:39.007601 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc72528-411a-41e0-8792-f6a82598bca4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:39.009070 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc72528-411a-41e0-8792-f6a82598bca4 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:39.023794 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-9fc72528-411a-41e0-8792-f6a82598bca4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 10:42:39.023794 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:39.023794 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:39.023794 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:39.023794 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:39.023794 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:39.023794 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:39.023794 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:39.023794 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:39.023794 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:39.023794 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:39.023794 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:39.023794 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:42:39.023794 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:42:39.023794 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:42:39.023794 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:42:39.024988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:39.024988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:39.024988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:42:39.024988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:39.024988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:42:39.024988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:39.024988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:39.024988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:39.024988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:39.024988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:39.024988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:39.024988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:39.024988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:39.024988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:39.024988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:39.024988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:39.024988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:39.024988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:39.026161 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:39.026161 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:39.026161 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:42:39.026161 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:42:39.026161 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:42:39.026161 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:42:39.026161 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:42:39.026161 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:42:39.026161 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 10:42:39.026161 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:39.026161 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 422/844] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:42:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:39.032722 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0bb96-8361-4b30-90b8-6156838102a5 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:39.158726 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0bb96-8361-4b30-90b8-6156838102a5 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:39.195435 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:39.202088 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d983a-250d-414f-86c4-a41e72864a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:39.202701 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d983a-250d-414f-86c4-a41e72864a15 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:39.202974 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d983a-250d-414f-86c4-a41e72864a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:39.203241 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d983a-250d-414f-86c4-a41e72864a15 None admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:39.204504 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d983a-250d-414f-86c4-a41e72864a15 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:39.204809 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d983a-250d-414f-86c4-a41e72864a15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:39.206338 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d983a-250d-414f-86c4-a41e72864a15 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:39.229181 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 423/845] 10.222.0.27 () {56 vars in 1135 bytes} [Sun Aug 7 10:42:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:39.230549 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc72528-411a-41e0-8792-f6a82598bca4 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:39.250599 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:39.350401 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc72528-411a-41e0-8792-f6a82598bca4 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:39.390038 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8327c6-6574-400a-93c2-fce940dadfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:39.390642 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8327c6-6574-400a-93c2-fce940dadfc0 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:39.390909 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8327c6-6574-400a-93c2-fce940dadfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:39.391176 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8327c6-6574-400a-93c2-fce940dadfc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:39.460744 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8327c6-6574-400a-93c2-fce940dadfc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:39.462201 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8327c6-6574-400a-93c2-fce940dadfc0 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:39.479609 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:39.564687 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 423/846] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:42:39 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 10:42:39.570461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d983a-250d-414f-86c4-a41e72864a15 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:39.631514 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b23c8-7eef-4f1d-9866-625d6d45f701 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:39.631858 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b23c8-7eef-4f1d-9866-625d6d45f701 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:39.632127 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b23c8-7eef-4f1d-9866-625d6d45f701 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:39.633744 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 424/847] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 10:42:39.640279 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df23a2-a7b6-4059-93a5-6b67546dfaff None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:39.640764 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df23a2-a7b6-4059-93a5-6b67546dfaff None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:39.641130 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df23a2-a7b6-4059-93a5-6b67546dfaff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:39.660657 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-99df23a2-a7b6-4059-93a5-6b67546dfaff None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:39.662111 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-99df23a2-a7b6-4059-93a5-6b67546dfaff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:39.678838 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d983a-250d-414f-86c4-a41e72864a15 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:39.716852 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda201d2-c1e5-455a-b11d-b4ba84a41690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:39.717652 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda201d2-c1e5-455a-b11d-b4ba84a41690 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:39.718018 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda201d2-c1e5-455a-b11d-b4ba84a41690 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:39.718454 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda201d2-c1e5-455a-b11d-b4ba84a41690 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:39.730257 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda201d2-c1e5-455a-b11d-b4ba84a41690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:39.731991 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda201d2-c1e5-455a-b11d-b4ba84a41690 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:39.747284 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 425/848] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 10:42:39.753703 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-cda201d2-c1e5-455a-b11d-b4ba84a41690 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:39.753703 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:39.753703 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:39.753703 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:39.753703 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:39.753703 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:39.753703 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:39.753703 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:39.753703 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:39.753703 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:39.753703 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:39.753703 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:39.753703 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:39.753703 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:39.753703 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:39.753703 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:39.754637 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:39.754637 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:39.754637 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:39.754637 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:39.754637 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:39.754637 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:39.754637 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:39.754637 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:39.754637 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:39.754637 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:39.754637 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:39.754637 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:39.754637 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:39.754637 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:39.754637 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:39.754637 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:39.754637 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:39.755902 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:39.755902 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:39.755902 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:39.755902 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 424/849] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:39.762015 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df23a2-a7b6-4059-93a5-6b67546dfaff None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:39.770933 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda201d2-c1e5-455a-b11d-b4ba84a41690 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:39.821533 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:39.827719 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:39.891241 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df23a2-a7b6-4059-93a5-6b67546dfaff None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:39.904141 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda201d2-c1e5-455a-b11d-b4ba84a41690 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:39.929101 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e17fe-9d5f-42d4-a441-2610d0872e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:39.929886 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e17fe-9d5f-42d4-a441-2610d0872e31 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:39.930265 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e17fe-9d5f-42d4-a441-2610d0872e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:39.930950 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e17fe-9d5f-42d4-a441-2610d0872e31 None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:39.931476 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e17fe-9d5f-42d4-a441-2610d0872e31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:39.931880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e17fe-9d5f-42d4-a441-2610d0872e31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:39.933425 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e17fe-9d5f-42d4-a441-2610d0872e31 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:39.950556 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 426/850] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:39.951271 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30cecb-3370-4c60-b707-13df21d80af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:39.952037 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e17fe-9d5f-42d4-a441-2610d0872e31 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:39.952210 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30cecb-3370-4c60-b707-13df21d80af7 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:39.952718 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30cecb-3370-4c60-b707-13df21d80af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:39.953149 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30cecb-3370-4c60-b707-13df21d80af7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:39.966191 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc30cecb-3370-4c60-b707-13df21d80af7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:42:39.971467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-cc30cecb-3370-4c60-b707-13df21d80af7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:39.971467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:39.971467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:39.971467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:39.971467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:39.971467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:39.971467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:39.971467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:39.971467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:39.971467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:39.971467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:39.971467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:39.971467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:42:39.971467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:42:39.971467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:42:39.971467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:42:39.972625 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:42:39.972625 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:42:39.972625 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:42:39.972625 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:42:39.972625 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:39.972625 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:39.972625 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:39.972625 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:39.972625 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:39.972625 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:39.972625 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:39.972625 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:39.972625 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:39.972625 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:39.972625 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:39.972625 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:39.973592 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:39.973592 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:39.973592 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:39.973592 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:39.973592 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:42:39.973592 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:42:39.973592 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:42:39.973592 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:42:39.973592 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:42:39.973592 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:42:39.973592 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:42:39.973592 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:39.974247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 425/851] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 7 10:42:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:42:39.980289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30cecb-3370-4c60-b707-13df21d80af7 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:40.086336 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e17fe-9d5f-42d4-a441-2610d0872e31 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:40.092198 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30cecb-3370-4c60-b707-13df21d80af7 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:40.093935 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:40.100891 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:40.133066 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f682fd3-43d0-466e-a2b3-8124af6731f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:40.133965 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f682fd3-43d0-466e-a2b3-8124af6731f4 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:40.134075 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f682fd3-43d0-466e-a2b3-8124af6731f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:40.134447 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f682fd3-43d0-466e-a2b3-8124af6731f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:40.135252 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f682fd3-43d0-466e-a2b3-8124af6731f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:40.135622 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f682fd3-43d0-466e-a2b3-8124af6731f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:40.137273 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f682fd3-43d0-466e-a2b3-8124af6731f4 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:40.140299 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ddd835-1797-4278-81fe-fb90a0949251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:40.141125 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddd835-1797-4278-81fe-fb90a0949251 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:40.142138 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddd835-1797-4278-81fe-fb90a0949251 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:40.142580 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddd835-1797-4278-81fe-fb90a0949251 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:40.147787 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 426/852] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 7 10:42:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:40.152437 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ddd835-1797-4278-81fe-fb90a0949251 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:40.153905 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ddd835-1797-4278-81fe-fb90a0949251 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:40.154500 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f682fd3-43d0-466e-a2b3-8124af6731f4 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:40.171432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-14ddd835-1797-4278-81fe-fb90a0949251 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:40.171432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:40.171432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:40.171432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:40.171432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:40.171432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:40.171432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:40.171432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:40.171432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:40.171432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:40.171432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:40.171432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:40.171432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:42:40.171432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:42:40.171432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:42:40.172414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:42:40.172414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:40.172414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:40.172414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:40.172414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:40.172414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:40.172414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:40.172414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:40.172414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:40.172414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:40.172414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:40.172414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:40.172414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:40.172414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:40.172414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:40.172414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:40.172414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:40.173898 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:42:40.173898 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:42:40.173898 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:42:40.173898 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:42:40.173898 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:42:40.173898 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:42:40.173898 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:40.173898 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:40.173898 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 427/853] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:40.182530 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ddd835-1797-4278-81fe-fb90a0949251 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:40.275987 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f682fd3-43d0-466e-a2b3-8124af6731f4 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:40.312143 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234f807-20a4-4577-bcb4-80ed95a8cc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:40.313122 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234f807-20a4-4577-bcb4-80ed95a8cc39 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:40.314253 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234f807-20a4-4577-bcb4-80ed95a8cc39 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:40.314736 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234f807-20a4-4577-bcb4-80ed95a8cc39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:40.321510 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ddd835-1797-4278-81fe-fb90a0949251 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:40.327161 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234f807-20a4-4577-bcb4-80ed95a8cc39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:40.328864 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234f807-20a4-4577-bcb4-80ed95a8cc39 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:40.345645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-b234f807-20a4-4577-bcb4-80ed95a8cc39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:40.345645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:40.345645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:40.345645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:40.345645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:40.345645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:40.345645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:40.345645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:40.345645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:40.345645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:40.345645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:40.345645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:40.345645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:40.345645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:40.345645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:40.345645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:40.346629 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:40.346629 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:40.346629 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:40.346629 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:40.346629 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:40.346629 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:40.346629 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:40.346629 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:40.346629 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:40.346629 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:40.346629 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:40.346629 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:40.346629 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:40.346629 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:40.346629 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:40.346629 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:40.346629 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:40.347584 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:40.347584 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:40.347584 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:40.354783 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 427/854] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:40.355862 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234f807-20a4-4577-bcb4-80ed95a8cc39 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:40.375590 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007208b5-a9a7-442d-9d67-a8aa38af8a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:40.376718 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007208b5-a9a7-442d-9d67-a8aa38af8a51 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:40.376995 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007208b5-a9a7-442d-9d67-a8aa38af8a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:40.377264 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007208b5-a9a7-442d-9d67-a8aa38af8a51 None admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:40.378067 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:40.379214 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007208b5-a9a7-442d-9d67-a8aa38af8a51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:40.379523 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007208b5-a9a7-442d-9d67-a8aa38af8a51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:40.381762 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007208b5-a9a7-442d-9d67-a8aa38af8a51 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:40.402739 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 428/855] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:42:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:40.408276 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007208b5-a9a7-442d-9d67-a8aa38af8a51 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:40.445491 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:40.474703 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234f807-20a4-4577-bcb4-80ed95a8cc39 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:40.512803 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b1a74-f9af-4133-ac66-ebde2fd18b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:40.513778 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b1a74-f9af-4133-ac66-ebde2fd18b49 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:40.514271 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b1a74-f9af-4133-ac66-ebde2fd18b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:40.514794 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b1a74-f9af-4133-ac66-ebde2fd18b49 None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:40.515680 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14b1a74-f9af-4133-ac66-ebde2fd18b49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:40.516176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14b1a74-f9af-4133-ac66-ebde2fd18b49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:40.518085 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14b1a74-f9af-4133-ac66-ebde2fd18b49 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:40.536460 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 428/856] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:40.537721 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b1a74-f9af-4133-ac66-ebde2fd18b49 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:40.539317 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007208b5-a9a7-442d-9d67-a8aa38af8a51 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:40.584816 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca3067-d9ae-46f1-b8dc-1691a73d0187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:40.585457 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca3067-d9ae-46f1-b8dc-1691a73d0187 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:40.585738 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca3067-d9ae-46f1-b8dc-1691a73d0187 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:40.586011 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca3067-d9ae-46f1-b8dc-1691a73d0187 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:40.587184 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca3067-d9ae-46f1-b8dc-1691a73d0187 None admin] RBAC: Adding query filter params (role.id=9da6e501237c405ca021a9d9f6173caf, scope.project.id=62eed8550ae3403f8a75894dbd19cf4a, user.id=a7181e5118c547a3a31d2e080c25ff01) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:40.587493 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca3067-d9ae-46f1-b8dc-1691a73d0187 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:40.589187 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca3067-d9ae-46f1-b8dc-1691a73d0187 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:40.601464 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 429/857] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:42:40 2022] GET /identity/v3/role_assignments?user.id=a7181e5118c547a3a31d2e080c25ff01&scope.project.id=62eed8550ae3403f8a75894dbd19cf4a&role.id=9da6e501237c405ca021a9d9f6173caf => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:40.636652 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:40.660918 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b1a74-f9af-4133-ac66-ebde2fd18b49 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:40.706350 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c926f1e-a268-4981-92c1-dd2ef04677d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:40.707472 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c926f1e-a268-4981-92c1-dd2ef04677d2 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:40.707953 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c926f1e-a268-4981-92c1-dd2ef04677d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:40.708569 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c926f1e-a268-4981-92c1-dd2ef04677d2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:40.717483 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c926f1e-a268-4981-92c1-dd2ef04677d2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:40.719405 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c926f1e-a268-4981-92c1-dd2ef04677d2 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:40.732676 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-1c926f1e-a268-4981-92c1-dd2ef04677d2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 10:42:40.732676 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:40.732676 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:40.732676 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:40.732676 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:40.732676 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:40.732676 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:40.732676 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:40.732676 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:40.732676 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:40.732676 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:40.732676 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:40.732676 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:42:40.732676 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:42:40.732676 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:42:40.732676 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:42:40.733735 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:40.733735 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:40.733735 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:42:40.733735 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:40.733735 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:42:40.733735 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:40.733735 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:40.733735 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:40.733735 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:40.733735 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:40.733735 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:40.733735 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:40.733735 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:40.733735 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:40.733735 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:40.733735 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:40.733735 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:40.733735 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:40.734684 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:40.734684 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:40.734684 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:42:40.734684 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:42:40.734684 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:42:40.734684 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:42:40.734684 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:42:40.734684 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:42:40.734684 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 10:42:40.734684 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:40.738054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 429/858] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Aug 7 10:42:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:40.743401 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b21dcf-6d84-44b7-87f9-b78a53945833 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:40.743689 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b21dcf-6d84-44b7-87f9-b78a53945833 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:40.743934 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c926f1e-a268-4981-92c1-dd2ef04677d2 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:40.744039 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b21dcf-6d84-44b7-87f9-b78a53945833 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:40.745868 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 430/859] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:40.751217 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e74cfd-49a5-4600-ae16-aa0e576c25cb None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:40.751507 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e74cfd-49a5-4600-ae16-aa0e576c25cb None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:40.751770 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e74cfd-49a5-4600-ae16-aa0e576c25cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:40.770656 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-44e74cfd-49a5-4600-ae16-aa0e576c25cb None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:40.771877 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-44e74cfd-49a5-4600-ae16-aa0e576c25cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:40.855768 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 431/860] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:40 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 10:42:40.874718 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c926f1e-a268-4981-92c1-dd2ef04677d2 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:40.878426 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e74cfd-49a5-4600-ae16-aa0e576c25cb None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:40.910624 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3014bc-5288-439e-90a9-c499b35db94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:40.911233 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3014bc-5288-439e-90a9-c499b35db94a None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:40.911507 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3014bc-5288-439e-90a9-c499b35db94a None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:40.911776 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3014bc-5288-439e-90a9-c499b35db94a None admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:40.912514 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3014bc-5288-439e-90a9-c499b35db94a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:40.912817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3014bc-5288-439e-90a9-c499b35db94a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:40.914274 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3014bc-5288-439e-90a9-c499b35db94a None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:40.915332 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:40.918164 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:40.934718 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 430/861] 10.222.0.27 () {56 vars in 1149 bytes} [Sun Aug 7 10:42:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:40.940211 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3014bc-5288-439e-90a9-c499b35db94a None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:41.026618 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e74cfd-49a5-4600-ae16-aa0e576c25cb None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:41.059357 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3014bc-5288-439e-90a9-c499b35db94a None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:41.070271 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78859c32-cd8e-4655-a18f-c6245a4e3eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:41.070647 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78859c32-cd8e-4655-a18f-c6245a4e3eed None admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:41.070851 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78859c32-cd8e-4655-a18f-c6245a4e3eed None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:41.071123 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78859c32-cd8e-4655-a18f-c6245a4e3eed None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:41.071768 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78859c32-cd8e-4655-a18f-c6245a4e3eed None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:41.073123 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78859c32-cd8e-4655-a18f-c6245a4e3eed None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:41.097146 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 432/862] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 7 10:42:40 2022] POST /identity/v3/services => generated 251 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 10:42:41.107241 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e63544-a582-49ba-9af5-7dc5b4ddc2d9 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:41.107439 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e63544-a582-49ba-9af5-7dc5b4ddc2d9 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:41.107686 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e63544-a582-49ba-9af5-7dc5b4ddc2d9 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:41.113784 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 433/863] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 10:42:41.115930 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a41f53-d5fd-43bf-837b-ff016c711012 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:41.116210 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a41f53-d5fd-43bf-837b-ff016c711012 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:41.116483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a41f53-d5fd-43bf-837b-ff016c711012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:41.125596 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb7d98-e250-49c5-a245-7a11ee1ff5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:41.127031 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb7d98-e250-49c5-a245-7a11ee1ff5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:41.127476 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb7d98-e250-49c5-a245-7a11ee1ff5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:41.127889 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb7d98-e250-49c5-a245-7a11ee1ff5c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:41.136985 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-26a41f53-d5fd-43bf-837b-ff016c711012 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:41.138299 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-26a41f53-d5fd-43bf-837b-ff016c711012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:41.212690 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:41.221462 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 434/864] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:41 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 10:42:41.234465 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb7d98-e250-49c5-a245-7a11ee1ff5c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:41.236356 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb7d98-e250-49c5-a245-7a11ee1ff5c5 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:41.239837 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a41f53-d5fd-43bf-837b-ff016c711012 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:41.256233 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:41.371303 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 431/865] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:42:40 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 10:42:41.379413 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb7d98-e250-49c5-a245-7a11ee1ff5c5 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:41.395674 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a41f53-d5fd-43bf-837b-ff016c711012 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:41.432930 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd11012-ac34-411c-a9cc-302aeab11a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:41.434040 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd11012-ac34-411c-a9cc-302aeab11a99 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:41.434541 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd11012-ac34-411c-a9cc-302aeab11a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:41.435014 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd11012-ac34-411c-a9cc-302aeab11a99 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:41.435796 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd11012-ac34-411c-a9cc-302aeab11a99 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:41.437569 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd11012-ac34-411c-a9cc-302aeab11a99 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:41.447330 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-9dd11012-ac34-411c-a9cc-302aeab11a99 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 10:42:41.447330 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:41.447330 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 10:42:41.447330 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 10:42:41.447330 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 10:42:41.447330 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 10:42:41.447330 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 10:42:41.447330 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:41.447330 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 10:42:41.447330 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:41.447330 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 10:42:41.447330 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:41.447330 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:41.447330 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:41.447330 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:41.447330 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:41.448329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:41.448329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:41.448329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:41.448329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:41.448329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:41.448329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:41.448329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:41.448329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 10:42:41.448329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 10:42:41.448329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 10:42:41.448329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 10:42:41.448329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:41.448329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:41.448329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:41.448329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:41.448329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:41.448329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:41.449231 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:41.449231 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:41.449231 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:41.449231 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:41.449231 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:41.449231 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:41.449231 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:41.449231 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:41.449231 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:41.449231 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:41.449231 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 10:42:41.449231 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:41.449231 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 10:42:41.449231 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:41.452104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 435/866] 10.222.0.27 () {56 vars in 1132 bytes} [Sun Aug 7 10:42:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:41.459252 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd11012-ac34-411c-a9cc-302aeab11a99 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:41.489274 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:41.502060 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb7d98-e250-49c5-a245-7a11ee1ff5c5 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:41.540148 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee757684-f48c-49f1-9b8b-dee0b0c4ef96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:41.540774 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee757684-f48c-49f1-9b8b-dee0b0c4ef96 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:41.541046 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee757684-f48c-49f1-9b8b-dee0b0c4ef96 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:41.541343 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee757684-f48c-49f1-9b8b-dee0b0c4ef96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:41.553697 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:41.555464 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee757684-f48c-49f1-9b8b-dee0b0c4ef96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:41.557271 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee757684-f48c-49f1-9b8b-dee0b0c4ef96 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:41.577940 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-ee757684-f48c-49f1-9b8b-dee0b0c4ef96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:41.577940 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:41.577940 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:41.577940 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:41.577940 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:41.577940 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:41.577940 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:41.577940 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:41.577940 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:41.577940 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:41.577940 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:41.577940 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:41.577940 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:41.577940 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:41.577940 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:41.577940 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:41.579455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:41.579455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:41.579455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:41.579455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:41.579455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:41.579455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:41.579455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:41.579455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:41.579455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:41.579455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:41.579455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:41.579455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:41.579455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:41.579455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:41.579455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:41.579455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:41.579455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:41.580344 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:41.580344 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:41.580344 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:41.580344 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 432/867] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:41.587224 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee757684-f48c-49f1-9b8b-dee0b0c4ef96 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:41.590604 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd11012-ac34-411c-a9cc-302aeab11a99 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:41.632326 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb429e05-c907-46b0-b7e3-b00f89f31762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:41.632905 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb429e05-c907-46b0-b7e3-b00f89f31762 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:41.633180 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb429e05-c907-46b0-b7e3-b00f89f31762 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:41.633486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb429e05-c907-46b0-b7e3-b00f89f31762 None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:41.634938 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb429e05-c907-46b0-b7e3-b00f89f31762 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:41.635242 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb429e05-c907-46b0-b7e3-b00f89f31762 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:41.636601 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb429e05-c907-46b0-b7e3-b00f89f31762 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:41.643077 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 436/868] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Aug 7 10:42:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:41.647807 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb429e05-c907-46b0-b7e3-b00f89f31762 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:41.705790 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee757684-f48c-49f1-9b8b-dee0b0c4ef96 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:41.741094 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364dbdee-000a-42c3-97f7-bd1be08ba660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:41.741743 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dbdee-000a-42c3-97f7-bd1be08ba660 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:41.742016 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dbdee-000a-42c3-97f7-bd1be08ba660 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:41.742279 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dbdee-000a-42c3-97f7-bd1be08ba660 None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:41.742990 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364dbdee-000a-42c3-97f7-bd1be08ba660 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:41.743279 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364dbdee-000a-42c3-97f7-bd1be08ba660 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:41.744661 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364dbdee-000a-42c3-97f7-bd1be08ba660 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:41.758041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 433/869] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:41.763299 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364dbdee-000a-42c3-97f7-bd1be08ba660 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:41.767545 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:41.771945 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb429e05-c907-46b0-b7e3-b00f89f31762 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:41.816241 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df68abd-c7d2-4ebb-9594-567ffacdfc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:41.816823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df68abd-c7d2-4ebb-9594-567ffacdfc7b None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:41.817096 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df68abd-c7d2-4ebb-9594-567ffacdfc7b None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:41.817393 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df68abd-c7d2-4ebb-9594-567ffacdfc7b None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:41.818026 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df68abd-c7d2-4ebb-9594-567ffacdfc7b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:41.818322 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df68abd-c7d2-4ebb-9594-567ffacdfc7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:41.820193 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df68abd-c7d2-4ebb-9594-567ffacdfc7b None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:41.829400 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 437/870] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Aug 7 10:42:41 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:41.898011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364dbdee-000a-42c3-97f7-bd1be08ba660 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:41.941550 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0eefc5-b557-47a3-a5e7-6c4fcd3d870f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:41.942601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0eefc5-b557-47a3-a5e7-6c4fcd3d870f None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:41.943081 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0eefc5-b557-47a3-a5e7-6c4fcd3d870f None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:41.943554 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0eefc5-b557-47a3-a5e7-6c4fcd3d870f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:41.951484 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0eefc5-b557-47a3-a5e7-6c4fcd3d870f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:41.953341 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0eefc5-b557-47a3-a5e7-6c4fcd3d870f None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:41.967116 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-4d0eefc5-b557-47a3-a5e7-6c4fcd3d870f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:41.967116 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:41.967116 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:41.967116 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:41.967116 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:41.967116 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:41.967116 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:41.967116 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:41.967116 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:41.967116 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:41.967116 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:41.967116 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:41.967116 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:42:41.967116 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:42:41.967116 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:42:41.968100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:42:41.968100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:41.968100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:41.968100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:41.968100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:41.968100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:41.968100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:41.968100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:41.968100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:41.968100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:41.968100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:41.968100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:41.968100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:41.968100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:41.968100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:41.968100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:41.968100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:41.969002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:42:41.969002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:42:41.969002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:42:41.969002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:42:41.969002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:42:41.969002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:42:41.969002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:41.969002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:41.972098 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 434/871] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:42:41.978842 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df68abd-c7d2-4ebb-9594-567ffacdfc7b None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:41.981880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:42.084168 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df68abd-c7d2-4ebb-9594-567ffacdfc7b None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:42.118335 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354678a-3daf-4554-92e4-1e4a32a87512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:42.118939 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354678a-3daf-4554-92e4-1e4a32a87512 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:42.119212 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354678a-3daf-4554-92e4-1e4a32a87512 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:42.119480 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354678a-3daf-4554-92e4-1e4a32a87512 None admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:42.120419 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354678a-3daf-4554-92e4-1e4a32a87512 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:42.120717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354678a-3daf-4554-92e4-1e4a32a87512 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:42.122204 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354678a-3daf-4554-92e4-1e4a32a87512 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:42.135658 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 438/872] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:42:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:42.141633 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0eefc5-b557-47a3-a5e7-6c4fcd3d870f None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:42.206217 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:42.248893 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0eefc5-b557-47a3-a5e7-6c4fcd3d870f None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:42.290197 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d0fba-3ffa-4101-aa2a-44cdc56058df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:42.291242 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d0fba-3ffa-4101-aa2a-44cdc56058df None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:42.291722 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d0fba-3ffa-4101-aa2a-44cdc56058df None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:42.292192 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d0fba-3ffa-4101-aa2a-44cdc56058df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:42.293130 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d0fba-3ffa-4101-aa2a-44cdc56058df None admin] RBAC: Adding query filter params (role.id=bf9e51dafeac420f89a66e78e1463982, scope.project.id=62eed8550ae3403f8a75894dbd19cf4a, user.id=e7eebb4bd7e04ff8bc4304a40cf6ba35) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:42.293671 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d0fba-3ffa-4101-aa2a-44cdc56058df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:42.295331 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d0fba-3ffa-4101-aa2a-44cdc56058df None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:42.302844 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 435/873] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:42:42 2022] GET /identity/v3/role_assignments?user.id=e7eebb4bd7e04ff8bc4304a40cf6ba35&scope.project.id=62eed8550ae3403f8a75894dbd19cf4a&role.id=bf9e51dafeac420f89a66e78e1463982 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:42.815285 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54338e5-3476-41d5-be83-0f533754ede7 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:42.815568 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54338e5-3476-41d5-be83-0f533754ede7 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:42.815824 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54338e5-3476-41d5-be83-0f533754ede7 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:42.817489 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 439/874] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:42.822751 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e8fba-6dbf-418a-bd8d-162878be8ca6 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:42.823206 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e8fba-6dbf-418a-bd8d-162878be8ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:42.823283 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e8fba-6dbf-418a-bd8d-162878be8ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:42.841455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-ce3e8fba-6dbf-418a-bd8d-162878be8ca6 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:42.842647 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ce3e8fba-6dbf-418a-bd8d-162878be8ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:42.912297 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 436/875] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:42 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:42:42.934187 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54338e5-3476-41d5-be83-0f533754ede7 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:43.000340 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:43.042901 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54338e5-3476-41d5-be83-0f533754ede7 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:43.082050 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1a433-77cb-4f2f-98e4-d0c56aa5b29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:43.082596 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1a433-77cb-4f2f-98e4-d0c56aa5b29c None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:43.082877 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1a433-77cb-4f2f-98e4-d0c56aa5b29c None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:43.083148 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1a433-77cb-4f2f-98e4-d0c56aa5b29c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:43.083732 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1a433-77cb-4f2f-98e4-d0c56aa5b29c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:43.085084 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1a433-77cb-4f2f-98e4-d0c56aa5b29c None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:43.094264 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-81e1a433-77cb-4f2f-98e4-d0c56aa5b29c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 10:42:43.094264 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:43.094264 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 10:42:43.094264 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 10:42:43.094264 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 10:42:43.094264 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 10:42:43.094264 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 10:42:43.094264 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:43.094264 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 10:42:43.094264 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:43.094264 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 10:42:43.094264 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:43.094264 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:43.094264 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:43.094264 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:43.094264 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:43.094264 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:43.095396 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:43.095396 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:43.095396 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:43.095396 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:43.095396 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:43.095396 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:43.095396 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 10:42:43.095396 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 10:42:43.095396 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 10:42:43.095396 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 10:42:43.095396 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:43.095396 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:43.095396 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:43.095396 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:43.095396 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:43.095396 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:43.096237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:43.096237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:43.096237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:43.096237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:43.096237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:43.096237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:43.096237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:43.096237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:43.096237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:43.096237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:43.096237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 10:42:43.096237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:43.096237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 10:42:43.096237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:43.096237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 440/876] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Aug 7 10:42:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:43.101903 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e8fba-6dbf-418a-bd8d-162878be8ca6 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:43.162452 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:43.195453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7379b56-10cb-47a0-8c22-f40ef346045a None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:43.196059 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7379b56-10cb-47a0-8c22-f40ef346045a None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:43.196530 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7379b56-10cb-47a0-8c22-f40ef346045a None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:43.198429 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 441/877] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 10:42:43.203374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f777c9b-8e57-4b7f-8e8c-4264a8efbad8 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:43.204447 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f777c9b-8e57-4b7f-8e8c-4264a8efbad8 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:43.204917 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f777c9b-8e57-4b7f-8e8c-4264a8efbad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:43.209400 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e8fba-6dbf-418a-bd8d-162878be8ca6 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:43.223701 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-4f777c9b-8e57-4b7f-8e8c-4264a8efbad8 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:43.225225 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-4f777c9b-8e57-4b7f-8e8c-4264a8efbad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:43.245789 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98616a05-a808-4864-8530-dddacbac1472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:43.246392 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98616a05-a808-4864-8530-dddacbac1472 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:43.246669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98616a05-a808-4864-8530-dddacbac1472 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:43.246938 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98616a05-a808-4864-8530-dddacbac1472 None admin] PATH_INFO: `/v3/services` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:43.247560 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98616a05-a808-4864-8530-dddacbac1472 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:43.247857 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98616a05-a808-4864-8530-dddacbac1472 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:43.249210 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98616a05-a808-4864-8530-dddacbac1472 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:43.254392 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 437/878] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Aug 7 10:42:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:43.259645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98616a05-a808-4864-8530-dddacbac1472 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:43.314443 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 442/879] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:43 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:42:43.341430 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f777c9b-8e57-4b7f-8e8c-4264a8efbad8 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:43.366946 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98616a05-a808-4864-8530-dddacbac1472 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:43.394326 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:43.402673 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86fb87-d14a-456d-b08a-23190605cd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:43.403047 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:43.403296 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86fb87-d14a-456d-b08a-23190605cd64 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:43.404157 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86fb87-d14a-456d-b08a-23190605cd64 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:43.404498 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86fb87-d14a-456d-b08a-23190605cd64 None admin] PATH_INFO: `/v3/services` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:43.405125 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86fb87-d14a-456d-b08a-23190605cd64 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:43.405466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86fb87-d14a-456d-b08a-23190605cd64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:43.406847 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86fb87-d14a-456d-b08a-23190605cd64 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:43.412352 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 438/880] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Aug 7 10:42:43 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:43.458739 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f777c9b-8e57-4b7f-8e8c-4264a8efbad8 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:43.496631 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f86df9-e362-4f7d-ae74-3dc808e33691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:43.497363 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f86df9-e362-4f7d-ae74-3dc808e33691 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:43.497651 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f86df9-e362-4f7d-ae74-3dc808e33691 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:43.497920 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f86df9-e362-4f7d-ae74-3dc808e33691 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:43.498524 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f86df9-e362-4f7d-ae74-3dc808e33691 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:43.499914 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f86df9-e362-4f7d-ae74-3dc808e33691 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:43.510377 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-e5f86df9-e362-4f7d-ae74-3dc808e33691 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 10:42:43.510377 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:43.510377 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 10:42:43.510377 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 10:42:43.510377 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 10:42:43.510377 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 10:42:43.510377 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 10:42:43.510377 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:43.510377 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 10:42:43.510377 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:43.510377 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 10:42:43.510377 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:43.510377 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:43.510377 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:43.510377 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:43.510377 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:43.510377 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:43.511446 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:43.511446 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:43.511446 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:43.511446 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:43.511446 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:43.511446 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:43.511446 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 10:42:43.511446 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 10:42:43.511446 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 10:42:43.511446 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 10:42:43.511446 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:43.511446 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:43.511446 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:43.511446 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:43.511446 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:43.511446 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:43.512299 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:43.512299 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:43.512299 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:43.512299 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:43.512299 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:43.512299 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:43.512299 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:43.512299 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:43.512299 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:43.512299 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:43.512299 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 10:42:43.512299 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:43.512299 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 10:42:43.512299 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:43.512299 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 443/881] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 7 10:42:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:42:43.520111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86fb87-d14a-456d-b08a-23190605cd64 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:43.634809 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86fb87-d14a-456d-b08a-23190605cd64 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:43.670859 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae354c3f-2ff2-4999-9425-24ea29ac65f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:43.671467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae354c3f-2ff2-4999-9425-24ea29ac65f5 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:43.671752 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae354c3f-2ff2-4999-9425-24ea29ac65f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:43.672064 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae354c3f-2ff2-4999-9425-24ea29ac65f5 None admin] PATH_INFO: `/v3/services` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:43.673239 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae354c3f-2ff2-4999-9425-24ea29ac65f5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:43.673575 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae354c3f-2ff2-4999-9425-24ea29ac65f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:43.674937 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae354c3f-2ff2-4999-9425-24ea29ac65f5 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:43.680164 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 439/882] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 7 10:42:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:43.685747 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f86df9-e362-4f7d-ae74-3dc808e33691 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:43.799704 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f86df9-e362-4f7d-ae74-3dc808e33691 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:43.823301 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:43.839724 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c310d-0fe4-4856-b65c-8eea480a69c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:43.840343 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c310d-0fe4-4856-b65c-8eea480a69c2 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:43.840621 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c310d-0fe4-4856-b65c-8eea480a69c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:43.840892 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c310d-0fe4-4856-b65c-8eea480a69c2 None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:43.841555 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c310d-0fe4-4856-b65c-8eea480a69c2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:43.841857 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c310d-0fe4-4856-b65c-8eea480a69c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:43.843205 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c310d-0fe4-4856-b65c-8eea480a69c2 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:43.848643 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 444/883] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 7 10:42:43 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:43.854223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae354c3f-2ff2-4999-9425-24ea29ac65f5 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:43.913792 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:43.968488 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae354c3f-2ff2-4999-9425-24ea29ac65f5 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:43.991518 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f64482-dbbc-4d1d-b30a-42b7374c2ffa None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:43.991966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f64482-dbbc-4d1d-b30a-42b7374c2ffa None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:43.992247 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f64482-dbbc-4d1d-b30a-42b7374c2ffa None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:43.993888 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 445/884] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:44.001475 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102dceaa-8c7d-4475-900a-e0201a704033 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:44.001885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102dceaa-8c7d-4475-900a-e0201a704033 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:44.002260 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102dceaa-8c7d-4475-900a-e0201a704033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:44.006289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccb4d2-cff6-4eac-b476-57c13ad27195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:44.007067 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccb4d2-cff6-4eac-b476-57c13ad27195 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:44.007487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccb4d2-cff6-4eac-b476-57c13ad27195 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:44.007917 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccb4d2-cff6-4eac-b476-57c13ad27195 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:44.008762 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccb4d2-cff6-4eac-b476-57c13ad27195 None admin] RBAC: Adding query filter params (interface=public, service_id=2bd6eb6b224249a4969dc89c681f21b6, region_id=RegionOne) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:44.009222 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccb4d2-cff6-4eac-b476-57c13ad27195 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:44.010740 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccb4d2-cff6-4eac-b476-57c13ad27195 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:44.016352 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 440/885] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Aug 7 10:42:43 2022] GET /identity/v3/endpoints?service_id=2bd6eb6b224249a4969dc89c681f21b6&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:44.021877 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccb4d2-cff6-4eac-b476-57c13ad27195 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:44.023023 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-102dceaa-8c7d-4475-900a-e0201a704033 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:44.024318 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-102dceaa-8c7d-4475-900a-e0201a704033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:44.100888 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 446/886] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:43 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:42:44.128393 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102dceaa-8c7d-4475-900a-e0201a704033 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:44.138909 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccb4d2-cff6-4eac-b476-57c13ad27195 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:44.152979 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:44.182087 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75849cba-7aaa-48db-8557-3fb3c6a79f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:44.182609 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75849cba-7aaa-48db-8557-3fb3c6a79f34 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:44.182886 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75849cba-7aaa-48db-8557-3fb3c6a79f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:44.183155 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75849cba-7aaa-48db-8557-3fb3c6a79f34 None admin] PATH_INFO: `/v3/services` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:44.183756 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75849cba-7aaa-48db-8557-3fb3c6a79f34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:44.185415 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75849cba-7aaa-48db-8557-3fb3c6a79f34 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:44.192128 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 441/887] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Aug 7 10:42:44 2022] GET /identity/v3/services => generated 1011 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 10:42:44.256452 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102dceaa-8c7d-4475-900a-e0201a704033 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:44.273994 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:44.296699 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae06c2-4e1a-4f74-a9ce-b4397158956d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:44.297332 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae06c2-4e1a-4f74-a9ce-b4397158956d None admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:44.297683 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae06c2-4e1a-4f74-a9ce-b4397158956d None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:44.297956 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae06c2-4e1a-4f74-a9ce-b4397158956d None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:44.298626 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae06c2-4e1a-4f74-a9ce-b4397158956d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:44.300002 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae06c2-4e1a-4f74-a9ce-b4397158956d None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:44.320333 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 447/888] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 7 10:42:44 2022] POST /identity/v3/services => generated 269 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 10:42:44.532703 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb09a0-4ff4-4e57-8e0b-3d30b0c06222 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:44.532954 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb09a0-4ff4-4e57-8e0b-3d30b0c06222 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:44.533242 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb09a0-4ff4-4e57-8e0b-3d30b0c06222 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:44.534896 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 442/889] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:44.542755 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affffe53-3406-4e09-8724-e8186da3fd2a None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:44.543164 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affffe53-3406-4e09-8724-e8186da3fd2a None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:44.543536 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affffe53-3406-4e09-8724-e8186da3fd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:44.563072 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-affffe53-3406-4e09-8724-e8186da3fd2a None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:44.564797 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-affffe53-3406-4e09-8724-e8186da3fd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:44.643624 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 448/890] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:44 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:42:44.667882 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb09a0-4ff4-4e57-8e0b-3d30b0c06222 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:44.776078 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb09a0-4ff4-4e57-8e0b-3d30b0c06222 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:44.812273 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045fa3e-d864-47aa-a831-353762184052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:44.812823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045fa3e-d864-47aa-a831-353762184052 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:44.813099 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045fa3e-d864-47aa-a831-353762184052 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:44.813944 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045fa3e-d864-47aa-a831-353762184052 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:44.824351 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045fa3e-d864-47aa-a831-353762184052 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:42:44.829110 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-5045fa3e-d864-47aa-a831-353762184052 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 10:42:44.829110 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:44.829110 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:44.829110 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:44.829110 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:44.829110 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:44.829110 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:44.829110 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:44.829110 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:44.829110 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:44.829110 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:44.829110 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:44.829110 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:42:44.829110 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:42:44.829110 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:42:44.829110 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:42:44.830055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:42:44.830055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:42:44.830055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:42:44.830055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:42:44.830055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:44.830055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:44.830055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:44.830055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:44.830055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:44.830055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:44.830055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:44.830055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:44.830055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:44.830055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:44.830055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:44.830055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:44.830888 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:44.830888 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:44.830888 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:44.830888 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:44.830888 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:42:44.830888 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:42:44.830888 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:42:44.830888 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:42:44.830888 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:42:44.830888 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:42:44.830888 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 10:42:44.830888 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:44.830888 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 443/891] 10.222.0.27 () {56 vars in 1120 bytes} [Sun Aug 7 10:42:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:44.837394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affffe53-3406-4e09-8724-e8186da3fd2a None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:44.944572 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:44.947754 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affffe53-3406-4e09-8724-e8186da3fd2a None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:44.987479 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8b417-d472-4d7d-ba80-d95f8a139692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:44.988092 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8b417-d472-4d7d-ba80-d95f8a139692 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:44.988367 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8b417-d472-4d7d-ba80-d95f8a139692 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:44.988635 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8b417-d472-4d7d-ba80-d95f8a139692 None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:44.989302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8b417-d472-4d7d-ba80-d95f8a139692 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:44.989699 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8b417-d472-4d7d-ba80-d95f8a139692 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:44.991172 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8b417-d472-4d7d-ba80-d95f8a139692 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:45.004109 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 449/892] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Aug 7 10:42:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:45.010358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045fa3e-d864-47aa-a831-353762184052 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:45.047722 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:45.115232 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045fa3e-d864-47aa-a831-353762184052 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:45.150733 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcb205-b4b9-4a3f-a241-f0837d5b96a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:45.151362 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcb205-b4b9-4a3f-a241-f0837d5b96a6 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:45.151637 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcb205-b4b9-4a3f-a241-f0837d5b96a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:45.151907 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcb205-b4b9-4a3f-a241-f0837d5b96a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:45.162464 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fcb205-b4b9-4a3f-a241-f0837d5b96a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:45.163939 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fcb205-b4b9-4a3f-a241-f0837d5b96a6 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:45.179672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-97fcb205-b4b9-4a3f-a241-f0837d5b96a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:45.179672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:45.179672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:45.179672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:45.179672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:45.179672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:45.179672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:45.179672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:45.179672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:45.179672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:45.179672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:45.179672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:45.179672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:45.179672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:45.179672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:45.179672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:45.180669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:45.180669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:45.180669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:45.180669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:45.180669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:45.180669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:45.180669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:45.180669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:45.180669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:45.180669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:45.180669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:45.180669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:45.180669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:45.180669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:45.180669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:45.180669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:45.180669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:45.181643 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:45.181643 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:45.181643 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:45.181643 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 444/893] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:45.186885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8b417-d472-4d7d-ba80-d95f8a139692 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:45.295194 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8b417-d472-4d7d-ba80-d95f8a139692 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:45.332698 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717276be-8150-4e36-a594-af65936c6ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:45.332698 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717276be-8150-4e36-a594-af65936c6ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:45.332698 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717276be-8150-4e36-a594-af65936c6ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:45.332698 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717276be-8150-4e36-a594-af65936c6ba9 None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:45.333102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717276be-8150-4e36-a594-af65936c6ba9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:45.333381 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717276be-8150-4e36-a594-af65936c6ba9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:45.334716 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717276be-8150-4e36-a594-af65936c6ba9 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:45.351345 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 450/894] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:45.354372 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcb205-b4b9-4a3f-a241-f0837d5b96a6 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:45.449152 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:45.466134 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcb205-b4b9-4a3f-a241-f0837d5b96a6 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:45.500827 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbd31c-4333-44e5-987c-e23c518203cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:45.501496 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbd31c-4333-44e5-987c-e23c518203cc None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:45.501774 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbd31c-4333-44e5-987c-e23c518203cc None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:45.502037 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbd31c-4333-44e5-987c-e23c518203cc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:45.509755 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfbd31c-4333-44e5-987c-e23c518203cc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:45.511192 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfbd31c-4333-44e5-987c-e23c518203cc None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:45.522670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-bcfbd31c-4333-44e5-987c-e23c518203cc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 10:42:45.522670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:45.522670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:45.522670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:45.522670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:45.522670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:45.522670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:45.522670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:45.522670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:45.522670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:45.522670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:45.522670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:45.522670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:42:45.522670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:42:45.522670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:42:45.522670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:42:45.523627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:45.523627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:45.523627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:42:45.523627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:45.523627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:42:45.523627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:45.523627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:45.523627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:45.523627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:45.523627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:45.523627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:45.523627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:45.523627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:45.523627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:45.523627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:45.523627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:45.523627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:45.523627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:45.524733 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:45.524733 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:45.524733 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:42:45.524733 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:42:45.524733 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:42:45.524733 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:42:45.524733 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:42:45.524733 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:42:45.524733 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 10:42:45.524733 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:45.524733 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 445/895] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Aug 7 10:42:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:45.531731 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717276be-8150-4e36-a594-af65936c6ba9 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:45.554773 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6fe97-7f69-4125-8565-704727d86e02 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:45.555087 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6fe97-7f69-4125-8565-704727d86e02 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:45.555306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6fe97-7f69-4125-8565-704727d86e02 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:45.556879 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 446/896] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:45.559779 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:45.562170 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68fee3-dfb1-4615-9f00-ac8eb4284952 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:45.563984 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68fee3-dfb1-4615-9f00-ac8eb4284952 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:45.563984 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68fee3-dfb1-4615-9f00-ac8eb4284952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:45.583156 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-4b68fee3-dfb1-4615-9f00-ac8eb4284952 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:45.584119 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-4b68fee3-dfb1-4615-9f00-ac8eb4284952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:45.649987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717276be-8150-4e36-a594-af65936c6ba9 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:45.672516 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 447/897] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:45 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 10:42:45.686897 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa016f-f8fa-431c-8ed6-86c57c0d432e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:45.687855 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa016f-f8fa-431c-8ed6-86c57c0d432e None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:45.688361 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa016f-f8fa-431c-8ed6-86c57c0d432e None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:45.688836 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa016f-f8fa-431c-8ed6-86c57c0d432e None admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:45.689800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa016f-f8fa-431c-8ed6-86c57c0d432e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:45.690311 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa016f-f8fa-431c-8ed6-86c57c0d432e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:45.692016 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa016f-f8fa-431c-8ed6-86c57c0d432e None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:45.694971 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68fee3-dfb1-4615-9f00-ac8eb4284952 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:45.714717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 451/898] 10.222.0.27 () {56 vars in 1149 bytes} [Sun Aug 7 10:42:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:45.721353 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa016f-f8fa-431c-8ed6-86c57c0d432e None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:45.798821 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:45.817233 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:45.826238 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68fee3-dfb1-4615-9f00-ac8eb4284952 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:45.847571 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa016f-f8fa-431c-8ed6-86c57c0d432e None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:45.864408 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d9208-2c77-4671-818d-ab3b6d6157b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:45.865401 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d9208-2c77-4671-818d-ab3b6d6157b9 None admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:45.865939 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d9208-2c77-4671-818d-ab3b6d6157b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:45.866422 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d9208-2c77-4671-818d-ab3b6d6157b9 None admin] PATH_INFO: `/v3/services` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:45.867246 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d9208-2c77-4671-818d-ab3b6d6157b9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:45.868887 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d9208-2c77-4671-818d-ab3b6d6157b9 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:45.893346 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 448/899] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 7 10:42:45 2022] POST /identity/v3/services => generated 241 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:42:45.896938 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e215847-551e-4213-ac51-01fda061b67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:45.897598 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e215847-551e-4213-ac51-01fda061b67b None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:45.897873 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e215847-551e-4213-ac51-01fda061b67b None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:45.898146 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e215847-551e-4213-ac51-01fda061b67b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:45.975647 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e215847-551e-4213-ac51-01fda061b67b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:45.977047 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e215847-551e-4213-ac51-01fda061b67b None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:46.062937 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:46.088274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 452/900] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:42:45 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 10:42:46.094224 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d9208-2c77-4671-818d-ab3b6d6157b9 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:46.200263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d9208-2c77-4671-818d-ab3b6d6157b9 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:46.234918 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad38ed7-1a85-4305-8d0d-423b950a0970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:46.236004 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad38ed7-1a85-4305-8d0d-423b950a0970 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:46.236284 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad38ed7-1a85-4305-8d0d-423b950a0970 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:46.236562 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad38ed7-1a85-4305-8d0d-423b950a0970 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:46.243998 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:46.249420 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad38ed7-1a85-4305-8d0d-423b950a0970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:46.251042 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad38ed7-1a85-4305-8d0d-423b950a0970 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:46.268678 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-0ad38ed7-1a85-4305-8d0d-423b950a0970 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:46.268678 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:46.268678 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:46.268678 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:46.268678 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:46.268678 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:46.268678 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:46.268678 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:46.268678 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:46.268678 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:46.268678 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:46.268678 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:46.268678 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:46.268678 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:46.268678 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:46.268678 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:46.269705 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:46.269705 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:46.269705 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:46.269705 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:46.269705 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:46.269705 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:46.269705 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:46.269705 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:46.269705 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:46.269705 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:46.269705 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:46.269705 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:46.269705 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:46.269705 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:46.269705 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:46.269705 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:46.269705 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:46.270597 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:46.270597 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:46.270597 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:46.270597 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 449/901] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:46.276978 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e215847-551e-4213-ac51-01fda061b67b None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:46.303904 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052c2ef-7cc2-4dfc-898d-9c2646dd2569 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:46.304203 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052c2ef-7cc2-4dfc-898d-9c2646dd2569 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:46.304544 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052c2ef-7cc2-4dfc-898d-9c2646dd2569 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:46.306088 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 450/902] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 10:42:46.311002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b9135-9419-475f-b1fb-e630b79e8c08 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:46.311282 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b9135-9419-475f-b1fb-e630b79e8c08 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:46.311557 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b9135-9419-475f-b1fb-e630b79e8c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:46.336038 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-ff4b9135-9419-475f-b1fb-e630b79e8c08 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:46.337167 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ff4b9135-9419-475f-b1fb-e630b79e8c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:46.398670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e215847-551e-4213-ac51-01fda061b67b None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:46.429378 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 451/903] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 10:42:46.444257 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e6826-dfcd-41b6-a574-48b87e7c30af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:46.445160 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e6826-dfcd-41b6-a574-48b87e7c30af None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:46.445674 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e6826-dfcd-41b6-a574-48b87e7c30af None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:46.446149 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e6826-dfcd-41b6-a574-48b87e7c30af None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:46.447005 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92e6826-dfcd-41b6-a574-48b87e7c30af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:46.447584 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92e6826-dfcd-41b6-a574-48b87e7c30af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:46.449744 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b9135-9419-475f-b1fb-e630b79e8c08 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:46.454028 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92e6826-dfcd-41b6-a574-48b87e7c30af None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:46.466876 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 453/904] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:46.473800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e6826-dfcd-41b6-a574-48b87e7c30af None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:46.509755 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:46.561921 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b9135-9419-475f-b1fb-e630b79e8c08 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:46.582285 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e6826-dfcd-41b6-a574-48b87e7c30af None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:46.583372 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:46.599080 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab18439-525c-41bf-b9ad-fd86f241c8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:46.599714 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab18439-525c-41bf-b9ad-fd86f241c8e9 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:46.599988 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab18439-525c-41bf-b9ad-fd86f241c8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:46.600259 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab18439-525c-41bf-b9ad-fd86f241c8e9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:46.600838 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab18439-525c-41bf-b9ad-fd86f241c8e9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:46.602298 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab18439-525c-41bf-b9ad-fd86f241c8e9 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:46.611069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-1ab18439-525c-41bf-b9ad-fd86f241c8e9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 10:42:46.611069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:46.611069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 10:42:46.611069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 10:42:46.611069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 10:42:46.611069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 10:42:46.611069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 10:42:46.611069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:46.611069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 10:42:46.611069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:46.611069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 10:42:46.611069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:46.611069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:46.611069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:46.611069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:46.611069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:46.611069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:46.612093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:46.612093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:46.612093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:46.612093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:46.612093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:46.612093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:46.612093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 10:42:46.612093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 10:42:46.612093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 10:42:46.612093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 10:42:46.612093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:46.612093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:46.612093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:46.612093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:46.612093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:46.612093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:46.612951 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:46.612951 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:46.612951 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:46.612951 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:46.612951 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:46.612951 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:46.612951 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:46.612951 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:46.612951 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:46.612951 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:46.612951 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 10:42:46.612951 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:46.612951 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 10:42:46.612951 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:46.617115 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 452/905] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 7 10:42:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:42:46.618352 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61995a3-1bcb-475a-87d3-ae0b04586239 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:46.618633 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61995a3-1bcb-475a-87d3-ae0b04586239 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:46.618904 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61995a3-1bcb-475a-87d3-ae0b04586239 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:46.619724 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280a075-51c4-42d7-99fc-d9ec58dd0970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:46.624476 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 453/906] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:46.624613 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280a075-51c4-42d7-99fc-d9ec58dd0970 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:46.624613 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280a075-51c4-42d7-99fc-d9ec58dd0970 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:46.624613 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280a075-51c4-42d7-99fc-d9ec58dd0970 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:46.624805 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61995a3-1bcb-475a-87d3-ae0b04586239 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:46.632359 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280a075-51c4-42d7-99fc-d9ec58dd0970 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:46.633846 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280a075-51c4-42d7-99fc-d9ec58dd0970 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:46.645248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-d280a075-51c4-42d7-99fc-d9ec58dd0970 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:46.645248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:46.645248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:46.645248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:46.645248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:46.645248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:46.645248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:46.645248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:46.645248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:46.645248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:46.645248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:46.645248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:46.645248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:42:46.645248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:42:46.645248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:42:46.646145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:42:46.646145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:46.646145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:46.646145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:46.646145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:46.646145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:46.646145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:46.646145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:46.646145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:46.646145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:46.646145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:46.646145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:46.646145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:46.646145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:46.646145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:46.646145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:46.646145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:46.652598 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:42:46.652598 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:42:46.652598 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:42:46.652598 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:42:46.652598 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:42:46.652598 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:42:46.652598 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:46.652598 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:46.652598 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 454/907] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:46.652598 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090a7e7-a043-4466-b482-72ad46508c43 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:46.652598 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090a7e7-a043-4466-b482-72ad46508c43 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:46.653333 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090a7e7-a043-4466-b482-72ad46508c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:46.667772 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-e090a7e7-a043-4466-b482-72ad46508c43 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:46.668950 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-e090a7e7-a043-4466-b482-72ad46508c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:46.741378 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 455/908] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:42:46.741378 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090a7e7-a043-4466-b482-72ad46508c43 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:46.741633 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61995a3-1bcb-475a-87d3-ae0b04586239 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:46.776841 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:46.780414 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e741fa-ee29-4865-9806-b0f28a9c9ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:46.781187 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e741fa-ee29-4865-9806-b0f28a9c9ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:46.781490 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e741fa-ee29-4865-9806-b0f28a9c9ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:46.781759 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e741fa-ee29-4865-9806-b0f28a9c9ef9 None admin] PATH_INFO: `/v3/services` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:46.782427 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e741fa-ee29-4865-9806-b0f28a9c9ef9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:46.782721 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e741fa-ee29-4865-9806-b0f28a9c9ef9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:46.784086 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e741fa-ee29-4865-9806-b0f28a9c9ef9 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:46.793944 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 454/909] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 7 10:42:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:46.793944 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e741fa-ee29-4865-9806-b0f28a9c9ef9 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:46.845967 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:46.856818 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090a7e7-a043-4466-b482-72ad46508c43 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:46.896121 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31dcc5e-c546-4ae7-900e-1a78cc14ea53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:46.896837 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dcc5e-c546-4ae7-900e-1a78cc14ea53 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:46.897113 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dcc5e-c546-4ae7-900e-1a78cc14ea53 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:46.897413 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dcc5e-c546-4ae7-900e-1a78cc14ea53 None admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:46.898107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31dcc5e-c546-4ae7-900e-1a78cc14ea53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:46.898409 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31dcc5e-c546-4ae7-900e-1a78cc14ea53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:46.899631 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e741fa-ee29-4865-9806-b0f28a9c9ef9 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:46.899825 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31dcc5e-c546-4ae7-900e-1a78cc14ea53 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:46.912273 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 456/910] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:42:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:46.913085 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31dcc5e-c546-4ae7-900e-1a78cc14ea53 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:46.938662 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f36be-f022-4649-bc4b-e4fb9ac7b8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:46.939286 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f36be-f022-4649-bc4b-e4fb9ac7b8e1 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:46.939562 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f36be-f022-4649-bc4b-e4fb9ac7b8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:46.939831 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f36be-f022-4649-bc4b-e4fb9ac7b8e1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:46.940406 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f36be-f022-4649-bc4b-e4fb9ac7b8e1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:46.941796 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f36be-f022-4649-bc4b-e4fb9ac7b8e1 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:46.950473 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-043f36be-f022-4649-bc4b-e4fb9ac7b8e1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 10:42:46.950473 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:46.950473 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 10:42:46.950473 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 10:42:46.950473 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 10:42:46.950473 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 10:42:46.950473 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 10:42:46.950473 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:46.950473 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 10:42:46.950473 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:46.950473 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 10:42:46.950473 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:46.950473 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:46.950473 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:46.950473 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:46.950473 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:46.951590 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:46.951590 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:46.951590 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:46.951590 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:46.951590 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:46.951590 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:46.951590 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:46.951590 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 10:42:46.951590 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 10:42:46.951590 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 10:42:46.951590 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 10:42:46.951590 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:46.951590 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:46.951590 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:46.951590 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:46.951590 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:46.951590 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:46.952688 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:46.952688 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:46.952688 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:46.952688 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:46.952688 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:46.952688 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:46.952688 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:46.952688 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:46.952688 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:46.952688 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:46.952688 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 10:42:46.952688 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:46.952688 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 10:42:46.952688 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:46.956897 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 455/911] 10.222.0.27 () {56 vars in 1132 bytes} [Sun Aug 7 10:42:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:46.957716 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f36be-f022-4649-bc4b-e4fb9ac7b8e1 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:47.007214 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:47.023555 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31dcc5e-c546-4ae7-900e-1a78cc14ea53 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:47.058682 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f36be-f022-4649-bc4b-e4fb9ac7b8e1 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:47.060250 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d7821-4a6b-45a1-a6d2-972cdd81fd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:47.060859 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d7821-4a6b-45a1-a6d2-972cdd81fd2f None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:47.061133 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d7821-4a6b-45a1-a6d2-972cdd81fd2f None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:47.061430 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d7821-4a6b-45a1-a6d2-972cdd81fd2f None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:47.062063 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d7821-4a6b-45a1-a6d2-972cdd81fd2f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:47.062359 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d7821-4a6b-45a1-a6d2-972cdd81fd2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:47.064256 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d7821-4a6b-45a1-a6d2-972cdd81fd2f None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:47.073730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 457/912] 10.222.0.27 () {56 vars in 1114 bytes} [Sun Aug 7 10:42:46 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:47.073730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d7821-4a6b-45a1-a6d2-972cdd81fd2f None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:47.077402 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:47.100975 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc69ad-76b5-4da2-89a0-e9fb4b556458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:47.101717 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc69ad-76b5-4da2-89a0-e9fb4b556458 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:47.101902 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc69ad-76b5-4da2-89a0-e9fb4b556458 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:47.102172 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc69ad-76b5-4da2-89a0-e9fb4b556458 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:47.102882 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc69ad-76b5-4da2-89a0-e9fb4b556458 None admin] RBAC: Adding query filter params (role.id=051acd6762694d9985183bf0b8860800, scope.project.id=62eed8550ae3403f8a75894dbd19cf4a, user.id=e7eebb4bd7e04ff8bc4304a40cf6ba35) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:47.103184 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc69ad-76b5-4da2-89a0-e9fb4b556458 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:47.104592 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc69ad-76b5-4da2-89a0-e9fb4b556458 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:47.121370 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 456/913] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:42:46 2022] GET /identity/v3/role_assignments?user.id=e7eebb4bd7e04ff8bc4304a40cf6ba35&scope.project.id=62eed8550ae3403f8a75894dbd19cf4a&role.id=051acd6762694d9985183bf0b8860800 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:47.121370 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc69ad-76b5-4da2-89a0-e9fb4b556458 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:47.212284 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d7821-4a6b-45a1-a6d2-972cdd81fd2f None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:47.234769 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc69ad-76b5-4da2-89a0-e9fb4b556458 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:47.259253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4ea09-b920-4aba-ab61-390ff9ed464d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:47.260234 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4ea09-b920-4aba-ab61-390ff9ed464d None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:47.260578 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4ea09-b920-4aba-ab61-390ff9ed464d None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:47.260919 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4ea09-b920-4aba-ab61-390ff9ed464d None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:47.261816 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4ea09-b920-4aba-ab61-390ff9ed464d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:47.262556 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4ea09-b920-4aba-ab61-390ff9ed464d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:47.264260 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4ea09-b920-4aba-ab61-390ff9ed464d None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:47.272836 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 458/914] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Aug 7 10:42:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:47.279788 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4ea09-b920-4aba-ab61-390ff9ed464d None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:47.280784 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fcf10-2404-406e-85e5-27e45ee934fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:47.281433 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fcf10-2404-406e-85e5-27e45ee934fe None admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:47.281712 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fcf10-2404-406e-85e5-27e45ee934fe None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:47.282523 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fcf10-2404-406e-85e5-27e45ee934fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:47.283194 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fcf10-2404-406e-85e5-27e45ee934fe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:47.284633 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fcf10-2404-406e-85e5-27e45ee934fe None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:47.306044 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:47.314073 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 457/915] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:42:47 2022] POST /identity/v3/endpoints => generated 346 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:42:47.415739 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4ea09-b920-4aba-ab61-390ff9ed464d None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:47.459609 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa0833-4a44-4b4b-89e8-45efbf4f03eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:47.460223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa0833-4a44-4b4b-89e8-45efbf4f03eb None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:47.460496 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa0833-4a44-4b4b-89e8-45efbf4f03eb None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:47.460762 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa0833-4a44-4b4b-89e8-45efbf4f03eb None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:47.461416 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa0833-4a44-4b4b-89e8-45efbf4f03eb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:47.461719 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa0833-4a44-4b4b-89e8-45efbf4f03eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:47.463077 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa0833-4a44-4b4b-89e8-45efbf4f03eb None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:47.469386 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 459/916] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Aug 7 10:42:47 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:47.475582 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fcf10-2404-406e-85e5-27e45ee934fe None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:47.508331 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:47.581847 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fcf10-2404-406e-85e5-27e45ee934fe None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:47.616578 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8972f-5c56-4409-9fe7-5be3d90809c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:47.617245 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8972f-5c56-4409-9fe7-5be3d90809c8 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:47.617555 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8972f-5c56-4409-9fe7-5be3d90809c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:47.617829 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8972f-5c56-4409-9fe7-5be3d90809c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:47.618537 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8972f-5c56-4409-9fe7-5be3d90809c8 None admin] RBAC: Adding query filter params (interface=public, service_id=bed1ec4bcdc54a0d88b0b0d327053a0e, region_id=RegionOne) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:47.618839 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8972f-5c56-4409-9fe7-5be3d90809c8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:47.620556 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8972f-5c56-4409-9fe7-5be3d90809c8 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:47.626273 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 458/917] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Aug 7 10:42:47 2022] GET /identity/v3/endpoints?service_id=bed1ec4bcdc54a0d88b0b0d327053a0e&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:47.631484 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa0833-4a44-4b4b-89e8-45efbf4f03eb None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:47.709558 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:47.734876 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa0833-4a44-4b4b-89e8-45efbf4f03eb None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:47.770593 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ad30d-14dd-4379-9bf0-21a844bd3f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:47.771203 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ad30d-14dd-4379-9bf0-21a844bd3f66 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:47.771477 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ad30d-14dd-4379-9bf0-21a844bd3f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:47.771744 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ad30d-14dd-4379-9bf0-21a844bd3f66 None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:47.772342 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ad30d-14dd-4379-9bf0-21a844bd3f66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:47.773719 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ad30d-14dd-4379-9bf0-21a844bd3f66 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:47.779998 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 460/918] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Aug 7 10:42:47 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:42:48.081698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916d898-2ada-4553-a1e0-7b7d378c0edc None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:48.082079 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916d898-2ada-4553-a1e0-7b7d378c0edc None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:48.082278 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916d898-2ada-4553-a1e0-7b7d378c0edc None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:48.083869 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 459/919] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:48.089384 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473c853-5775-4b2e-8c3d-08649c859b20 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:48.089678 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473c853-5775-4b2e-8c3d-08649c859b20 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:48.089952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473c853-5775-4b2e-8c3d-08649c859b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:48.108882 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-0473c853-5775-4b2e-8c3d-08649c859b20 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:48.110663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-0473c853-5775-4b2e-8c3d-08649c859b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:48.180784 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 461/920] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:42:48.203599 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916d898-2ada-4553-a1e0-7b7d378c0edc None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:48.315655 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:48.324442 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916d898-2ada-4553-a1e0-7b7d378c0edc None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:48.360814 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0531aea-d28c-4565-bb01-8cbedf2ecc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:48.361502 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0531aea-d28c-4565-bb01-8cbedf2ecc98 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:48.361783 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0531aea-d28c-4565-bb01-8cbedf2ecc98 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:48.362054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0531aea-d28c-4565-bb01-8cbedf2ecc98 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:48.362650 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0531aea-d28c-4565-bb01-8cbedf2ecc98 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:48.364008 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0531aea-d28c-4565-bb01-8cbedf2ecc98 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:48.373334 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-e0531aea-d28c-4565-bb01-8cbedf2ecc98 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 10:42:48.373334 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:48.373334 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 10:42:48.373334 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 10:42:48.373334 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 10:42:48.373334 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 10:42:48.373334 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 10:42:48.373334 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:48.373334 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 10:42:48.373334 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:48.373334 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 10:42:48.373334 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:48.373334 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:48.373334 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:48.373334 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:48.373334 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:48.373334 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:48.374289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:48.374289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:48.374289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:48.374289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:48.374289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:48.374289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:48.374289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 10:42:48.374289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 10:42:48.374289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 10:42:48.374289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 10:42:48.374289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:48.374289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:48.374289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:48.374289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:48.374289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:48.374289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:48.375132 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:48.375132 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:48.375132 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:48.375132 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:48.375132 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:48.375132 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:48.375132 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:48.375132 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:48.375132 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:48.375132 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:48.375132 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 10:42:48.375132 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:48.375132 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 10:42:48.375132 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:48.375132 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 460/921] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Aug 7 10:42:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:48.381225 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473c853-5775-4b2e-8c3d-08649c859b20 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:48.449245 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:48.484913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473c853-5775-4b2e-8c3d-08649c859b20 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:48.521195 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8b836-9c3a-4d41-ab04-a7d7949c4a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:48.521827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8b836-9c3a-4d41-ab04-a7d7949c4a4e None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:48.522105 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8b836-9c3a-4d41-ab04-a7d7949c4a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:48.522376 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8b836-9c3a-4d41-ab04-a7d7949c4a4e None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:48.523004 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8b836-9c3a-4d41-ab04-a7d7949c4a4e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:48.523302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8b836-9c3a-4d41-ab04-a7d7949c4a4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:48.524658 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8b836-9c3a-4d41-ab04-a7d7949c4a4e None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:48.530317 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 462/922] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Aug 7 10:42:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:48.536488 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0531aea-d28c-4565-bb01-8cbedf2ecc98 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:48.649597 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0531aea-d28c-4565-bb01-8cbedf2ecc98 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:48.684543 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610fa996-2cb3-4ef8-bc71-dd97817bbcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:48.685148 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fa996-2cb3-4ef8-bc71-dd97817bbcc6 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:48.685453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fa996-2cb3-4ef8-bc71-dd97817bbcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:48.685727 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fa996-2cb3-4ef8-bc71-dd97817bbcc6 None admin] PATH_INFO: `/v3/services` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:48.686359 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610fa996-2cb3-4ef8-bc71-dd97817bbcc6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:48.686658 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610fa996-2cb3-4ef8-bc71-dd97817bbcc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:48.688025 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610fa996-2cb3-4ef8-bc71-dd97817bbcc6 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:48.694111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 461/923] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Aug 7 10:42:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:48.699508 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8b836-9c3a-4d41-ab04-a7d7949c4a4e None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:48.804715 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8b836-9c3a-4d41-ab04-a7d7949c4a4e None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:48.834248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:48.839478 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e182c8-8f0a-4e2a-ad77-e975c927b14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:48.840092 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e182c8-8f0a-4e2a-ad77-e975c927b14b None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:48.840367 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e182c8-8f0a-4e2a-ad77-e975c927b14b None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:48.840681 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e182c8-8f0a-4e2a-ad77-e975c927b14b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:48.841410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e182c8-8f0a-4e2a-ad77-e975c927b14b None admin] RBAC: Adding query filter params (interface=public, service_id=a1ed0dd03f6a431ab48555adc85a13e1, region_id=RegionOne) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:48.841718 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e182c8-8f0a-4e2a-ad77-e975c927b14b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:48.843069 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e182c8-8f0a-4e2a-ad77-e975c927b14b None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:48.851675 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 463/924] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Aug 7 10:42:48 2022] GET /identity/v3/endpoints?service_id=a1ed0dd03f6a431ab48555adc85a13e1&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:48.856845 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610fa996-2cb3-4ef8-bc71-dd97817bbcc6 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:48.883408 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:48.966127 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610fa996-2cb3-4ef8-bc71-dd97817bbcc6 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:49.003799 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e4fd8-cf8d-4f37-845f-b7fae5fd94ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:49.004409 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e4fd8-cf8d-4f37-845f-b7fae5fd94ea None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:49.004683 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e4fd8-cf8d-4f37-845f-b7fae5fd94ea None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:49.004952 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e4fd8-cf8d-4f37-845f-b7fae5fd94ea None admin] PATH_INFO: `/v3/services` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:49.005596 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e4fd8-cf8d-4f37-845f-b7fae5fd94ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:49.007022 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e4fd8-cf8d-4f37-845f-b7fae5fd94ea None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:49.013468 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 462/925] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Aug 7 10:42:48 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:42:49.256379 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89039cc4-0787-4fbc-b84b-968704591464 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:49.256732 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89039cc4-0787-4fbc-b84b-968704591464 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:49.256943 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89039cc4-0787-4fbc-b84b-968704591464 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:49.258666 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 464/926] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:49.264090 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ac9ee-32d2-4608-82e4-52f6a30a1d31 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:49.264654 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ac9ee-32d2-4608-82e4-52f6a30a1d31 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:49.264654 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ac9ee-32d2-4608-82e4-52f6a30a1d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:49.286202 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-d24ac9ee-32d2-4608-82e4-52f6a30a1d31 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:49.287423 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-d24ac9ee-32d2-4608-82e4-52f6a30a1d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:49.369443 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 463/927] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:42:49.388030 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89039cc4-0787-4fbc-b84b-968704591464 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:49.494710 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9483bbc-1694-4206-9062-e9108117828a None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:49.495052 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9483bbc-1694-4206-9062-e9108117828a None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:49.495249 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9483bbc-1694-4206-9062-e9108117828a None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:49.497102 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 464/928] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:49.497537 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89039cc4-0787-4fbc-b84b-968704591464 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:49.502707 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb2629-5b52-4bb6-a0e8-f520e9b52788 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:49.502985 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb2629-5b52-4bb6-a0e8-f520e9b52788 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:49.503260 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb2629-5b52-4bb6-a0e8-f520e9b52788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:49.521778 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-5ffb2629-5b52-4bb6-a0e8-f520e9b52788 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:49.522889 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-5ffb2629-5b52-4bb6-a0e8-f520e9b52788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:49.537185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cef7c5-819e-4f3a-8c78-519885958af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:49.537681 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:49.538204 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cef7c5-819e-4f3a-8c78-519885958af6 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:49.538481 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cef7c5-819e-4f3a-8c78-519885958af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:49.538903 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cef7c5-819e-4f3a-8c78-519885958af6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:49.553109 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cef7c5-819e-4f3a-8c78-519885958af6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:42:49.558640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-36cef7c5-819e-4f3a-8c78-519885958af6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 10:42:49.558640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:49.558640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:49.558640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:49.558640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:49.558640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:49.558640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:49.558640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:49.558640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:49.558640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:49.558640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:49.558640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:49.558640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:42:49.558640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:42:49.558640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:42:49.558640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:42:49.560261 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:42:49.560261 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:42:49.560261 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:42:49.560261 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:42:49.560261 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:49.560261 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:49.560261 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:49.560261 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:49.560261 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:49.560261 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:49.560261 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:49.560261 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:49.560261 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:49.560261 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:49.560261 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:49.560261 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:49.561546 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:49.561546 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:49.561546 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:49.561546 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:49.561546 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:42:49.561546 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:42:49.561546 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:42:49.561546 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:42:49.561546 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:42:49.561546 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:42:49.561546 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 10:42:49.561546 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:49.561546 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 465/929] 10.222.0.27 () {56 vars in 1120 bytes} [Sun Aug 7 10:42:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:49.567602 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cef7c5-819e-4f3a-8c78-519885958af6 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:49.609589 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 465/930] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 10:42:49.626375 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb2629-5b52-4bb6-a0e8-f520e9b52788 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:49.637685 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:49.695942 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cef7c5-819e-4f3a-8c78-519885958af6 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:49.731307 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb2629-5b52-4bb6-a0e8-f520e9b52788 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:49.739155 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8aec2d-ccee-4ec2-b14d-481fa2e5cf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:49.740204 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8aec2d-ccee-4ec2-b14d-481fa2e5cf8a None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:49.740486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8aec2d-ccee-4ec2-b14d-481fa2e5cf8a None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:49.740757 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8aec2d-ccee-4ec2-b14d-481fa2e5cf8a None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:49.741458 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8aec2d-ccee-4ec2-b14d-481fa2e5cf8a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:49.741760 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8aec2d-ccee-4ec2-b14d-481fa2e5cf8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:49.743497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8aec2d-ccee-4ec2-b14d-481fa2e5cf8a None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:49.754739 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 466/931] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Aug 7 10:42:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:49.759717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8aec2d-ccee-4ec2-b14d-481fa2e5cf8a None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:49.773653 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568cbfc-b2f8-4e2e-bfe6-97648c41fee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:49.774556 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568cbfc-b2f8-4e2e-bfe6-97648c41fee9 None admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:49.775036 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568cbfc-b2f8-4e2e-bfe6-97648c41fee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:49.775529 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568cbfc-b2f8-4e2e-bfe6-97648c41fee9 None admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:49.776384 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568cbfc-b2f8-4e2e-bfe6-97648c41fee9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:49.778037 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568cbfc-b2f8-4e2e-bfe6-97648c41fee9 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:49.780846 dv-cinder-850320-3-smb devstack@keystone.service[80145]: WARNING keystone.server.flask.common [None req-c568cbfc-b2f8-4e2e-bfe6-97648c41fee9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 07 10:42:49.801170 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.sql.core [None req-c568cbfc-b2f8-4e2e-bfe6-97648c41fee9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 07 10:42:49.801170 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 07 10:42:49.801170 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [parameters: {'id': '0ddb4283e5d64ed28fc2a0be448e3bf7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 07 10:42:49.801170 dv-cinder-850320-3-smb devstack@keystone.service[80145]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80145) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 07 10:42:49.819833 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-c568cbfc-b2f8-4e2e-bfe6-97648c41fee9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0ddb4283e5d64ed28fc2a0be448e3bf7.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0ddb4283e5d64ed28fc2a0be448e3bf7. Aug 07 10:42:49.819833 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:49.819833 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 10:42:49.819833 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 10:42:49.819833 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 10:42:49.819833 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 10:42:49.819833 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 10:42:49.819833 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 10:42:49.819833 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 10:42:49.819833 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application conn.query(q) Aug 07 10:42:49.819833 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 10:42:49.819833 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 10:42:49.819833 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 10:42:49.820704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application result.read() Aug 07 10:42:49.820704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 10:42:49.820704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 10:42:49.820704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 10:42:49.820704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 10:42:49.820704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 10:42:49.820704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 10:42:49.820704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 10:42:49.820704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 10:42:49.820704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 07 10:42:49.820704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:49.820704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 07 10:42:49.820704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:49.820704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:49.820704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 07 10:42:49.820704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 07 10:42:49.820704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 07 10:42:49.820704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 07 10:42:49.821726 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 10:42:49.821726 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application next(self.gen) Aug 07 10:42:49.821726 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 07 10:42:49.821726 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application yield resource Aug 07 10:42:49.821726 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 10:42:49.821726 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application next(self.gen) Aug 07 10:42:49.821726 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 07 10:42:49.821726 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application self.session.rollback() Aug 07 10:42:49.821726 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 10:42:49.821726 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application self.force_reraise() Aug 07 10:42:49.821726 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 10:42:49.821726 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise self.value Aug 07 10:42:49.821726 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 07 10:42:49.821726 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 07 10:42:49.821726 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 07 10:42:49.821726 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application session.commit() Aug 07 10:42:49.821726 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 07 10:42:49.822668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 07 10:42:49.822668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 07 10:42:49.822668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application self._prepare_impl() Aug 07 10:42:49.822668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 07 10:42:49.822668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application self.session.flush() Aug 07 10:42:49.822668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 07 10:42:49.822668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application self._flush(objects) Aug 07 10:42:49.822668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 07 10:42:49.822668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 07 10:42:49.822668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 07 10:42:49.822668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application compat.raise_( Aug 07 10:42:49.822668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 10:42:49.822668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception Aug 07 10:42:49.822668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 07 10:42:49.822668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application flush_context.execute() Aug 07 10:42:49.822668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 07 10:42:49.822668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rec.execute(self) Aug 07 10:42:49.823601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 07 10:42:49.823601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 07 10:42:49.823601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 07 10:42:49.823601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 07 10:42:49.823601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 07 10:42:49.823601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 07 10:42:49.823601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 07 10:42:49.823601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 07 10:42:49.823601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 07 10:42:49.823601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 07 10:42:49.823601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 07 10:42:49.823601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 07 10:42:49.823601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 07 10:42:49.823601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 07 10:42:49.823601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 07 10:42:49.824421 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 07 10:42:49.824421 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 10:42:49.824421 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception Aug 07 10:42:49.824421 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 10:42:49.824421 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 10:42:49.824421 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 10:42:49.824421 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 10:42:49.824421 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 10:42:49.824421 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 10:42:49.824421 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 10:42:49.824421 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application conn.query(q) Aug 07 10:42:49.824421 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 10:42:49.824421 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 10:42:49.824421 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 10:42:49.824421 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application result.read() Aug 07 10:42:49.824421 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 10:42:49.824421 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 10:42:49.825304 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 10:42:49.825304 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 10:42:49.825304 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 10:42:49.825304 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 10:42:49.825304 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 10:42:49.825304 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 10:42:49.825304 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 07 10:42:49.825304 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 07 10:42:49.825304 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [parameters: {'id': '0ddb4283e5d64ed28fc2a0be448e3bf7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 07 10:42:49.825304 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 07 10:42:49.825304 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:49.825304 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 10:42:49.825304 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:49.825304 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:49.825304 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 07 10:42:49.828468 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 07 10:42:49.828468 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 07 10:42:49.828468 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 07 10:42:49.828468 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 07 10:42:49.828468 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:49.828468 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 10:42:49.828468 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:49.828468 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:49.828468 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:49.828468 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:49.828468 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:49.828468 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:49.828468 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:49.828468 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:49.828468 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:49.828468 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:49.828468 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:49.831336 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:49.831336 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 07 10:42:49.831336 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 07 10:42:49.831336 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:49.831336 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:49.831336 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 07 10:42:49.831336 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 07 10:42:49.831336 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0ddb4283e5d64ed28fc2a0be448e3bf7. Aug 07 10:42:49.831336 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:49.839168 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 466/932] 10.222.0.27 () {60 vars in 1140 bytes} [Sun Aug 7 10:42:49 2022] POST /identity/v3/projects => generated 262 bytes in 208 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:49.840574 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568cbfc-b2f8-4e2e-bfe6-97648c41fee9 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:49.845762 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:49.882779 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8aec2d-ccee-4ec2-b14d-481fa2e5cf8a None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:49.904803 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:49.925814 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5910e-b534-4698-9759-ec845fe700d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:49.926612 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5910e-b534-4698-9759-ec845fe700d3 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:49.926995 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5910e-b534-4698-9759-ec845fe700d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:49.927370 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5910e-b534-4698-9759-ec845fe700d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:49.939320 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5910e-b534-4698-9759-ec845fe700d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:49.940935 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5910e-b534-4698-9759-ec845fe700d3 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:49.955940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-97c5910e-b534-4698-9759-ec845fe700d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:49.955940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:49.955940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:49.955940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:49.955940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:49.955940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:49.955940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:49.955940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:49.955940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:49.955940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:49.955940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:49.955940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:49.955940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:49.955940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:49.955940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:49.955940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:49.957145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:49.957145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:49.957145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:49.957145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:49.957145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:49.957145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:49.957145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:49.957145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:49.957145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:49.957145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:49.957145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:49.957145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:49.957145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:49.957145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:49.957145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:49.957145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:49.957145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:49.958268 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:49.958268 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:49.958268 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:49.959647 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 467/933] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:42:49.966145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5910e-b534-4698-9759-ec845fe700d3 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:49.989733 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568cbfc-b2f8-4e2e-bfe6-97648c41fee9 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:50.027123 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb135e3f-26b5-49c5-ad70-88f02337e90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:50.027678 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb135e3f-26b5-49c5-ad70-88f02337e90c None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:50.027954 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb135e3f-26b5-49c5-ad70-88f02337e90c None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:50.028219 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb135e3f-26b5-49c5-ad70-88f02337e90c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:50.035662 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb135e3f-26b5-49c5-ad70-88f02337e90c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:50.037296 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb135e3f-26b5-49c5-ad70-88f02337e90c None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:50.049036 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-fb135e3f-26b5-49c5-ad70-88f02337e90c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:50.049036 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:50.049036 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:50.049036 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:50.049036 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:50.049036 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:50.049036 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:50.049036 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:50.049036 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:50.049036 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:50.049036 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:50.049036 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:50.049036 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:42:50.049036 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:42:50.049036 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:42:50.055188 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:42:50.055188 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:50.055188 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:50.055188 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:50.055188 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:50.055188 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:50.055188 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:50.055188 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:50.055188 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:50.055188 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:50.055188 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:50.055188 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:50.055188 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:50.055188 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:50.055188 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:50.055188 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:50.055188 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:50.056308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:42:50.056308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:42:50.056308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:42:50.056308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:42:50.056308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:42:50.056308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:42:50.056308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:50.056308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:50.056308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 467/934] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:50.056308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbc800-5b7f-4d7d-96bc-aaaf79184611 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:50.056308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbc800-5b7f-4d7d-96bc-aaaf79184611 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:50.056916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fbc800-5b7f-4d7d-96bc-aaaf79184611 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:50.056916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 468/935] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:50.056916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbc800-5b7f-4d7d-96bc-aaaf79184611 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:50.090696 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5910e-b534-4698-9759-ec845fe700d3 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:50.128867 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e15424-35db-4732-807a-4b4381b66c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:50.129064 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:50.129500 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e15424-35db-4732-807a-4b4381b66c60 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:50.129781 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e15424-35db-4732-807a-4b4381b66c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:50.130107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e15424-35db-4732-807a-4b4381b66c60 None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:50.130694 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e15424-35db-4732-807a-4b4381b66c60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:50.131029 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e15424-35db-4732-807a-4b4381b66c60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:50.132335 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e15424-35db-4732-807a-4b4381b66c60 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:50.149567 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 468/936] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:50.149567 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e964250-242d-4085-9d50-1ab495f5e910 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:50.149567 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e964250-242d-4085-9d50-1ab495f5e910 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:50.149567 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e964250-242d-4085-9d50-1ab495f5e910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:50.165389 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-5e964250-242d-4085-9d50-1ab495f5e910 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:50.166717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-5e964250-242d-4085-9d50-1ab495f5e910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:50.179495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fbc800-5b7f-4d7d-96bc-aaaf79184611 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:50.196016 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:50.215803 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26e16d-947d-499b-9cb1-409f2ba5ebc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:50.216544 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26e16d-947d-499b-9cb1-409f2ba5ebc6 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:50.216909 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26e16d-947d-499b-9cb1-409f2ba5ebc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:50.217290 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26e16d-947d-499b-9cb1-409f2ba5ebc6 None admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:50.218075 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26e16d-947d-499b-9cb1-409f2ba5ebc6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:50.218471 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26e16d-947d-499b-9cb1-409f2ba5ebc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:50.219976 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26e16d-947d-499b-9cb1-409f2ba5ebc6 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:50.245579 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 469/937] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 7 10:42:50 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:50.245579 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26e16d-947d-499b-9cb1-409f2ba5ebc6 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:50.254138 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 469/938] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:42:50.277099 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e964250-242d-4085-9d50-1ab495f5e910 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:50.391192 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26e16d-947d-499b-9cb1-409f2ba5ebc6 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:50.408122 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e964250-242d-4085-9d50-1ab495f5e910 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:50.426494 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:50.438772 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c40ad0-02a0-407f-8499-efe4e1865278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:50.439632 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c40ad0-02a0-407f-8499-efe4e1865278 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:50.440050 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c40ad0-02a0-407f-8499-efe4e1865278 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:50.440456 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c40ad0-02a0-407f-8499-efe4e1865278 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:50.447980 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c40ad0-02a0-407f-8499-efe4e1865278 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:50.449608 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c40ad0-02a0-407f-8499-efe4e1865278 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:50.452391 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c408c9-6bf6-43fb-999a-86c1461065b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:50.453720 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c408c9-6bf6-43fb-999a-86c1461065b5 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:50.454009 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c408c9-6bf6-43fb-999a-86c1461065b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:50.454285 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c408c9-6bf6-43fb-999a-86c1461065b5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:50.454875 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c408c9-6bf6-43fb-999a-86c1461065b5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:50.456220 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c408c9-6bf6-43fb-999a-86c1461065b5 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:50.464663 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-80c40ad0-02a0-407f-8499-efe4e1865278 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 10:42:50.464663 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:50.464663 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:50.464663 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:50.464663 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:50.464663 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:50.464663 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:50.464663 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:50.464663 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:50.464663 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:50.464663 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:50.464663 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:50.464663 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:42:50.464663 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:42:50.464663 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:42:50.464663 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:42:50.465631 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:50.465631 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:50.465631 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:42:50.465631 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:50.465631 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:42:50.465631 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:50.465631 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:50.465631 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:50.465631 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:50.465631 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:50.465631 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:50.465631 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:50.465631 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:50.465631 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:50.465631 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:50.465631 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:50.465631 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:50.465631 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:50.466569 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:50.466569 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:50.466569 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:42:50.466569 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:42:50.466569 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:42:50.466569 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:42:50.466569 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:42:50.466569 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:42:50.466569 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 10:42:50.466569 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:50.467098 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-f8c408c9-6bf6-43fb-999a-86c1461065b5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 10:42:50.467098 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:50.467098 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 10:42:50.467098 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 10:42:50.467098 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 10:42:50.467098 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 10:42:50.467098 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 10:42:50.467098 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:50.467098 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 10:42:50.467098 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:50.467098 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 10:42:50.467098 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:50.467098 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:50.467098 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:50.467098 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:50.467098 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:50.467959 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:50.467959 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:50.467959 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:50.467959 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:50.467959 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:50.467959 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:50.467959 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:50.467959 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 10:42:50.467959 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 10:42:50.467959 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 10:42:50.467959 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 10:42:50.467959 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:50.467959 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:50.467959 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:50.467959 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:50.467959 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:50.467959 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:50.468853 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:50.468853 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:50.468853 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:50.468853 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:50.468853 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:50.468853 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:50.468853 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:50.468853 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:50.468853 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:50.468853 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:50.468853 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 10:42:50.468853 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:50.468853 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 10:42:50.468853 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:50.468853 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 470/939] 10.222.0.27 () {56 vars in 1132 bytes} [Sun Aug 7 10:42:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:50.475648 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 470/940] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Aug 7 10:42:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:50.475788 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c408c9-6bf6-43fb-999a-86c1461065b5 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:50.477116 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c40ad0-02a0-407f-8499-efe4e1865278 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:50.511315 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:50.595796 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c408c9-6bf6-43fb-999a-86c1461065b5 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:50.607892 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c40ad0-02a0-407f-8499-efe4e1865278 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:50.636683 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41572334-6a49-41c0-b3fa-92ee3a832704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:50.638108 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41572334-6a49-41c0-b3fa-92ee3a832704 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:50.638680 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41572334-6a49-41c0-b3fa-92ee3a832704 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:50.639122 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41572334-6a49-41c0-b3fa-92ee3a832704 None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:50.640176 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41572334-6a49-41c0-b3fa-92ee3a832704 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:50.640990 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41572334-6a49-41c0-b3fa-92ee3a832704 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:50.643580 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41572334-6a49-41c0-b3fa-92ee3a832704 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:50.648943 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ee000-33f3-4760-bde3-3e8d86adefb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:50.649649 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ee000-33f3-4760-bde3-3e8d86adefb3 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:50.650029 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ee000-33f3-4760-bde3-3e8d86adefb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:50.650401 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ee000-33f3-4760-bde3-3e8d86adefb3 None admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:50.650584 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 471/941] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Aug 7 10:42:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:50.655771 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ee000-33f3-4760-bde3-3e8d86adefb3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:50.656087 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ee000-33f3-4760-bde3-3e8d86adefb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:50.656453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41572334-6a49-41c0-b3fa-92ee3a832704 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:50.658447 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ee000-33f3-4760-bde3-3e8d86adefb3 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:50.689558 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 471/942] 10.222.0.27 () {56 vars in 1149 bytes} [Sun Aug 7 10:42:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:50.691572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ee000-33f3-4760-bde3-3e8d86adefb3 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:50.749267 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:50.763238 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:50.781531 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41572334-6a49-41c0-b3fa-92ee3a832704 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:50.812077 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ee000-33f3-4760-bde3-3e8d86adefb3 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:50.825480 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76e0d9-77f7-4912-8928-7a8cf4289783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:50.826845 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76e0d9-77f7-4912-8928-7a8cf4289783 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:50.827517 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76e0d9-77f7-4912-8928-7a8cf4289783 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:50.827928 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76e0d9-77f7-4912-8928-7a8cf4289783 None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:50.828732 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76e0d9-77f7-4912-8928-7a8cf4289783 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:50.829500 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76e0d9-77f7-4912-8928-7a8cf4289783 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:50.831754 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76e0d9-77f7-4912-8928-7a8cf4289783 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:50.838490 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 472/943] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Aug 7 10:42:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:50.843710 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76e0d9-77f7-4912-8928-7a8cf4289783 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:50.857252 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390f408-8e7d-4fd7-8686-50419d6ba58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:50.858120 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390f408-8e7d-4fd7-8686-50419d6ba58e None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:50.858392 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390f408-8e7d-4fd7-8686-50419d6ba58e None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:50.858725 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390f408-8e7d-4fd7-8686-50419d6ba58e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:50.870054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6390f408-8e7d-4fd7-8686-50419d6ba58e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:50.871844 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6390f408-8e7d-4fd7-8686-50419d6ba58e None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:50.888090 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-6390f408-8e7d-4fd7-8686-50419d6ba58e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:50.888090 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:50.888090 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:50.888090 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:50.888090 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:50.888090 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:50.888090 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:50.888090 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:50.888090 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:50.888090 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:50.888090 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:50.888090 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:50.888090 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:50.888090 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:50.888090 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:50.888090 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:50.889053 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:50.889053 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:50.889053 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:50.889053 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:50.889053 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:50.889053 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:50.889053 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:50.889053 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:50.889053 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:50.889053 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:50.889053 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:50.889053 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:50.889053 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:50.889053 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:50.889053 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:50.889053 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:50.889053 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:50.889972 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:50.889972 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:50.889972 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:50.893883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 472/944] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:50.895850 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390f408-8e7d-4fd7-8686-50419d6ba58e None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:50.974627 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76e0d9-77f7-4912-8928-7a8cf4289783 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:51.013723 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:51.016820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f382b-8a2f-476c-8eba-ebf28e3a6e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:51.017977 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f382b-8a2f-476c-8eba-ebf28e3a6e72 None admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:51.018422 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f382b-8a2f-476c-8eba-ebf28e3a6e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:51.018862 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f382b-8a2f-476c-8eba-ebf28e3a6e72 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:51.019928 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f382b-8a2f-476c-8eba-ebf28e3a6e72 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:51.022119 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f382b-8a2f-476c-8eba-ebf28e3a6e72 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:51.023536 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390f408-8e7d-4fd7-8686-50419d6ba58e None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:51.048927 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 473/945] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:42:50 2022] POST /identity/v3/endpoints => generated 347 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 10:42:51.081654 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee0891-594c-465a-980b-50e0bf9024eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:51.082683 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee0891-594c-465a-980b-50e0bf9024eb None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:51.083155 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee0891-594c-465a-980b-50e0bf9024eb None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:51.083623 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee0891-594c-465a-980b-50e0bf9024eb None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:51.084609 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee0891-594c-465a-980b-50e0bf9024eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:51.085117 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee0891-594c-465a-980b-50e0bf9024eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:51.086987 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee0891-594c-465a-980b-50e0bf9024eb None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:51.088988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02866764-7fb4-42d9-9c99-28d3b46ce0bf None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:51.089425 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02866764-7fb4-42d9-9c99-28d3b46ce0bf None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:51.089628 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02866764-7fb4-42d9-9c99-28d3b46ce0bf None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:51.092498 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 474/946] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:51.097094 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6507e-2396-4e6c-a839-0211b23c1788 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:51.097474 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6507e-2396-4e6c-a839-0211b23c1788 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:51.097641 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6507e-2396-4e6c-a839-0211b23c1788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:51.104194 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 473/947] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:51.109451 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee0891-594c-465a-980b-50e0bf9024eb None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:51.118864 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-cda6507e-2396-4e6c-a839-0211b23c1788 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:51.120784 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-cda6507e-2396-4e6c-a839-0211b23c1788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:51.122928 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:51.203818 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 475/948] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 10:42:51.222216 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6507e-2396-4e6c-a839-0211b23c1788 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:51.226988 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee0891-594c-465a-980b-50e0bf9024eb None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:51.268305 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85221d55-27d4-4dc6-b541-7ec77ec3244c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:51.269596 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85221d55-27d4-4dc6-b541-7ec77ec3244c None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:51.269973 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85221d55-27d4-4dc6-b541-7ec77ec3244c None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:51.271142 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85221d55-27d4-4dc6-b541-7ec77ec3244c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:51.280975 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85221d55-27d4-4dc6-b541-7ec77ec3244c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:51.283418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85221d55-27d4-4dc6-b541-7ec77ec3244c None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:51.300730 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-85221d55-27d4-4dc6-b541-7ec77ec3244c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:51.300730 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:51.300730 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:51.300730 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:51.300730 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:51.300730 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:51.300730 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:51.300730 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:51.300730 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:51.300730 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:51.300730 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:51.300730 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:51.300730 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:42:51.300730 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:42:51.300730 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:42:51.302430 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:42:51.302430 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:51.302430 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:51.302430 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:51.302430 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:51.302430 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:51.302430 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:51.302430 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:51.302430 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:51.302430 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:51.302430 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:51.302430 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:51.302430 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:51.302430 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:51.302430 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:51.302430 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:51.302430 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:51.303568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:42:51.303568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:42:51.303568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:42:51.303568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:42:51.303568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:42:51.303568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:42:51.303568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:51.303568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:51.303568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 474/949] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:42:51.308070 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85221d55-27d4-4dc6-b541-7ec77ec3244c None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:51.321772 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:51.347641 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6507e-2396-4e6c-a839-0211b23c1788 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:51.384176 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7b28a-cb23-4683-a472-8f0e9b1bb087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:51.384818 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7b28a-cb23-4683-a472-8f0e9b1bb087 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:51.385104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7b28a-cb23-4683-a472-8f0e9b1bb087 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:51.385391 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7b28a-cb23-4683-a472-8f0e9b1bb087 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:51.385997 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7b28a-cb23-4683-a472-8f0e9b1bb087 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:51.387448 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7b28a-cb23-4683-a472-8f0e9b1bb087 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:51.397127 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-16f7b28a-cb23-4683-a472-8f0e9b1bb087 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 10:42:51.397127 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:51.397127 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 10:42:51.397127 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 10:42:51.397127 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 10:42:51.397127 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 10:42:51.397127 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 10:42:51.397127 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:51.397127 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 10:42:51.397127 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:51.397127 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 10:42:51.397127 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:51.397127 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:51.397127 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:51.397127 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:51.397127 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:51.397127 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:51.398183 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:51.398183 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:51.398183 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:51.398183 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:51.398183 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:51.398183 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:51.398183 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 10:42:51.398183 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 10:42:51.398183 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 10:42:51.398183 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 10:42:51.398183 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:51.398183 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:51.398183 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:51.398183 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:51.398183 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:51.398183 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:51.399025 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:51.399025 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:51.399025 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:51.399025 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:51.399025 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:51.399025 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:51.399025 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:51.399025 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:51.399025 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:51.399025 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:51.399025 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 10:42:51.399025 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:51.399025 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 10:42:51.399025 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:51.399025 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 476/950] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Aug 7 10:42:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:42:51.404254 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7b28a-cb23-4683-a472-8f0e9b1bb087 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:51.407780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:51.424930 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85221d55-27d4-4dc6-b541-7ec77ec3244c None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:51.461449 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab76301-5ec9-4a61-9227-658931daa6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:51.462443 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab76301-5ec9-4a61-9227-658931daa6c3 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:51.462913 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab76301-5ec9-4a61-9227-658931daa6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:51.463381 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab76301-5ec9-4a61-9227-658931daa6c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:51.464444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab76301-5ec9-4a61-9227-658931daa6c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:51.464951 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab76301-5ec9-4a61-9227-658931daa6c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:51.466678 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab76301-5ec9-4a61-9227-658931daa6c3 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:51.481035 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 475/951] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:42:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:51.490414 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab76301-5ec9-4a61-9227-658931daa6c3 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:51.518160 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7b28a-cb23-4683-a472-8f0e9b1bb087 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:51.556218 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4ac2b-ab9f-49ca-bbfa-e570f5221906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:51.557154 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4ac2b-ab9f-49ca-bbfa-e570f5221906 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:51.557641 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4ac2b-ab9f-49ca-bbfa-e570f5221906 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:51.558206 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4ac2b-ab9f-49ca-bbfa-e570f5221906 None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:51.559145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4ac2b-ab9f-49ca-bbfa-e570f5221906 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:51.559639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4ac2b-ab9f-49ca-bbfa-e570f5221906 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:51.561240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4ac2b-ab9f-49ca-bbfa-e570f5221906 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:51.572010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 477/952] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Aug 7 10:42:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:51.573596 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:51.574239 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4ac2b-ab9f-49ca-bbfa-e570f5221906 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:51.607371 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab76301-5ec9-4a61-9227-658931daa6c3 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:51.642749 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44481e4e-0f71-4b1d-a8c4-91348ef587f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:51.643322 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44481e4e-0f71-4b1d-a8c4-91348ef587f3 None admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:51.643597 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44481e4e-0f71-4b1d-a8c4-91348ef587f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:51.643867 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44481e4e-0f71-4b1d-a8c4-91348ef587f3 None admin] PATH_INFO: `/v3/projects/62eed8550ae3403f8a75894dbd19cf4a/users/e7eebb4bd7e04ff8bc4304a40cf6ba35/roles/051acd6762694d9985183bf0b8860800` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:51.646159 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44481e4e-0f71-4b1d-a8c4-91348ef587f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=62eed8550ae3403f8a75894dbd19cf4a, user_id=e7eebb4bd7e04ff8bc4304a40cf6ba35, role_id=051acd6762694d9985183bf0b8860800)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:51.647571 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44481e4e-0f71-4b1d-a8c4-91348ef587f3 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:51.652228 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:51.665739 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 476/953] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 7 10:42:51 2022] PUT /identity/v3/projects/62eed8550ae3403f8a75894dbd19cf4a/users/e7eebb4bd7e04ff8bc4304a40cf6ba35/roles/051acd6762694d9985183bf0b8860800 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:42:51.697605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4ac2b-ab9f-49ca-bbfa-e570f5221906 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:51.742767 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb250e2-543d-4be3-8df9-2304be901753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:51.743416 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb250e2-543d-4be3-8df9-2304be901753 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:51.743690 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb250e2-543d-4be3-8df9-2304be901753 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:51.744004 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb250e2-543d-4be3-8df9-2304be901753 None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:51.744693 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb250e2-543d-4be3-8df9-2304be901753 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:51.744993 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb250e2-543d-4be3-8df9-2304be901753 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:51.746717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb250e2-543d-4be3-8df9-2304be901753 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:51.752837 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 478/954] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Aug 7 10:42:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:51.758864 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44481e4e-0f71-4b1d-a8c4-91348ef587f3 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:51.871825 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44481e4e-0f71-4b1d-a8c4-91348ef587f3 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:51.901363 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:51.911383 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc121e-a537-456e-b4ed-52c533ac9706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:51.911999 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc121e-a537-456e-b4ed-52c533ac9706 None admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:51.912278 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc121e-a537-456e-b4ed-52c533ac9706 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:51.912556 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc121e-a537-456e-b4ed-52c533ac9706 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:51.913223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc121e-a537-456e-b4ed-52c533ac9706 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:51.914617 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc121e-a537-456e-b4ed-52c533ac9706 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:51.941483 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 477/955] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:42:51 2022] POST /identity/v3/endpoints => generated 349 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:42:52.462204 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af65aa8-e78a-4e45-b96b-414cac9b66f9 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:52.462583 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af65aa8-e78a-4e45-b96b-414cac9b66f9 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:52.462763 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af65aa8-e78a-4e45-b96b-414cac9b66f9 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:52.464220 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 479/956] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:52.470048 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f4e4a-c802-408e-a9bb-394c55e819ee None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:52.470918 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f4e4a-c802-408e-a9bb-394c55e819ee None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:52.471394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f4e4a-c802-408e-a9bb-394c55e819ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:52.490520 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-403f4e4a-c802-408e-a9bb-394c55e819ee None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:52.492348 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-403f4e4a-c802-408e-a9bb-394c55e819ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:52.564998 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 478/957] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:42:52.590040 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af65aa8-e78a-4e45-b96b-414cac9b66f9 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:52.697332 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af65aa8-e78a-4e45-b96b-414cac9b66f9 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:52.727650 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:52.733833 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae76083-5281-4150-82f8-c15ac8009bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:52.734998 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae76083-5281-4150-82f8-c15ac8009bd8 None admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:52.735534 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae76083-5281-4150-82f8-c15ac8009bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:52.736068 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae76083-5281-4150-82f8-c15ac8009bd8 None admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:52.737037 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae76083-5281-4150-82f8-c15ac8009bd8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:52.738874 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae76083-5281-4150-82f8-c15ac8009bd8 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:52.741460 dv-cinder-850320-3-smb devstack@keystone.service[80144]: WARNING keystone.server.flask.common [None req-cae76083-5281-4150-82f8-c15ac8009bd8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 07 10:42:52.754554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.sql.core [None req-cae76083-5281-4150-82f8-c15ac8009bd8 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 07 10:42:52.754554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 07 10:42:52.754554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [parameters: {'user_id': '6f9e6315146c4aca8184e1579627338f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 07 10:42:52.754554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80144) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 07 10:42:52.762071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-cae76083-5281-4150-82f8-c15ac8009bd8 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 07 10:42:52.762071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:52.762071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 10:42:52.762071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 10:42:52.762071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 10:42:52.762071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 10:42:52.762071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 10:42:52.762071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 10:42:52.762071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 10:42:52.762071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application conn.query(q) Aug 07 10:42:52.762071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 10:42:52.762071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 10:42:52.762071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 10:42:52.762071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application result.read() Aug 07 10:42:52.762071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 10:42:52.762966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 10:42:52.762966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 10:42:52.762966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 10:42:52.762966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 10:42:52.762966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 10:42:52.762966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 10:42:52.762966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 10:42:52.762966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 07 10:42:52.762966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:52.762966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 07 10:42:52.762966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:52.762966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:52.762966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 07 10:42:52.762966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 07 10:42:52.762966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 07 10:42:52.762966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 07 10:42:52.762966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 10:42:52.762966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application next(self.gen) Aug 07 10:42:52.763966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 07 10:42:52.763966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application yield resource Aug 07 10:42:52.763966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 10:42:52.763966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application next(self.gen) Aug 07 10:42:52.763966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 07 10:42:52.763966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self.session.rollback() Aug 07 10:42:52.763966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 10:42:52.763966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self.force_reraise() Aug 07 10:42:52.763966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 10:42:52.763966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise self.value Aug 07 10:42:52.763966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 07 10:42:52.763966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 07 10:42:52.763966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 07 10:42:52.763966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application session.commit() Aug 07 10:42:52.763966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 07 10:42:52.763966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 07 10:42:52.763966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 07 10:42:52.764880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self._prepare_impl() Aug 07 10:42:52.764880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 07 10:42:52.764880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self.session.flush() Aug 07 10:42:52.764880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 07 10:42:52.764880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self._flush(objects) Aug 07 10:42:52.764880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 07 10:42:52.764880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 07 10:42:52.764880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 07 10:42:52.764880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application compat.raise_( Aug 07 10:42:52.764880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 10:42:52.764880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception Aug 07 10:42:52.764880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 07 10:42:52.764880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application flush_context.execute() Aug 07 10:42:52.764880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 07 10:42:52.764880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rec.execute(self) Aug 07 10:42:52.764880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 07 10:42:52.764880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 07 10:42:52.767717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 07 10:42:52.767717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 07 10:42:52.767717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 07 10:42:52.767717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 07 10:42:52.767717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 07 10:42:52.767717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 07 10:42:52.767717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 07 10:42:52.767717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 07 10:42:52.767717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 07 10:42:52.767717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 07 10:42:52.767717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 07 10:42:52.767717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 07 10:42:52.767717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 07 10:42:52.767717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 07 10:42:52.767717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 10:42:52.767717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception Aug 07 10:42:52.769736 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 10:42:52.769736 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 10:42:52.769736 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 10:42:52.769736 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 10:42:52.769736 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 10:42:52.769736 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 10:42:52.769736 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 10:42:52.769736 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application conn.query(q) Aug 07 10:42:52.769736 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 10:42:52.769736 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 10:42:52.769736 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 10:42:52.769736 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application result.read() Aug 07 10:42:52.769736 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 10:42:52.769736 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 10:42:52.769736 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 10:42:52.769736 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 10:42:52.771723 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 10:42:52.771723 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 10:42:52.771723 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 10:42:52.771723 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 10:42:52.771723 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 07 10:42:52.771723 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 07 10:42:52.771723 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [parameters: {'user_id': '6f9e6315146c4aca8184e1579627338f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 07 10:42:52.771723 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 07 10:42:52.771723 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:52.771723 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 10:42:52.771723 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:52.771723 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:52.771723 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:52.771723 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:52.771723 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:52.778042 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:52.778042 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:52.778042 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:52.778042 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:52.778042 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:52.778042 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:52.778042 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:52.778042 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 07 10:42:52.778042 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 07 10:42:52.778042 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:52.778042 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:52.778042 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:42:52.778042 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:52.778042 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:42:52.778042 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:52.778042 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 07 10:42:52.778042 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 07 10:42:52.780334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 07 10:42:52.780334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 07 10:42:52.780334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 07 10:42:52.780334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 07 10:42:52.780334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 07 10:42:52.780334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:52.780334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 480/958] 10.222.0.27 () {60 vars in 1131 bytes} [Sun Aug 7 10:42:52 2022] POST /identity/v3/users => generated 160 bytes in 174 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:52.783903 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f4e4a-c802-408e-a9bb-394c55e819ee None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:52.889948 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f4e4a-c802-408e-a9bb-394c55e819ee None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:52.903293 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:52.928768 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6698bea-425e-45b2-b8da-a892434cfa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:52.929441 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6698bea-425e-45b2-b8da-a892434cfa07 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:52.929722 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6698bea-425e-45b2-b8da-a892434cfa07 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:52.929992 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6698bea-425e-45b2-b8da-a892434cfa07 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:52.937712 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6698bea-425e-45b2-b8da-a892434cfa07 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:52.939773 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6698bea-425e-45b2-b8da-a892434cfa07 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:52.951385 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-d6698bea-425e-45b2-b8da-a892434cfa07 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 10:42:52.951385 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:52.951385 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:52.951385 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:52.951385 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:52.951385 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:52.951385 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:52.951385 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:52.951385 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:52.951385 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:52.951385 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:52.951385 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:52.951385 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:42:52.951385 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:42:52.951385 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:42:52.951385 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:42:52.952311 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:52.952311 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:52.952311 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:42:52.952311 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:52.952311 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:42:52.952311 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:52.952311 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:52.952311 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:52.952311 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:52.952311 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:52.952311 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:52.952311 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:52.952311 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:52.952311 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:52.952311 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:52.952311 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:52.952311 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:52.952311 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:52.953327 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:52.953327 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:52.953327 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:42:52.953327 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:42:52.953327 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:42:52.953327 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:42:52.953327 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:42:52.953327 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:42:52.953327 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 10:42:52.953327 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:52.953327 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 479/959] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:42:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:52.959369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae76083-5281-4150-82f8-c15ac8009bd8 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:53.067727 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae76083-5281-4150-82f8-c15ac8009bd8 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:53.102151 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0344c4-acff-4e92-ba01-7ca6d966ba4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:53.102762 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0344c4-acff-4e92-ba01-7ca6d966ba4f None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:53.103048 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0344c4-acff-4e92-ba01-7ca6d966ba4f None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:53.103326 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0344c4-acff-4e92-ba01-7ca6d966ba4f None admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:53.104038 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0344c4-acff-4e92-ba01-7ca6d966ba4f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:53.104332 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0344c4-acff-4e92-ba01-7ca6d966ba4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:53.105992 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0344c4-acff-4e92-ba01-7ca6d966ba4f None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:53.149482 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 481/960] 10.222.0.27 () {56 vars in 1101 bytes} [Sun Aug 7 10:42:52 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:53.178986 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb4a65-7a1a-4c8d-b097-51f64b350c5f None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:53.179306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb4a65-7a1a-4c8d-b097-51f64b350c5f None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:53.179528 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb4a65-7a1a-4c8d-b097-51f64b350c5f None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:53.180896 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 480/961] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:53.186745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ba0a2-333a-4247-ab39-ac0ee65ca565 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:53.187077 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ba0a2-333a-4247-ab39-ac0ee65ca565 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:53.187297 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ba0a2-333a-4247-ab39-ac0ee65ca565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:53.207005 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-979ba0a2-333a-4247-ab39-ac0ee65ca565 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:53.208512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-979ba0a2-333a-4247-ab39-ac0ee65ca565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:53.267091 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:53.292193 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 482/962] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:42:53.314325 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb4a65-7a1a-4c8d-b097-51f64b350c5f None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:53.426601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb4a65-7a1a-4c8d-b097-51f64b350c5f None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:53.461812 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7abe4-10ff-4a82-b181-c7ef81749053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:53.462363 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7abe4-10ff-4a82-b181-c7ef81749053 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:53.462637 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7abe4-10ff-4a82-b181-c7ef81749053 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:53.462932 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7abe4-10ff-4a82-b181-c7ef81749053 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:53.463518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7abe4-10ff-4a82-b181-c7ef81749053 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:53.464874 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7abe4-10ff-4a82-b181-c7ef81749053 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:53.473701 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-cfb7abe4-10ff-4a82-b181-c7ef81749053 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 10:42:53.473701 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:53.473701 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 10:42:53.473701 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 10:42:53.473701 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 10:42:53.473701 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 10:42:53.473701 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 10:42:53.473701 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:53.473701 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 10:42:53.473701 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:53.473701 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 10:42:53.473701 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:53.473701 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:53.473701 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:53.473701 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:53.473701 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:53.473701 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:53.475713 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:53.475713 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:53.475713 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:53.475713 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:53.475713 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:53.475713 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:53.475713 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 10:42:53.475713 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 10:42:53.475713 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 10:42:53.475713 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 10:42:53.475713 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:53.475713 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:53.475713 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:53.475713 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:53.475713 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:53.475713 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:53.476798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:53.476798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:53.476798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:53.476798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:53.476798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:53.476798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:53.476798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:53.476798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:53.476798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:53.476798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:53.476798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 10:42:53.476798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:53.476798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 10:42:53.476798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:53.476798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 481/963] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:53.480934 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ba0a2-333a-4247-ab39-ac0ee65ca565 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:53.581860 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ba0a2-333a-4247-ab39-ac0ee65ca565 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:53.615666 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc2bf1-4d3b-4809-87f3-6f8a653dc17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:53.616274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc2bf1-4d3b-4809-87f3-6f8a653dc17c None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:53.616530 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc2bf1-4d3b-4809-87f3-6f8a653dc17c None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:53.616797 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc2bf1-4d3b-4809-87f3-6f8a653dc17c None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:53.617459 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc2bf1-4d3b-4809-87f3-6f8a653dc17c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:53.617764 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc2bf1-4d3b-4809-87f3-6f8a653dc17c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:53.619119 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc2bf1-4d3b-4809-87f3-6f8a653dc17c None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:53.629411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 483/964] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 7 10:42:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:53.630624 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7abe4-10ff-4a82-b181-c7ef81749053 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:53.667936 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:53.738606 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7abe4-10ff-4a82-b181-c7ef81749053 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:53.773451 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1183ac77-d817-4e90-96d2-fe1ec7120acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:53.774054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183ac77-d817-4e90-96d2-fe1ec7120acc None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:53.774327 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183ac77-d817-4e90-96d2-fe1ec7120acc None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:53.774594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1183ac77-d817-4e90-96d2-fe1ec7120acc None admin] PATH_INFO: `/v3/services` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:53.775223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183ac77-d817-4e90-96d2-fe1ec7120acc None admin] RBAC: Adding query filter params (type=compute) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:53.775522 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183ac77-d817-4e90-96d2-fe1ec7120acc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:53.776878 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1183ac77-d817-4e90-96d2-fe1ec7120acc None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:53.786502 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 482/965] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 7 10:42:53 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:53.786681 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cd7fc-aa19-4dec-a176-6592973bdbad None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:53.786681 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cd7fc-aa19-4dec-a176-6592973bdbad None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:53.786681 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cd7fc-aa19-4dec-a176-6592973bdbad None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:53.786681 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 484/966] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 10:42:53.791903 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f0732-f65f-47ea-a0d5-4f0609c99422 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:53.792185 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f0732-f65f-47ea-a0d5-4f0609c99422 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:53.792453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f0732-f65f-47ea-a0d5-4f0609c99422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:53.811941 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-b81f0732-f65f-47ea-a0d5-4f0609c99422 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:53.813278 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-b81f0732-f65f-47ea-a0d5-4f0609c99422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:53.888113 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 483/967] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 10:42:53.912543 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987cd7fc-aa19-4dec-a176-6592973bdbad None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:53.962512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:54.018791 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987cd7fc-aa19-4dec-a176-6592973bdbad None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:54.053331 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84064825-46f9-44c7-b05c-c62060313f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:54.053976 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84064825-46f9-44c7-b05c-c62060313f5f None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:54.054252 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84064825-46f9-44c7-b05c-c62060313f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:54.054518 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84064825-46f9-44c7-b05c-c62060313f5f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:54.064633 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84064825-46f9-44c7-b05c-c62060313f5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:42:54.067216 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c53af1-1366-4387-b1cb-29da467a8bf6 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:54.067500 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c53af1-1366-4387-b1cb-29da467a8bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:54.067770 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c53af1-1366-4387-b1cb-29da467a8bf6 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:54.069263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 484/968] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 10:42:54.069465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-84064825-46f9-44c7-b05c-c62060313f5f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 10:42:54.069465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:54.069465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:54.069465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:54.069465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:54.069465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:54.069465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:54.069465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:54.069465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:54.069465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:54.069465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:54.069465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:54.069465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:42:54.069465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:42:54.069465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:42:54.069465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:42:54.070909 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:42:54.070909 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:42:54.070909 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:42:54.070909 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:42:54.070909 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:54.070909 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:54.070909 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:54.070909 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:54.070909 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:54.070909 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:54.070909 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:54.070909 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:54.070909 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:54.070909 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:54.070909 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:54.070909 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:54.072054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:54.072054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:54.072054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:54.072054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:54.072054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:42:54.072054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:42:54.072054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:42:54.072054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:42:54.072054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:42:54.072054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:42:54.072054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 10:42:54.072054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:54.073390 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 485/969] 10.222.0.27 () {56 vars in 1120 bytes} [Sun Aug 7 10:42:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:54.073956 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c77279-b26e-443c-b419-5c3c8d8611a1 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:54.074232 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c77279-b26e-443c-b419-5c3c8d8611a1 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:54.074500 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c77279-b26e-443c-b419-5c3c8d8611a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:54.076615 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84064825-46f9-44c7-b05c-c62060313f5f None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:54.091971 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-03c77279-b26e-443c-b419-5c3c8d8611a1 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:54.093138 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-03c77279-b26e-443c-b419-5c3c8d8611a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:54.118668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:54.166334 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 485/970] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:42:54.185971 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84064825-46f9-44c7-b05c-c62060313f5f None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:54.188858 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:54.191413 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c77279-b26e-443c-b419-5c3c8d8611a1 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:54.223776 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4d601-5606-43b5-9ba1-c0b978e12a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:54.224378 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4d601-5606-43b5-9ba1-c0b978e12a8e None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:54.224652 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4d601-5606-43b5-9ba1-c0b978e12a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:54.224918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4d601-5606-43b5-9ba1-c0b978e12a8e None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:54.225608 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4d601-5606-43b5-9ba1-c0b978e12a8e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:54.225934 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4d601-5606-43b5-9ba1-c0b978e12a8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:54.227294 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4d601-5606-43b5-9ba1-c0b978e12a8e None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:54.236026 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 486/971] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Aug 7 10:42:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:54.241456 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4d601-5606-43b5-9ba1-c0b978e12a8e None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:54.307366 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c77279-b26e-443c-b419-5c3c8d8611a1 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:54.348696 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4e268-5cfb-499f-8cca-4b167c684e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:54.349458 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4e268-5cfb-499f-8cca-4b167c684e8d None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:54.349731 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4e268-5cfb-499f-8cca-4b167c684e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:54.350164 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4e268-5cfb-499f-8cca-4b167c684e8d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:54.350756 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f4e268-5cfb-499f-8cca-4b167c684e8d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:54.352115 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f4e268-5cfb-499f-8cca-4b167c684e8d None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:54.353736 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4d601-5606-43b5-9ba1-c0b978e12a8e None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:54.363664 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-68f4e268-5cfb-499f-8cca-4b167c684e8d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 10:42:54.363664 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:54.363664 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 10:42:54.363664 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 10:42:54.363664 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 10:42:54.363664 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 10:42:54.363664 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 10:42:54.363664 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:54.363664 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 10:42:54.363664 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:54.363664 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 10:42:54.363664 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:54.363664 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:54.363664 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:54.363664 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:54.363664 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:54.363664 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:54.364828 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:54.364828 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:54.364828 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:54.364828 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:54.364828 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:54.364828 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:54.364828 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 10:42:54.364828 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 10:42:54.364828 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 10:42:54.364828 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 10:42:54.364828 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:54.364828 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:54.364828 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:54.364828 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:54.364828 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:54.364828 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:54.366666 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:54.366666 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:54.366666 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:54.366666 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:54.366666 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:54.366666 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:54.366666 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:54.366666 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:54.366666 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:54.366666 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:54.366666 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 10:42:54.366666 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:54.366666 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 10:42:54.366666 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:54.366666 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 486/972] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Aug 7 10:42:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:42:54.371059 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4e268-5cfb-499f-8cca-4b167c684e8d None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:54.393082 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f06df-5c7d-4add-b81f-c74e6a71c5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:54.393733 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f06df-5c7d-4add-b81f-c74e6a71c5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:54.394007 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f06df-5c7d-4add-b81f-c74e6a71c5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:54.394273 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f06df-5c7d-4add-b81f-c74e6a71c5b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:54.399006 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:54.408104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f06df-5c7d-4add-b81f-c74e6a71c5b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:54.409572 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f06df-5c7d-4add-b81f-c74e6a71c5b1 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:54.427459 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-2d1f06df-5c7d-4add-b81f-c74e6a71c5b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:54.427459 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:54.427459 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:54.427459 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:54.427459 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:54.427459 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:54.427459 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:54.427459 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:54.427459 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:54.427459 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:54.427459 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:54.427459 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:54.427459 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:54.427459 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:54.427459 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:54.427459 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:54.428638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:54.428638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:54.428638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:54.428638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:54.428638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:54.428638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:54.428638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:54.428638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:54.428638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:54.428638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:54.428638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:54.428638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:54.428638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:54.428638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:54.428638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:54.428638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:54.428638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:54.429788 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:54.429788 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:54.429788 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:54.433288 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 487/973] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:42:54.433959 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f06df-5c7d-4add-b81f-c74e6a71c5b1 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:54.454937 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:54.481577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4e268-5cfb-499f-8cca-4b167c684e8d None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:54.517002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedefb6d-f1c0-42d3-a641-1b04eee9c91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:54.517642 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedefb6d-f1c0-42d3-a641-1b04eee9c91c None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:54.517918 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedefb6d-f1c0-42d3-a641-1b04eee9c91c None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:54.518184 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedefb6d-f1c0-42d3-a641-1b04eee9c91c None admin] PATH_INFO: `/v3/services` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:54.518822 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedefb6d-f1c0-42d3-a641-1b04eee9c91c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:54.519121 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedefb6d-f1c0-42d3-a641-1b04eee9c91c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:54.520484 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedefb6d-f1c0-42d3-a641-1b04eee9c91c None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:54.530292 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 487/974] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Aug 7 10:42:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:54.531365 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedefb6d-f1c0-42d3-a641-1b04eee9c91c None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:54.544640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f06df-5c7d-4add-b81f-c74e6a71c5b1 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:54.580856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae41fe2-13e2-48d4-a16c-30ac7705a8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:54.581570 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae41fe2-13e2-48d4-a16c-30ac7705a8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:54.581853 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae41fe2-13e2-48d4-a16c-30ac7705a8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:54.582156 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae41fe2-13e2-48d4-a16c-30ac7705a8d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:54.582805 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae41fe2-13e2-48d4-a16c-30ac7705a8d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:54.583105 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae41fe2-13e2-48d4-a16c-30ac7705a8d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:54.584597 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae41fe2-13e2-48d4-a16c-30ac7705a8d8 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:54.602416 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 488/975] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:54.603423 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae41fe2-13e2-48d4-a16c-30ac7705a8d8 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:54.619315 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:54.631670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedefb6d-f1c0-42d3-a641-1b04eee9c91c None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:54.665470 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177461bb-aae3-41c2-b388-66bd078cdd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:54.666067 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177461bb-aae3-41c2-b388-66bd078cdd37 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:54.666346 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177461bb-aae3-41c2-b388-66bd078cdd37 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:54.666615 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177461bb-aae3-41c2-b388-66bd078cdd37 None admin] PATH_INFO: `/v3/services` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:54.667229 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177461bb-aae3-41c2-b388-66bd078cdd37 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:54.667528 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177461bb-aae3-41c2-b388-66bd078cdd37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:54.668883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177461bb-aae3-41c2-b388-66bd078cdd37 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:54.674292 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 488/976] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Aug 7 10:42:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:54.679924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177461bb-aae3-41c2-b388-66bd078cdd37 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:54.692418 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:54.715034 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae41fe2-13e2-48d4-a16c-30ac7705a8d8 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:54.751446 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7861918-0819-4819-a3dc-4609dd1f9e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:54.752072 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7861918-0819-4819-a3dc-4609dd1f9e25 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:54.752350 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7861918-0819-4819-a3dc-4609dd1f9e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:54.752623 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7861918-0819-4819-a3dc-4609dd1f9e25 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:54.759860 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7861918-0819-4819-a3dc-4609dd1f9e25 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:54.761279 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7861918-0819-4819-a3dc-4609dd1f9e25 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:54.772639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-d7861918-0819-4819-a3dc-4609dd1f9e25 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 10:42:54.772639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:54.772639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:54.772639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:54.772639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:54.772639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:54.772639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:54.772639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:54.772639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:54.772639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:54.772639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:54.772639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:54.772639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:42:54.772639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:42:54.772639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:42:54.772639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:42:54.773652 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:54.773652 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:54.773652 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:42:54.773652 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:54.773652 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:42:54.773652 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:42:54.773652 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:54.773652 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:54.773652 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:54.773652 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:54.773652 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:54.773652 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:54.773652 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:54.773652 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:54.773652 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:54.773652 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:54.773652 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:54.773652 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:54.774639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:54.774639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:54.774639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:42:54.774639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:42:54.774639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:42:54.774639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:42:54.774639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:42:54.774639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:42:54.774639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 10:42:54.774639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:54.774639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 489/977] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Aug 7 10:42:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:54.779423 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7861918-0819-4819-a3dc-4609dd1f9e25 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:54.786769 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177461bb-aae3-41c2-b388-66bd078cdd37 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:54.821209 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98a40b-f50b-4ade-84f7-303fe2109508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:54.821853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98a40b-f50b-4ade-84f7-303fe2109508 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:54.822128 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98a40b-f50b-4ade-84f7-303fe2109508 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:54.822394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98a40b-f50b-4ade-84f7-303fe2109508 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:54.823100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed98a40b-f50b-4ade-84f7-303fe2109508 None admin] RBAC: Adding query filter params (interface=admin, service_id=a1ed0dd03f6a431ab48555adc85a13e1, region_id=RegionOne) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:54.823409 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed98a40b-f50b-4ade-84f7-303fe2109508 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:54.824758 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed98a40b-f50b-4ade-84f7-303fe2109508 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:54.830525 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 489/978] 10.222.0.27 () {56 vars in 1249 bytes} [Sun Aug 7 10:42:54 2022] GET /identity/v3/endpoints?service_id=a1ed0dd03f6a431ab48555adc85a13e1&interface=admin®ion_id=RegionOne => generated 193 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:54.835961 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98a40b-f50b-4ade-84f7-303fe2109508 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:54.855182 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:54.894450 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7861918-0819-4819-a3dc-4609dd1f9e25 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:54.930715 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace0e98-0541-4db0-9246-8ea15928a473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:54.931319 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace0e98-0541-4db0-9246-8ea15928a473 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:54.931596 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace0e98-0541-4db0-9246-8ea15928a473 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:54.931868 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace0e98-0541-4db0-9246-8ea15928a473 None admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:54.932597 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace0e98-0541-4db0-9246-8ea15928a473 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:54.932901 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace0e98-0541-4db0-9246-8ea15928a473 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:54.934383 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace0e98-0541-4db0-9246-8ea15928a473 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:54.943152 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98a40b-f50b-4ade-84f7-303fe2109508 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:54.943712 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:54.954097 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 490/979] 10.222.0.27 () {56 vars in 1149 bytes} [Sun Aug 7 10:42:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:54.959710 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace0e98-0541-4db0-9246-8ea15928a473 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:54.978848 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08c03e-3c17-45f3-9a3e-37638512b43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:54.979449 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08c03e-3c17-45f3-9a3e-37638512b43b None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:54.979720 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08c03e-3c17-45f3-9a3e-37638512b43b None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:54.979981 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08c03e-3c17-45f3-9a3e-37638512b43b None admin] PATH_INFO: `/v3/services` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:54.980578 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c08c03e-3c17-45f3-9a3e-37638512b43b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:54.981949 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c08c03e-3c17-45f3-9a3e-37638512b43b None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:54.997671 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 490/980] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Aug 7 10:42:54 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 10:42:55.070939 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace0e98-0541-4db0-9246-8ea15928a473 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:55.108581 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fdc73-6a5f-4ba7-84fb-1c275fdb8d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:55.109103 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fdc73-6a5f-4ba7-84fb-1c275fdb8d3e None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:55.109404 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fdc73-6a5f-4ba7-84fb-1c275fdb8d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:55.109675 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fdc73-6a5f-4ba7-84fb-1c275fdb8d3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:55.176772 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:55.184464 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7fdc73-6a5f-4ba7-84fb-1c275fdb8d3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:55.185966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7fdc73-6a5f-4ba7-84fb-1c275fdb8d3e None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:55.297327 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 491/981] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:42:54 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 10:42:55.303651 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08c03e-3c17-45f3-9a3e-37638512b43b None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:55.398669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:55.419738 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08c03e-3c17-45f3-9a3e-37638512b43b None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:55.455501 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b21b2f-f133-4921-999d-688f4562a614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:55.456125 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b21b2f-f133-4921-999d-688f4562a614 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:55.456398 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b21b2f-f133-4921-999d-688f4562a614 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:55.456657 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b21b2f-f133-4921-999d-688f4562a614 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:55.467091 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b21b2f-f133-4921-999d-688f4562a614 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:55.468520 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b21b2f-f133-4921-999d-688f4562a614 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:55.482316 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-28b21b2f-f133-4921-999d-688f4562a614 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:55.482316 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:55.482316 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:55.482316 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:55.482316 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:55.482316 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:55.482316 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:55.482316 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:55.482316 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:55.482316 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:55.482316 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:55.482316 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:55.482316 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:42:55.482316 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:42:55.482316 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:42:55.482316 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:42:55.483750 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:55.483750 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:55.483750 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:55.483750 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:55.483750 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:55.483750 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:55.483750 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:55.483750 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:55.483750 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:55.483750 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:55.483750 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:55.483750 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:55.483750 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:55.483750 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:55.483750 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:55.483750 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:55.483750 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:42:55.484701 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:42:55.484701 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:42:55.484701 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:55.484701 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 491/982] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:55.489280 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fdc73-6a5f-4ba7-84fb-1c275fdb8d3e None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:55.585797 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:55.592680 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fdc73-6a5f-4ba7-84fb-1c275fdb8d3e None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:55.626582 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5f110-802d-4c72-8e9a-c516710a1d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:55.627236 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5f110-802d-4c72-8e9a-c516710a1d1f None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:55.627512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5f110-802d-4c72-8e9a-c516710a1d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:55.627777 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5f110-802d-4c72-8e9a-c516710a1d1f None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:55.628406 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5f110-802d-4c72-8e9a-c516710a1d1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:55.628706 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5f110-802d-4c72-8e9a-c516710a1d1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:55.630071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5f110-802d-4c72-8e9a-c516710a1d1f None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:55.646346 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 492/983] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:55.647951 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b21b2f-f133-4921-999d-688f4562a614 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:55.748479 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b21b2f-f133-4921-999d-688f4562a614 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:55.777509 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:55.783331 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277b83b-feb7-4def-ad3a-453b12b2083d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:55.783953 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277b83b-feb7-4def-ad3a-453b12b2083d None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:55.784342 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277b83b-feb7-4def-ad3a-453b12b2083d None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:55.784619 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277b83b-feb7-4def-ad3a-453b12b2083d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:55.791349 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277b83b-feb7-4def-ad3a-453b12b2083d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:55.792629 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0fc07-7a29-4fc1-8e01-670b3f49f5bb None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:55.793058 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277b83b-feb7-4def-ad3a-453b12b2083d None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:55.793161 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0fc07-7a29-4fc1-8e01-670b3f49f5bb None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:55.793161 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0fc07-7a29-4fc1-8e01-670b3f49f5bb None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:55.794688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 493/984] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:55.799725 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc80bfd-22f1-450f-a85b-59d00b3e9ef7 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:55.800010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc80bfd-22f1-450f-a85b-59d00b3e9ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:55.800280 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc80bfd-22f1-450f-a85b-59d00b3e9ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:55.805247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-c277b83b-feb7-4def-ad3a-453b12b2083d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:55.805247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:55.805247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:55.805247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:55.805247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:55.805247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:55.805247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:55.805247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:55.805247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:55.805247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:55.805247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:55.805247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:55.805247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:42:55.805247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:42:55.805247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:42:55.806216 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:42:55.806216 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:55.806216 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:55.806216 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:55.806216 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:55.806216 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:55.806216 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:55.806216 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:55.806216 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:55.806216 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:55.806216 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:55.806216 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:55.806216 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:55.806216 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:55.806216 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:55.806216 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:55.806216 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:55.807556 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:42:55.807556 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:42:55.807556 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:42:55.807556 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:42:55.807556 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:42:55.807556 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:42:55.807556 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:42:55.807556 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:55.807556 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 492/985] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:42:55.811901 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277b83b-feb7-4def-ad3a-453b12b2083d None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:55.821115 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-5dc80bfd-22f1-450f-a85b-59d00b3e9ef7 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:55.822344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-5dc80bfd-22f1-450f-a85b-59d00b3e9ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:55.891723 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 494/986] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 10:42:55.913605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc80bfd-22f1-450f-a85b-59d00b3e9ef7 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:55.915980 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277b83b-feb7-4def-ad3a-453b12b2083d None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:55.952635 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f1f1e-6e67-4bbc-bacd-292c9250f0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:55.953237 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f1f1e-6e67-4bbc-bacd-292c9250f0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:55.953540 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f1f1e-6e67-4bbc-bacd-292c9250f0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:55.953833 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f1f1e-6e67-4bbc-bacd-292c9250f0b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:55.954542 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f1f1e-6e67-4bbc-bacd-292c9250f0b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:55.954841 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f1f1e-6e67-4bbc-bacd-292c9250f0b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:55.956260 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f1f1e-6e67-4bbc-bacd-292c9250f0b3 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:55.968351 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 493/987] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:42:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:55.974644 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f1f1e-6e67-4bbc-bacd-292c9250f0b3 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:56.007254 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:56.022891 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc80bfd-22f1-450f-a85b-59d00b3e9ef7 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:56.036019 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:56.060932 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93117a5d-d571-4e73-9b66-e58666c9cb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:56.061786 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93117a5d-d571-4e73-9b66-e58666c9cb83 None admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:56.062078 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93117a5d-d571-4e73-9b66-e58666c9cb83 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:56.062335 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93117a5d-d571-4e73-9b66-e58666c9cb83 None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:56.063014 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93117a5d-d571-4e73-9b66-e58666c9cb83 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:56.064368 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93117a5d-d571-4e73-9b66-e58666c9cb83 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:56.079130 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 495/988] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 7 10:42:55 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 10:42:56.096130 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f1f1e-6e67-4bbc-bacd-292c9250f0b3 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:56.144404 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3bd33c-2167-47f6-b515-99b94849e2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:56.145061 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bd33c-2167-47f6-b515-99b94849e2b1 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:56.145374 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bd33c-2167-47f6-b515-99b94849e2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:56.145653 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bd33c-2167-47f6-b515-99b94849e2b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:56.146407 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3bd33c-2167-47f6-b515-99b94849e2b1 None admin] RBAC: Adding query filter params (role.id=051acd6762694d9985183bf0b8860800, scope.project.id=62eed8550ae3403f8a75894dbd19cf4a, user.id=e7eebb4bd7e04ff8bc4304a40cf6ba35) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:56.146774 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3bd33c-2167-47f6-b515-99b94849e2b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:56.148243 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3bd33c-2167-47f6-b515-99b94849e2b1 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:56.161607 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 494/989] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:42:55 2022] GET /identity/v3/role_assignments?user.id=e7eebb4bd7e04ff8bc4304a40cf6ba35&scope.project.id=62eed8550ae3403f8a75894dbd19cf4a&role.id=051acd6762694d9985183bf0b8860800 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:56.998735 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e3bc8-2a31-460e-9a1e-dd4e27f1ff26 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:56.999279 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e3bc8-2a31-460e-9a1e-dd4e27f1ff26 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:56.999279 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e3bc8-2a31-460e-9a1e-dd4e27f1ff26 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:57.001170 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 496/990] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:57.006186 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714d0e6-876f-4744-af2a-afe8e6183b4b None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:57.006616 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714d0e6-876f-4744-af2a-afe8e6183b4b None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:57.006761 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714d0e6-876f-4744-af2a-afe8e6183b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:57.025529 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-6714d0e6-876f-4744-af2a-afe8e6183b4b None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:57.026740 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-6714d0e6-876f-4744-af2a-afe8e6183b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:57.092704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 495/991] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:57 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:42:57.114999 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e3bc8-2a31-460e-9a1e-dd4e27f1ff26 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:57.219947 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e3bc8-2a31-460e-9a1e-dd4e27f1ff26 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:57.254584 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfaf6d-6404-4cd4-9ffc-18dcac6a6e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:57.255132 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfaf6d-6404-4cd4-9ffc-18dcac6a6e1a None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:57.255410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfaf6d-6404-4cd4-9ffc-18dcac6a6e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:57.255683 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfaf6d-6404-4cd4-9ffc-18dcac6a6e1a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:57.256262 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcfaf6d-6404-4cd4-9ffc-18dcac6a6e1a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:57.257645 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcfaf6d-6404-4cd4-9ffc-18dcac6a6e1a None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:57.266360 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-8dcfaf6d-6404-4cd4-9ffc-18dcac6a6e1a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 10:42:57.266360 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:57.266360 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 10:42:57.266360 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 10:42:57.266360 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 10:42:57.266360 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 10:42:57.266360 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 10:42:57.266360 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:57.266360 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 10:42:57.266360 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:57.266360 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 10:42:57.266360 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:57.266360 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:57.266360 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:57.266360 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:57.266360 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:57.266360 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:57.267333 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:57.267333 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:57.267333 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:57.267333 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:57.267333 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:57.267333 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:57.267333 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 10:42:57.267333 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 10:42:57.267333 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 10:42:57.267333 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 10:42:57.267333 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:57.267333 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:57.267333 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:57.267333 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:57.267333 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:57.267333 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:57.268172 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:57.268172 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:57.268172 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:57.268172 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:57.268172 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:57.268172 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:57.268172 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:57.268172 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:57.268172 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:57.268172 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:57.268172 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 10:42:57.268172 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:57.268172 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 10:42:57.268172 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:57.275555 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 497/992] 10.222.0.27 () {56 vars in 1126 bytes} [Sun Aug 7 10:42:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:42:57.275716 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714d0e6-876f-4744-af2a-afe8e6183b4b None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:57.321504 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:57.385510 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714d0e6-876f-4744-af2a-afe8e6183b4b None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:57.419440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62376353-e2e5-49e6-a780-0fa8595edef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:57.420263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62376353-e2e5-49e6-a780-0fa8595edef6 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:57.420695 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62376353-e2e5-49e6-a780-0fa8595edef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:57.421103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62376353-e2e5-49e6-a780-0fa8595edef6 None admin] PATH_INFO: `/v3/services` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:57.421918 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62376353-e2e5-49e6-a780-0fa8595edef6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:57.423080 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62376353-e2e5-49e6-a780-0fa8595edef6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:57.424572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62376353-e2e5-49e6-a780-0fa8595edef6 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:57.430655 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 496/993] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Aug 7 10:42:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:57.435847 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfaf6d-6404-4cd4-9ffc-18dcac6a6e1a None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:57.449932 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:57.540352 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfaf6d-6404-4cd4-9ffc-18dcac6a6e1a None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:57.574200 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23f03c-791c-4741-a87a-2288fe176803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:57.574848 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23f03c-791c-4741-a87a-2288fe176803 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:57.575128 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23f03c-791c-4741-a87a-2288fe176803 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:57.575398 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23f03c-791c-4741-a87a-2288fe176803 None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:57.576030 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23f03c-791c-4741-a87a-2288fe176803 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:57.576330 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23f03c-791c-4741-a87a-2288fe176803 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:57.577706 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f23f03c-791c-4741-a87a-2288fe176803 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:57.582642 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 498/994] 10.222.0.27 () {56 vars in 1122 bytes} [Sun Aug 7 10:42:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:42:57.588108 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62376353-e2e5-49e6-a780-0fa8595edef6 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:57.690414 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62376353-e2e5-49e6-a780-0fa8595edef6 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:57.697755 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:57.726171 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17462597-ae0e-4dc7-a34d-fd888550b0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:57.726781 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17462597-ae0e-4dc7-a34d-fd888550b0eb None admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:57.727110 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17462597-ae0e-4dc7-a34d-fd888550b0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:57.727389 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17462597-ae0e-4dc7-a34d-fd888550b0eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:57.728063 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17462597-ae0e-4dc7-a34d-fd888550b0eb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:57.729511 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17462597-ae0e-4dc7-a34d-fd888550b0eb None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:57.753344 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 497/995] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:42:57 2022] POST /identity/v3/endpoints => generated 325 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:42:58.119014 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c29c1-3820-436e-af1c-76529224a4c2 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:58.119565 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c29c1-3820-436e-af1c-76529224a4c2 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:58.119565 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c29c1-3820-436e-af1c-76529224a4c2 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:58.121286 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 499/996] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:42:58.126236 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c0034-fc73-43ae-95d5-258075e64331 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:58.126621 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c0034-fc73-43ae-95d5-258075e64331 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:58.126802 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c0034-fc73-43ae-95d5-258075e64331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:58.144878 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-cd4c0034-fc73-43ae-95d5-258075e64331 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:58.146076 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-cd4c0034-fc73-43ae-95d5-258075e64331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:58.217854 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396228f-edfe-40ea-820f-bb0e3634dfa1 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:58.218131 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396228f-edfe-40ea-820f-bb0e3634dfa1 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:58.218403 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396228f-edfe-40ea-820f-bb0e3634dfa1 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:58.220604 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 500/997] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 10:42:58.222215 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 498/998] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:58 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:42:58.225216 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6e4e2-009e-4ed5-b9b3-2bdf7579cc56 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:58.225529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6e4e2-009e-4ed5-b9b3-2bdf7579cc56 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:58.225801 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6e4e2-009e-4ed5-b9b3-2bdf7579cc56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:58.244463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-cad6e4e2-009e-4ed5-b9b3-2bdf7579cc56 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:58.244915 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c0034-fc73-43ae-95d5-258075e64331 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:58.245928 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-cad6e4e2-009e-4ed5-b9b3-2bdf7579cc56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:58.319808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 501/999] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:58 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:42:58.341983 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6e4e2-009e-4ed5-b9b3-2bdf7579cc56 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:58.348346 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:58.349670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:58.360631 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c0034-fc73-43ae-95d5-258075e64331 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:58.398850 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832fd28-9ca2-47be-90d1-18d228386900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:58.399388 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832fd28-9ca2-47be-90d1-18d228386900 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:58.399667 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832fd28-9ca2-47be-90d1-18d228386900 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:58.399932 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832fd28-9ca2-47be-90d1-18d228386900 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:58.400511 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832fd28-9ca2-47be-90d1-18d228386900 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:58.401906 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832fd28-9ca2-47be-90d1-18d228386900 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:58.410672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-b832fd28-9ca2-47be-90d1-18d228386900 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 10:42:58.410672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:58.410672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 10:42:58.410672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 10:42:58.410672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 10:42:58.410672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 10:42:58.410672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 10:42:58.410672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:58.410672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 10:42:58.410672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:58.410672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 10:42:58.410672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:58.410672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:58.410672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:58.410672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:58.410672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:58.410672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:58.411770 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:58.411770 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:58.411770 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:58.411770 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:58.411770 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:58.411770 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:58.411770 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 10:42:58.411770 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 10:42:58.411770 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 10:42:58.411770 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 10:42:58.411770 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:58.411770 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:58.411770 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:58.411770 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:58.411770 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:58.411770 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:58.412633 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:58.412633 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:58.412633 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:58.412633 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:58.412633 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:58.412633 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:58.412633 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:58.412633 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:58.412633 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:58.412633 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:58.412633 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 10:42:58.412633 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:58.412633 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 10:42:58.412633 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:42:58.412633 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 499/1000] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:42:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:42:58.417628 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832fd28-9ca2-47be-90d1-18d228386900 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:58.460016 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6e4e2-009e-4ed5-b9b3-2bdf7579cc56 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:58.495320 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad97f8-a389-46da-9d72-ecbeaf2639dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:58.496198 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad97f8-a389-46da-9d72-ecbeaf2639dc None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:58.496472 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad97f8-a389-46da-9d72-ecbeaf2639dc None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:58.496740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad97f8-a389-46da-9d72-ecbeaf2639dc None admin] PATH_INFO: `/v3/services/image` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:58.497335 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad97f8-a389-46da-9d72-ecbeaf2639dc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:58.498668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad97f8-a389-46da-9d72-ecbeaf2639dc None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:58.507663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-36ad97f8-a389-46da-9d72-ecbeaf2639dc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 10:42:58.507663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:58.507663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 10:42:58.507663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 10:42:58.507663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 10:42:58.507663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 10:42:58.507663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 10:42:58.507663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:58.507663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 10:42:58.507663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:58.507663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 10:42:58.507663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:58.507663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:42:58.507663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:42:58.507663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:42:58.507663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:42:58.507663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:42:58.508862 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:42:58.508862 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:42:58.508862 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:42:58.508862 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:42:58.508862 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:42:58.508862 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:42:58.508862 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 10:42:58.508862 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 10:42:58.508862 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 10:42:58.508862 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 10:42:58.508862 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:42:58.508862 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:42:58.508862 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:42:58.508862 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:42:58.508862 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:42:58.508862 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:42:58.509751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:42:58.509751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:42:58.509751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:42:58.509751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:42:58.509751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:42:58.509751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:42:58.509751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:42:58.509751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:42:58.509751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:42:58.509751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:42:58.509751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 10:42:58.509751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:42:58.509751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 10:42:58.509751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:42:58.509751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 502/1001] 10.222.0.27 () {56 vars in 1105 bytes} [Sun Aug 7 10:42:58 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:42:58.515556 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad97f8-a389-46da-9d72-ecbeaf2639dc None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:58.525546 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832fd28-9ca2-47be-90d1-18d228386900 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:58.560110 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ee832-3756-45d0-83ae-ab2e4b1abe83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:58.560704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ee832-3756-45d0-83ae-ab2e4b1abe83 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:58.560978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ee832-3756-45d0-83ae-ab2e4b1abe83 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:58.561245 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ee832-3756-45d0-83ae-ab2e4b1abe83 None admin] PATH_INFO: `/v3/services` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:58.561899 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ee832-3756-45d0-83ae-ab2e4b1abe83 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:58.562193 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ee832-3756-45d0-83ae-ab2e4b1abe83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:58.563589 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ee832-3756-45d0-83ae-ab2e4b1abe83 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:58.568208 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 500/1002] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 7 10:42:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:58.573689 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ee832-3756-45d0-83ae-ab2e4b1abe83 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:58.586706 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:58.597925 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:58.621815 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad97f8-a389-46da-9d72-ecbeaf2639dc None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:58.655934 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b3a4f-847a-4cb7-aa81-67d5a321e568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:58.656461 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b3a4f-847a-4cb7-aa81-67d5a321e568 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:58.656774 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b3a4f-847a-4cb7-aa81-67d5a321e568 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:58.657048 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b3a4f-847a-4cb7-aa81-67d5a321e568 None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:58.657696 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b3a4f-847a-4cb7-aa81-67d5a321e568 None admin] RBAC: Adding query filter params (name=image) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:58.657992 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b3a4f-847a-4cb7-aa81-67d5a321e568 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:58.659338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b3a4f-847a-4cb7-aa81-67d5a321e568 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:58.663918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 503/1003] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:58.669553 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b3a4f-847a-4cb7-aa81-67d5a321e568 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:58.681663 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ee832-3756-45d0-83ae-ab2e4b1abe83 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:58.717961 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df64f8-8fab-475e-8731-2c2f04ed33e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:58.718560 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df64f8-8fab-475e-8731-2c2f04ed33e3 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:58.718837 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df64f8-8fab-475e-8731-2c2f04ed33e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:58.719107 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df64f8-8fab-475e-8731-2c2f04ed33e3 None admin] PATH_INFO: `/v3/services` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:58.720310 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df64f8-8fab-475e-8731-2c2f04ed33e3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:58.720609 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df64f8-8fab-475e-8731-2c2f04ed33e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:58.722011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df64f8-8fab-475e-8731-2c2f04ed33e3 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:58.730119 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 501/1004] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 7 10:42:58 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:58.735780 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df64f8-8fab-475e-8731-2c2f04ed33e3 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:58.779313 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b3a4f-847a-4cb7-aa81-67d5a321e568 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:58.810043 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:58.817722 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ecb09-4c70-42d3-9498-cec3098e69cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:58.818556 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ecb09-4c70-42d3-9498-cec3098e69cd None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:58.819473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ecb09-4c70-42d3-9498-cec3098e69cd None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:58.819745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ecb09-4c70-42d3-9498-cec3098e69cd None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:58.820374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ecb09-4c70-42d3-9498-cec3098e69cd None admin] RBAC: Adding query filter params (type=image) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:58.820674 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ecb09-4c70-42d3-9498-cec3098e69cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:58.821671 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:58.822077 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ecb09-4c70-42d3-9498-cec3098e69cd None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:58.837718 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 504/1005] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:58 2022] GET /identity/v3/services?type=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:58.840381 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df64f8-8fab-475e-8731-2c2f04ed33e3 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:58.883431 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fa776-741a-4edb-a0ae-5435968b701a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:58.884053 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fa776-741a-4edb-a0ae-5435968b701a None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:58.884325 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fa776-741a-4edb-a0ae-5435968b701a None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:58.884590 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fa776-741a-4edb-a0ae-5435968b701a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:58.885334 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fa776-741a-4edb-a0ae-5435968b701a None admin] RBAC: Adding query filter params (interface=public, service_id=31542555ddc645429075f5557ba07e91, region_id=RegionOne) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:42:58.885639 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fa776-741a-4edb-a0ae-5435968b701a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:58.887045 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fa776-741a-4edb-a0ae-5435968b701a None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:58.893814 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 502/1006] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Aug 7 10:42:58 2022] GET /identity/v3/endpoints?service_id=31542555ddc645429075f5557ba07e91&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:42:58.899245 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ecb09-4c70-42d3-9498-cec3098e69cd None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:59.009255 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ecb09-4c70-42d3-9498-cec3098e69cd None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:42:59.043518 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6bada-b6b5-4f48-8550-97cfc4e54d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:42:59.044116 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6bada-b6b5-4f48-8550-97cfc4e54d9d None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:59.044395 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6bada-b6b5-4f48-8550-97cfc4e54d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:59.044667 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6bada-b6b5-4f48-8550-97cfc4e54d9d None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:59.045268 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6bada-b6b5-4f48-8550-97cfc4e54d9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:42:59.046640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6bada-b6b5-4f48-8550-97cfc4e54d9d None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:42:59.052821 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 505/1007] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Aug 7 10:42:58 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 10:42:59.767501 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa8abb-56de-42db-927c-9cdd197faeaa None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:59.768043 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa8abb-56de-42db-927c-9cdd197faeaa None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:59.768043 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa8abb-56de-42db-927c-9cdd197faeaa None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:59.769531 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 503/1008] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 10:42:59.774466 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2034a5f-9de7-49cc-a3b0-19cd94aaeff6 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:42:59.774845 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2034a5f-9de7-49cc-a3b0-19cd94aaeff6 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:42:59.775021 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2034a5f-9de7-49cc-a3b0-19cd94aaeff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:42:59.793259 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-a2034a5f-9de7-49cc-a3b0-19cd94aaeff6 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:42:59.794458 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-a2034a5f-9de7-49cc-a3b0-19cd94aaeff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:42:59.851388 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:42:59.863637 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 506/1009] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:42:59 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:42:59.886798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa8abb-56de-42db-927c-9cdd197faeaa None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:42:59.992260 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa8abb-56de-42db-927c-9cdd197faeaa None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:00.026797 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7c121-f81f-4255-9d16-d1431df49009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:00.027341 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7c121-f81f-4255-9d16-d1431df49009 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:00.027671 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7c121-f81f-4255-9d16-d1431df49009 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:00.027941 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7c121-f81f-4255-9d16-d1431df49009 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:00.029033 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7c121-f81f-4255-9d16-d1431df49009 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:00.030514 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7c121-f81f-4255-9d16-d1431df49009 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:00.036931 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 504/1010] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:42:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:43:00.038196 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2034a5f-9de7-49cc-a3b0-19cd94aaeff6 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:00.145257 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2034a5f-9de7-49cc-a3b0-19cd94aaeff6 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:00.180860 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb92db4-907b-4e85-b3e3-080bad4ca406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:00.181489 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb92db4-907b-4e85-b3e3-080bad4ca406 None admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:00.181766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb92db4-907b-4e85-b3e3-080bad4ca406 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:00.182032 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb92db4-907b-4e85-b3e3-080bad4ca406 None admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:00.182660 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb92db4-907b-4e85-b3e3-080bad4ca406 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:00.184065 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb92db4-907b-4e85-b3e3-080bad4ca406 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:00.216952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 507/1011] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 7 10:43:00 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:43:00.867832 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b588d35-46a5-4af7-a964-c8e246d20292 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:00.868347 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b588d35-46a5-4af7-a964-c8e246d20292 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:00.868347 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b588d35-46a5-4af7-a964-c8e246d20292 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:00.869792 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 505/1012] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:43:00.875060 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051f301-7f3d-4f7d-8ce9-45230a02c88b None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:00.875443 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051f301-7f3d-4f7d-8ce9-45230a02c88b None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:00.876153 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051f301-7f3d-4f7d-8ce9-45230a02c88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:00.894003 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-e051f301-7f3d-4f7d-8ce9-45230a02c88b None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:43:00.895237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-e051f301-7f3d-4f7d-8ce9-45230a02c88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:43:00.930488 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:00.965640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 508/1013] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:43:00 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:43:00.989947 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b588d35-46a5-4af7-a964-c8e246d20292 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:01.009551 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:01.057174 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a8838-1158-498b-a95c-b67e10fc8ae1 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:01.057489 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a8838-1158-498b-a95c-b67e10fc8ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:01.057767 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a8838-1158-498b-a95c-b67e10fc8ae1 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:01.059244 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 509/1014] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 10:43:01.064331 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18369e-bbe6-4c31-bd09-5c785477d665 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:01.064603 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18369e-bbe6-4c31-bd09-5c785477d665 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:01.064861 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18369e-bbe6-4c31-bd09-5c785477d665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:01.082334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-9b18369e-bbe6-4c31-bd09-5c785477d665 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:43:01.083509 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-9b18369e-bbe6-4c31-bd09-5c785477d665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:43:01.101597 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b588d35-46a5-4af7-a964-c8e246d20292 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:01.142706 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186140ac-67fe-46ea-a80c-f7a7a231717c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:01.143395 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186140ac-67fe-46ea-a80c-f7a7a231717c None admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:01.143962 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186140ac-67fe-46ea-a80c-f7a7a231717c None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:01.144253 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186140ac-67fe-46ea-a80c-f7a7a231717c None admin] PATH_INFO: `/v3/services` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:01.145173 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186140ac-67fe-46ea-a80c-f7a7a231717c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:01.147020 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186140ac-67fe-46ea-a80c-f7a7a231717c None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:01.151006 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 510/1015] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:43:01 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 10:43:01.170326 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 506/1016] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 7 10:43:00 2022] POST /identity/v3/services => generated 242 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:43:01.173813 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18369e-bbe6-4c31-bd09-5c785477d665 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:01.282907 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18369e-bbe6-4c31-bd09-5c785477d665 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:01.284598 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:01.333039 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0a5aa-c46d-42e9-8619-51070476c234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:01.334005 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0a5aa-c46d-42e9-8619-51070476c234 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:01.334453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0a5aa-c46d-42e9-8619-51070476c234 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:01.334867 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0a5aa-c46d-42e9-8619-51070476c234 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:01.335658 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0a5aa-c46d-42e9-8619-51070476c234 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:01.337058 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0a5aa-c46d-42e9-8619-51070476c234 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:01.347777 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-7cd0a5aa-c46d-42e9-8619-51070476c234 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 10:43:01.347777 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:43:01.347777 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 10:43:01.347777 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 10:43:01.347777 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 10:43:01.347777 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 10:43:01.347777 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 10:43:01.347777 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:43:01.347777 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 10:43:01.347777 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:43:01.347777 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 10:43:01.347777 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:43:01.347777 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:43:01.347777 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:43:01.347777 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:43:01.347777 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:43:01.347777 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:43:01.348820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:43:01.348820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:43:01.348820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:43:01.348820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:43:01.348820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:43:01.348820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:43:01.348820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 10:43:01.348820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 10:43:01.348820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 10:43:01.348820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 10:43:01.348820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:43:01.348820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:43:01.348820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:43:01.348820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:43:01.348820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:43:01.348820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:43:01.349752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:43:01.349752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:43:01.349752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:43:01.349752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:43:01.349752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:43:01.349752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:43:01.349752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:43:01.349752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:43:01.349752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:43:01.349752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:43:01.349752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 10:43:01.349752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:43:01.349752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 10:43:01.349752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:43:01.349752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 511/1017] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:43:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:43:01.354634 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186140ac-67fe-46ea-a80c-f7a7a231717c None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:01.441846 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:01.467237 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186140ac-67fe-46ea-a80c-f7a7a231717c None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:01.499989 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c088ff-4652-47d4-999e-3dafeedb3ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:01.501130 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c088ff-4652-47d4-999e-3dafeedb3ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:01.501432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c088ff-4652-47d4-999e-3dafeedb3ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:01.501701 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c088ff-4652-47d4-999e-3dafeedb3ff7 None admin] PATH_INFO: `/v3/services` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:01.502324 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c088ff-4652-47d4-999e-3dafeedb3ff7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:01.502629 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c088ff-4652-47d4-999e-3dafeedb3ff7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:01.503964 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c088ff-4652-47d4-999e-3dafeedb3ff7 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:01.513471 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 507/1018] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 7 10:43:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:01.514559 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0a5aa-c46d-42e9-8619-51070476c234 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:01.612766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0a5aa-c46d-42e9-8619-51070476c234 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:01.646595 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cecb92-522e-4643-afdb-c71039f2acf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:01.647187 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cecb92-522e-4643-afdb-c71039f2acf9 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:01.647457 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cecb92-522e-4643-afdb-c71039f2acf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:01.647720 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cecb92-522e-4643-afdb-c71039f2acf9 None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:01.649841 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cecb92-522e-4643-afdb-c71039f2acf9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:01.649841 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cecb92-522e-4643-afdb-c71039f2acf9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:01.650033 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cecb92-522e-4643-afdb-c71039f2acf9 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:01.655250 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 512/1019] 10.222.0.27 () {56 vars in 1112 bytes} [Sun Aug 7 10:43:01 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:01.660993 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c088ff-4652-47d4-999e-3dafeedb3ff7 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:01.760093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c088ff-4652-47d4-999e-3dafeedb3ff7 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:01.792120 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412209e-ff25-48ab-9673-44ac2bc73e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:01.792715 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412209e-ff25-48ab-9673-44ac2bc73e4b None admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:01.792990 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412209e-ff25-48ab-9673-44ac2bc73e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:01.793253 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412209e-ff25-48ab-9673-44ac2bc73e4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:01.793942 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412209e-ff25-48ab-9673-44ac2bc73e4b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:01.795301 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412209e-ff25-48ab-9673-44ac2bc73e4b None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:01.804986 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:01.825350 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 508/1020] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:43:01 2022] POST /identity/v3/endpoints => generated 334 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:43:02.243636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b0007-5f78-43ab-8a47-69eea84667dc None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:02.244158 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b0007-5f78-43ab-8a47-69eea84667dc None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:02.244158 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b0007-5f78-43ab-8a47-69eea84667dc None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:02.245960 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 513/1021] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:43:02.250978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd066d5a-8eeb-4af9-bc72-ad7aa8ff0da7 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:02.251393 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd066d5a-8eeb-4af9-bc72-ad7aa8ff0da7 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:02.251517 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd066d5a-8eeb-4af9-bc72-ad7aa8ff0da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:02.269208 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-bd066d5a-8eeb-4af9-bc72-ad7aa8ff0da7 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:43:02.270416 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-bd066d5a-8eeb-4af9-bc72-ad7aa8ff0da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:43:02.351449 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 509/1022] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:43:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:43:02.376421 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b0007-5f78-43ab-8a47-69eea84667dc None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:02.406222 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:02.483091 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b0007-5f78-43ab-8a47-69eea84667dc None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:02.518264 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c502d2d-c8f7-45f0-b505-54d356295df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:02.518820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c502d2d-c8f7-45f0-b505-54d356295df2 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:02.519093 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c502d2d-c8f7-45f0-b505-54d356295df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:02.519409 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c502d2d-c8f7-45f0-b505-54d356295df2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:02.520577 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c502d2d-c8f7-45f0-b505-54d356295df2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:02.522021 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c502d2d-c8f7-45f0-b505-54d356295df2 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:02.525656 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 514/1023] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:43:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:02.529249 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd066d5a-8eeb-4af9-bc72-ad7aa8ff0da7 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:02.630849 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd066d5a-8eeb-4af9-bc72-ad7aa8ff0da7 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:02.654075 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:02.666761 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f036f8-01d4-4459-ac06-9fec8af70ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:02.667364 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f036f8-01d4-4459-ac06-9fec8af70ebc None admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:02.667640 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f036f8-01d4-4459-ac06-9fec8af70ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:02.667908 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f036f8-01d4-4459-ac06-9fec8af70ebc None admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:02.668550 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f036f8-01d4-4459-ac06-9fec8af70ebc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:02.670000 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f036f8-01d4-4459-ac06-9fec8af70ebc None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:02.701339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 510/1024] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 7 10:43:02 2022] POST /identity/v3/users => generated 285 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:43:03.193797 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56914d6-146a-437d-a00e-3034b9e3faae None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:03.194181 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56914d6-146a-437d-a00e-3034b9e3faae None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:03.194400 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56914d6-146a-437d-a00e-3034b9e3faae None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:03.195727 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 515/1025] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:43:03.200851 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add6414-b265-4dc7-adfe-45560a16c9ac None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:03.201135 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add6414-b265-4dc7-adfe-45560a16c9ac None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:03.201445 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add6414-b265-4dc7-adfe-45560a16c9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:03.220222 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-9add6414-b265-4dc7-adfe-45560a16c9ac None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:43:03.221426 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-9add6414-b265-4dc7-adfe-45560a16c9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:43:03.288967 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 511/1026] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:43:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:43:03.310912 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56914d6-146a-437d-a00e-3034b9e3faae None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:03.414849 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:03.423198 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56914d6-146a-437d-a00e-3034b9e3faae None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:03.457808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b3bed-8a53-4408-80c7-32d50daa982f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:03.458355 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b3bed-8a53-4408-80c7-32d50daa982f None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:03.458628 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b3bed-8a53-4408-80c7-32d50daa982f None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:03.458894 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b3bed-8a53-4408-80c7-32d50daa982f None admin] PATH_INFO: `/v3/services/image` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:03.459475 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b3bed-8a53-4408-80c7-32d50daa982f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:03.460818 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b3bed-8a53-4408-80c7-32d50daa982f None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:03.470411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-f98b3bed-8a53-4408-80c7-32d50daa982f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 10:43:03.470411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:43:03.470411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 10:43:03.470411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 10:43:03.470411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 10:43:03.470411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 10:43:03.470411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 10:43:03.470411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:43:03.470411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 10:43:03.470411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:43:03.470411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 10:43:03.470411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:43:03.470411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:43:03.470411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:43:03.470411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:43:03.470411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:43:03.470411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:43:03.471406 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:43:03.471406 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:43:03.471406 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:43:03.471406 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:43:03.471406 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:43:03.471406 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:43:03.471406 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 10:43:03.471406 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 10:43:03.471406 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 10:43:03.471406 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 10:43:03.471406 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:43:03.471406 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:43:03.471406 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:43:03.471406 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:43:03.471406 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:43:03.471406 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:43:03.472247 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:43:03.472247 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:43:03.472247 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:43:03.472247 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:43:03.472247 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:43:03.472247 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:43:03.472247 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:43:03.472247 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:43:03.472247 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:43:03.472247 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:43:03.472247 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 10:43:03.472247 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:43:03.472247 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 10:43:03.472247 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:43:03.477643 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 516/1027] 10.222.0.27 () {56 vars in 1105 bytes} [Sun Aug 7 10:43:03 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:43:03.480087 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add6414-b265-4dc7-adfe-45560a16c9ac None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:03.581973 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add6414-b265-4dc7-adfe-45560a16c9ac None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:03.591416 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:03.617710 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bcdc1e-9ed2-4252-85cd-62ed669b7a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:03.618307 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcdc1e-9ed2-4252-85cd-62ed669b7a43 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:03.618580 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcdc1e-9ed2-4252-85cd-62ed669b7a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:03.618843 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcdc1e-9ed2-4252-85cd-62ed669b7a43 None admin] PATH_INFO: `/v3/services` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:03.619463 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bcdc1e-9ed2-4252-85cd-62ed669b7a43 None admin] RBAC: Adding query filter params (name=image) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:03.619761 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bcdc1e-9ed2-4252-85cd-62ed669b7a43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:03.621396 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bcdc1e-9ed2-4252-85cd-62ed669b7a43 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:03.631161 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 512/1028] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:43:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:03.632215 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b3bed-8a53-4408-80c7-32d50daa982f None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:03.731510 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b3bed-8a53-4408-80c7-32d50daa982f None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:03.772684 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb68c5-0171-437b-87c0-1c19cf65addd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:03.773294 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb68c5-0171-437b-87c0-1c19cf65addd None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:03.773587 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb68c5-0171-437b-87c0-1c19cf65addd None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:03.773850 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb68c5-0171-437b-87c0-1c19cf65addd None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:03.774504 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb68c5-0171-437b-87c0-1c19cf65addd None admin] RBAC: Adding query filter params (type=image) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:03.774805 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb68c5-0171-437b-87c0-1c19cf65addd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:03.776144 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb68c5-0171-437b-87c0-1c19cf65addd None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:03.786721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 517/1029] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:43:03 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:43:03.787534 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bcdc1e-9ed2-4252-85cd-62ed669b7a43 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:03.888249 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bcdc1e-9ed2-4252-85cd-62ed669b7a43 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:03.910777 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b3cd3-48b2-4673-b85a-f0ce5a4f3a9f None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:03.911045 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b3cd3-48b2-4673-b85a-f0ce5a4f3a9f None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:03.911306 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b3cd3-48b2-4673-b85a-f0ce5a4f3a9f None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:03.912768 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 518/1030] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 10:43:03.917500 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993e8bc-bfc4-41ad-8866-aa13609cfd88 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:03.917780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993e8bc-bfc4-41ad-8866-aa13609cfd88 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:03.918049 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993e8bc-bfc4-41ad-8866-aa13609cfd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:03.927643 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83e35a-62e0-4966-9c38-f60d0349fbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:03.928242 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83e35a-62e0-4966-9c38-f60d0349fbfe None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:03.928516 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83e35a-62e0-4966-9c38-f60d0349fbfe None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:03.928784 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83e35a-62e0-4966-9c38-f60d0349fbfe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:03.929510 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83e35a-62e0-4966-9c38-f60d0349fbfe None admin] RBAC: Adding query filter params (interface=public, service_id=a83ee398d0a945b9bd0457848b79020f, region_id=RegionOne) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:03.929813 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83e35a-62e0-4966-9c38-f60d0349fbfe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:03.931169 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83e35a-62e0-4966-9c38-f60d0349fbfe None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:03.940739 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 513/1031] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Aug 7 10:43:03 2022] GET /identity/v3/endpoints?service_id=a83ee398d0a945b9bd0457848b79020f&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:43:03.940929 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-d993e8bc-bfc4-41ad-8866-aa13609cfd88 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:43:03.940929 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-d993e8bc-bfc4-41ad-8866-aa13609cfd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:43:03.941588 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83e35a-62e0-4966-9c38-f60d0349fbfe None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:03.956796 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:03.977991 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:04.010609 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 519/1032] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:43:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 10:43:04.035246 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993e8bc-bfc4-41ad-8866-aa13609cfd88 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:04.053840 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83e35a-62e0-4966-9c38-f60d0349fbfe None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:04.102240 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd246e1d-c1cb-4588-aba9-cf850514a7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:04.103248 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd246e1d-c1cb-4588-aba9-cf850514a7a5 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:04.103738 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd246e1d-c1cb-4588-aba9-cf850514a7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:04.104071 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd246e1d-c1cb-4588-aba9-cf850514a7a5 None admin] PATH_INFO: `/v3/services` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:04.104688 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd246e1d-c1cb-4588-aba9-cf850514a7a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:04.106082 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd246e1d-c1cb-4588-aba9-cf850514a7a5 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:04.114577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 514/1033] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Aug 7 10:43:03 2022] GET /identity/v3/services => generated 1957 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 10:43:04.153177 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993e8bc-bfc4-41ad-8866-aa13609cfd88 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:04.191115 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696c3ab-2b11-4556-9cc1-ed840a5990cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:04.192009 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696c3ab-2b11-4556-9cc1-ed840a5990cf None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:04.192435 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696c3ab-2b11-4556-9cc1-ed840a5990cf None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:04.192878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696c3ab-2b11-4556-9cc1-ed840a5990cf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:04.205409 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696c3ab-2b11-4556-9cc1-ed840a5990cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:43:04.210453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-c696c3ab-2b11-4556-9cc1-ed840a5990cf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 10:43:04.210453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:43:04.210453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:43:04.210453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:43:04.210453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:43:04.210453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:43:04.210453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:43:04.210453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:43:04.210453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:43:04.210453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:43:04.210453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:43:04.210453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:43:04.210453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:43:04.210453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:43:04.210453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:43:04.210453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:43:04.211632 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:43:04.211632 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:43:04.211632 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:43:04.211632 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:43:04.211632 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:43:04.211632 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:43:04.211632 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:43:04.211632 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:43:04.211632 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:43:04.211632 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:43:04.211632 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:43:04.211632 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:43:04.211632 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:43:04.211632 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:43:04.211632 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:43:04.211632 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:43:04.212685 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:43:04.212685 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:43:04.212685 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:43:04.212685 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:43:04.212685 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:43:04.212685 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:43:04.212685 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:43:04.212685 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:43:04.212685 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:43:04.212685 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:43:04.212685 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 10:43:04.212685 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:43:04.214864 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 520/1034] 10.222.0.27 () {56 vars in 1120 bytes} [Sun Aug 7 10:43:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:43:04.221582 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd246e1d-c1cb-4588-aba9-cf850514a7a5 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:04.322690 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:04.326796 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd246e1d-c1cb-4588-aba9-cf850514a7a5 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:04.366171 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ab404-fe71-42f7-9356-29b35848b79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:04.366781 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ab404-fe71-42f7-9356-29b35848b79a None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:04.367056 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ab404-fe71-42f7-9356-29b35848b79a None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:04.367325 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ab404-fe71-42f7-9356-29b35848b79a None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:04.367990 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ab404-fe71-42f7-9356-29b35848b79a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:04.368290 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ab404-fe71-42f7-9356-29b35848b79a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:04.369683 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ab404-fe71-42f7-9356-29b35848b79a None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:04.379187 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 515/1035] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Aug 7 10:43:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:43:04.384835 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696c3ab-2b11-4556-9cc1-ed840a5990cf None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:04.403952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:04.497846 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696c3ab-2b11-4556-9cc1-ed840a5990cf None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:04.532041 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01e689-96da-4ec8-899b-1a28358069ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:04.532663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01e689-96da-4ec8-899b-1a28358069ed None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:04.532939 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01e689-96da-4ec8-899b-1a28358069ed None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:04.533211 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01e689-96da-4ec8-899b-1a28358069ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:04.543600 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01e689-96da-4ec8-899b-1a28358069ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:04.545027 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01e689-96da-4ec8-899b-1a28358069ed None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:04.560365 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-fd01e689-96da-4ec8-899b-1a28358069ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:43:04.560365 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:43:04.560365 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:43:04.560365 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:43:04.560365 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:43:04.560365 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:43:04.560365 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:43:04.560365 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:43:04.560365 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:43:04.560365 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:43:04.560365 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:43:04.560365 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:43:04.560365 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:43:04.560365 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:43:04.560365 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:43:04.560365 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:43:04.561374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:43:04.561374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:43:04.561374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:43:04.561374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:43:04.561374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:43:04.561374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:43:04.561374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:43:04.561374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:43:04.561374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:43:04.561374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:43:04.561374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:43:04.561374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:43:04.561374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:43:04.561374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:43:04.561374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:43:04.561374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:43:04.561374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:43:04.562312 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:43:04.562312 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:43:04.562312 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:43:04.565384 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 521/1036] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:43:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:43:04.567821 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ab404-fe71-42f7-9356-29b35848b79a None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:04.673049 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ab404-fe71-42f7-9356-29b35848b79a None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:04.706704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f524864-a234-4feb-afd6-6503ede9fade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:04.707305 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f524864-a234-4feb-afd6-6503ede9fade None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:04.707576 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f524864-a234-4feb-afd6-6503ede9fade None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:04.707838 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f524864-a234-4feb-afd6-6503ede9fade None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:04.708474 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f524864-a234-4feb-afd6-6503ede9fade None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:04.708770 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f524864-a234-4feb-afd6-6503ede9fade None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:04.710162 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f524864-a234-4feb-afd6-6503ede9fade None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:04.732000 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 516/1037] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:43:04.733910 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01e689-96da-4ec8-899b-1a28358069ed None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:04.797620 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361ed78-f3cc-4ebc-998a-9990e4b67131 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:04.797959 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361ed78-f3cc-4ebc-998a-9990e4b67131 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:04.798176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361ed78-f3cc-4ebc-998a-9990e4b67131 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:04.799528 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 517/1038] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:43:04.801095 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:04.804672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaf440-5c5b-42c6-91ee-cc4d07f58687 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:04.805164 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaf440-5c5b-42c6-91ee-cc4d07f58687 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:04.805867 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaf440-5c5b-42c6-91ee-cc4d07f58687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:04.829545 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-dcaaf440-5c5b-42c6-91ee-cc4d07f58687 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:43:04.831495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-dcaaf440-5c5b-42c6-91ee-cc4d07f58687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:43:04.842104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01e689-96da-4ec8-899b-1a28358069ed None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:04.852225 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:04.878452 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c8aa4-44ee-4d65-97c0-614697f02791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:04.879072 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c8aa4-44ee-4d65-97c0-614697f02791 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:04.879346 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c8aa4-44ee-4d65-97c0-614697f02791 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:04.879609 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c8aa4-44ee-4d65-97c0-614697f02791 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:04.887462 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c8aa4-44ee-4d65-97c0-614697f02791 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:04.888992 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c8aa4-44ee-4d65-97c0-614697f02791 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:04.900354 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-ee0c8aa4-44ee-4d65-97c0-614697f02791 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 10:43:04.900354 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:43:04.900354 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:43:04.900354 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:43:04.900354 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:43:04.900354 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:43:04.900354 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:43:04.900354 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:43:04.900354 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:43:04.900354 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:43:04.900354 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:43:04.900354 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:43:04.900354 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:43:04.900354 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:43:04.900354 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:43:04.900354 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:43:04.901347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:43:04.901347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:43:04.901347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:43:04.901347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:43:04.901347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:43:04.901347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:43:04.901347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:43:04.901347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:43:04.901347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:43:04.901347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:43:04.901347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:43:04.901347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:43:04.901347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:43:04.901347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:43:04.901347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:43:04.901347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:43:04.901347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:43:04.901347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:43:04.902302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:43:04.902302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:43:04.902302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:43:04.902302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:43:04.902302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:43:04.902302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:43:04.902302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:43:04.902302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:43:04.902302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 10:43:04.902302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:43:04.902302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 522/1039] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Aug 7 10:43:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:43:04.907249 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c8aa4-44ee-4d65-97c0-614697f02791 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:04.908882 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 518/1040] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:43:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:43:04.932376 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaaf440-5c5b-42c6-91ee-cc4d07f58687 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:05.021368 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c8aa4-44ee-4d65-97c0-614697f02791 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:05.035361 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaaf440-5c5b-42c6-91ee-cc4d07f58687 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:05.046095 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:05.060589 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b441a7-a721-48fd-ab97-df303fe50fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:05.061293 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b441a7-a721-48fd-ab97-df303fe50fda None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:05.061605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b441a7-a721-48fd-ab97-df303fe50fda None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:05.061879 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b441a7-a721-48fd-ab97-df303fe50fda None admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:05.062616 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b441a7-a721-48fd-ab97-df303fe50fda None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:05.063461 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b441a7-a721-48fd-ab97-df303fe50fda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:05.065114 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b441a7-a721-48fd-ab97-df303fe50fda None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:05.078042 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f3118-3672-4877-83bc-5bb103ed6dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:05.079514 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f3118-3672-4877-83bc-5bb103ed6dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:05.079862 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f3118-3672-4877-83bc-5bb103ed6dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:05.080194 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f3118-3672-4877-83bc-5bb103ed6dc7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:05.090524 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 523/1041] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Aug 7 10:43:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:43:05.091924 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b441a7-a721-48fd-ab97-df303fe50fda None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:05.098212 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f3118-3672-4877-83bc-5bb103ed6dc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:43:05.103041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-866f3118-3672-4877-83bc-5bb103ed6dc7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:43:05.103041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:43:05.103041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:43:05.103041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:43:05.103041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:43:05.103041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:43:05.103041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:43:05.103041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:43:05.103041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:43:05.103041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:43:05.103041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:43:05.103041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:43:05.103041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:43:05.103041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:43:05.103041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:43:05.103041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:43:05.104280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:43:05.104280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:43:05.104280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:43:05.104280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:43:05.104280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:43:05.104280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:43:05.104280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:43:05.104280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:43:05.104280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:43:05.104280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:43:05.104280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:43:05.104280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:43:05.104280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:43:05.104280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:43:05.104280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:43:05.104280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:43:05.105444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:43:05.105444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:43:05.105444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:43:05.105444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:43:05.105444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:43:05.105444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:43:05.105444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:43:05.105444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:43:05.105444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:43:05.105444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:43:05.105444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:43:05.105444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:43:05.109625 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 519/1042] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:43:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:43:05.111750 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f3118-3672-4877-83bc-5bb103ed6dc7 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:05.127585 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:05.197337 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b441a7-a721-48fd-ab97-df303fe50fda None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:05.218144 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f3118-3672-4877-83bc-5bb103ed6dc7 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:05.234931 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2ee86-2610-4ca3-a350-ef97170327ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:05.235694 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2ee86-2610-4ca3-a350-ef97170327ce None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:05.236096 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2ee86-2610-4ca3-a350-ef97170327ce None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:05.236440 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2ee86-2610-4ca3-a350-ef97170327ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:05.255394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def698ff-81f4-42b4-b924-545067ef2db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:05.256030 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def698ff-81f4-42b4-b924-545067ef2db7 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:05.256310 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def698ff-81f4-42b4-b924-545067ef2db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:05.256571 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def698ff-81f4-42b4-b924-545067ef2db7 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:05.257262 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def698ff-81f4-42b4-b924-545067ef2db7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:05.257598 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def698ff-81f4-42b4-b924-545067ef2db7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:05.258955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def698ff-81f4-42b4-b924-545067ef2db7 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:05.267391 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 520/1043] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:43:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:43:05.272822 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def698ff-81f4-42b4-b924-545067ef2db7 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:05.290908 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:05.310771 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2ee86-2610-4ca3-a350-ef97170327ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:05.312280 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2ee86-2610-4ca3-a350-ef97170327ce None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:05.359427 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:05.387790 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def698ff-81f4-42b4-b924-545067ef2db7 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:05.425560 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831710e-5229-4eff-8225-6ca3ed401fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:05.426183 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831710e-5229-4eff-8225-6ca3ed401fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:05.426461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831710e-5229-4eff-8225-6ca3ed401fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:05.426718 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831710e-5229-4eff-8225-6ca3ed401fb9 None admin] PATH_INFO: `/v3/users/bc2eb6bcdc304551bdc331f3576f65ad` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:05.442263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831710e-5229-4eff-8225-6ca3ed401fb9 None admin] RBAC: Authorizing `identity:get_user(user_id=bc2eb6bcdc304551bdc331f3576f65ad)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:05.443915 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831710e-5229-4eff-8225-6ca3ed401fb9 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:05.451022 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 521/1044] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:43:05 2022] GET /identity/v3/users/bc2eb6bcdc304551bdc331f3576f65ad => generated 285 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:43:05.451164 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 524/1045] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:43:05 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 10:43:05.451898 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831710e-5229-4eff-8225-6ca3ed401fb9 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:05.452621 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2ee86-2610-4ca3-a350-ef97170327ce None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:05.539938 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:05.554699 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831710e-5229-4eff-8225-6ca3ed401fb9 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:05.561271 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2ee86-2610-4ca3-a350-ef97170327ce None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:05.589921 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:05.595515 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6faaaa-a96e-4379-b348-258c41b2b135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:05.596182 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6faaaa-a96e-4379-b348-258c41b2b135 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:05.596429 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6faaaa-a96e-4379-b348-258c41b2b135 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:05.596700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6faaaa-a96e-4379-b348-258c41b2b135 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:05.599471 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2eb98-f323-4a5c-bdbb-b812ffe275f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:05.599965 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2eb98-f323-4a5c-bdbb-b812ffe275f5 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:05.600241 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2eb98-f323-4a5c-bdbb-b812ffe275f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:05.600510 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2eb98-f323-4a5c-bdbb-b812ffe275f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:05.606739 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6faaaa-a96e-4379-b348-258c41b2b135 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:05.608202 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6faaaa-a96e-4379-b348-258c41b2b135 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:05.623127 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-2f6faaaa-a96e-4379-b348-258c41b2b135 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:43:05.623127 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:43:05.623127 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:43:05.623127 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:43:05.623127 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:43:05.623127 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:43:05.623127 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:43:05.623127 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:43:05.623127 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:43:05.623127 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:43:05.623127 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:43:05.623127 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:43:05.623127 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:43:05.623127 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:43:05.623127 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:43:05.623127 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:43:05.624077 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:43:05.624077 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:43:05.624077 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:43:05.624077 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:43:05.624077 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:43:05.624077 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:43:05.624077 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:43:05.624077 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:43:05.624077 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:43:05.624077 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:43:05.624077 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:43:05.624077 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:43:05.624077 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:43:05.624077 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:43:05.624077 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:43:05.624077 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:43:05.624077 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:43:05.625418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:43:05.625418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:43:05.625418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:43:05.625418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 522/1046] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:43:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:43:05.629897 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6faaaa-a96e-4379-b348-258c41b2b135 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:05.677059 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2eb98-f323-4a5c-bdbb-b812ffe275f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:05.678751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2eb98-f323-4a5c-bdbb-b812ffe275f5 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:05.730451 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6faaaa-a96e-4379-b348-258c41b2b135 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:05.762790 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:05.767641 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86dc5f-4b22-4f92-8a73-a01fd1885459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:05.768250 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86dc5f-4b22-4f92-8a73-a01fd1885459 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:05.768528 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86dc5f-4b22-4f92-8a73-a01fd1885459 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:05.768860 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86dc5f-4b22-4f92-8a73-a01fd1885459 None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:05.769546 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86dc5f-4b22-4f92-8a73-a01fd1885459 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:05.769852 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86dc5f-4b22-4f92-8a73-a01fd1885459 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:05.771217 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86dc5f-4b22-4f92-8a73-a01fd1885459 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:05.783730 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 523/1047] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:43:05.790148 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 525/1048] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:43:05 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 10:43:05.790309 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86dc5f-4b22-4f92-8a73-a01fd1885459 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:05.791053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2eb98-f323-4a5c-bdbb-b812ffe275f5 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:05.834595 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:05.891117 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86dc5f-4b22-4f92-8a73-a01fd1885459 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:05.897346 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2eb98-f323-4a5c-bdbb-b812ffe275f5 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:05.928962 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2444e-f39c-44a1-9999-8598e0a72eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:05.929615 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2444e-f39c-44a1-9999-8598e0a72eee None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:05.929886 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2444e-f39c-44a1-9999-8598e0a72eee None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:05.930149 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2444e-f39c-44a1-9999-8598e0a72eee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:05.933170 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1da87-4f4f-4818-95eb-c9d1f8e79d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:05.933820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1da87-4f4f-4818-95eb-c9d1f8e79d4a None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:05.934098 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1da87-4f4f-4818-95eb-c9d1f8e79d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:05.934366 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1da87-4f4f-4818-95eb-c9d1f8e79d4a None admin] PATH_INFO: `/v3/projects/6b2d2eaf9cdd49e7871435856d504020` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:05.935483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1da87-4f4f-4818-95eb-c9d1f8e79d4a None admin] RBAC: Authorizing `identity:get_project(project_id=6b2d2eaf9cdd49e7871435856d504020)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:05.936719 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2444e-f39c-44a1-9999-8598e0a72eee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:05.936900 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1da87-4f4f-4818-95eb-c9d1f8e79d4a None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:05.938706 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2444e-f39c-44a1-9999-8598e0a72eee None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:05.944892 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 526/1049] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:43:05 2022] GET /identity/v3/projects/6b2d2eaf9cdd49e7871435856d504020 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:05.945793 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1da87-4f4f-4818-95eb-c9d1f8e79d4a None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:05.957111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-73f2444e-f39c-44a1-9999-8598e0a72eee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:43:05.957111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:43:05.957111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:43:05.957111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:43:05.957111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:43:05.957111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:43:05.957111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:43:05.957111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:43:05.957111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:43:05.957111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:43:05.957111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:43:05.957111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:43:05.957111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:43:05.957111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:43:05.957111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:43:05.958247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:43:05.958247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:43:05.958247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:43:05.958247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:43:05.958247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:43:05.958247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:43:05.958247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:43:05.958247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:43:05.958247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:43:05.958247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:43:05.958247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:43:05.958247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:43:05.958247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:43:05.958247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:43:05.958247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:43:05.958247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:43:05.958247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:43:05.959183 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:43:05.959183 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:43:05.959183 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:43:05.959183 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:43:05.959183 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:43:05.959183 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:43:05.959183 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:43:05.959183 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:43:05.959183 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 524/1050] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:43:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:43:05.963958 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2444e-f39c-44a1-9999-8598e0a72eee None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:06.009430 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:06.062111 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1da87-4f4f-4818-95eb-c9d1f8e79d4a None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:06.075827 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2444e-f39c-44a1-9999-8598e0a72eee None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:06.078195 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:06.103294 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f09eb7-e548-40b5-aa1e-b15443868255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:06.104041 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f09eb7-e548-40b5-aa1e-b15443868255 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:06.104386 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f09eb7-e548-40b5-aa1e-b15443868255 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:06.104720 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f09eb7-e548-40b5-aa1e-b15443868255 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:06.105540 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f09eb7-e548-40b5-aa1e-b15443868255 None admin] RBAC: Adding query filter params (role.id=9da6e501237c405ca021a9d9f6173caf, scope.project.id=6b2d2eaf9cdd49e7871435856d504020, user.id=bc2eb6bcdc304551bdc331f3576f65ad) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:06.105906 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f09eb7-e548-40b5-aa1e-b15443868255 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:06.107485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f09eb7-e548-40b5-aa1e-b15443868255 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:06.115041 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 527/1051] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:43:05 2022] GET /identity/v3/role_assignments?user.id=bc2eb6bcdc304551bdc331f3576f65ad&scope.project.id=6b2d2eaf9cdd49e7871435856d504020&role.id=9da6e501237c405ca021a9d9f6173caf => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:43:06.115634 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffa039-9577-400f-8e87-4006072be56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:06.116238 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffa039-9577-400f-8e87-4006072be56b None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:06.116512 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffa039-9577-400f-8e87-4006072be56b None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:06.116779 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffa039-9577-400f-8e87-4006072be56b None admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:06.117510 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffa039-9577-400f-8e87-4006072be56b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:06.117812 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffa039-9577-400f-8e87-4006072be56b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:06.119251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffa039-9577-400f-8e87-4006072be56b None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:06.138013 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 525/1052] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:43:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:43:06.140051 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffa039-9577-400f-8e87-4006072be56b None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:06.140197 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ab10e-46fa-4398-868f-418e27b36724 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:06.140500 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ab10e-46fa-4398-868f-418e27b36724 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:06.140777 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ab10e-46fa-4398-868f-418e27b36724 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:06.142929 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 528/1053] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:43:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:43:06.148541 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7394d8-9e7c-4dd8-a51e-cf9e989526a8 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:06.148967 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7394d8-9e7c-4dd8-a51e-cf9e989526a8 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:06.149367 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7394d8-9e7c-4dd8-a51e-cf9e989526a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:06.168209 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-ea7394d8-9e7c-4dd8-a51e-cf9e989526a8 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:43:06.169567 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-ea7394d8-9e7c-4dd8-a51e-cf9e989526a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:43:06.251695 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 529/1054] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:43:06 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 10:43:06.257979 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffa039-9577-400f-8e87-4006072be56b None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:06.274833 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7394d8-9e7c-4dd8-a51e-cf9e989526a8 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:06.296028 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a9c8e-e533-465e-80a2-01afe5e93d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:06.296780 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a9c8e-e533-465e-80a2-01afe5e93d48 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:06.297162 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a9c8e-e533-465e-80a2-01afe5e93d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:06.297503 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a9c8e-e533-465e-80a2-01afe5e93d48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:06.298242 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a9c8e-e533-465e-80a2-01afe5e93d48 None admin] RBAC: Adding query filter params (role.id=051acd6762694d9985183bf0b8860800, scope.project.id=62eed8550ae3403f8a75894dbd19cf4a, user.id=f98cb7abbb8942cebb71aa98da80a05a) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:06.298547 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a9c8e-e533-465e-80a2-01afe5e93d48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:06.299997 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a9c8e-e533-465e-80a2-01afe5e93d48 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:06.305587 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 526/1055] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:43:06 2022] GET /identity/v3/role_assignments?user.id=f98cb7abbb8942cebb71aa98da80a05a&scope.project.id=62eed8550ae3403f8a75894dbd19cf4a&role.id=051acd6762694d9985183bf0b8860800 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:43:06.340374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:06.407540 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7394d8-9e7c-4dd8-a51e-cf9e989526a8 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:06.447209 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fe8ae-9a4b-43e6-b405-c0bb71bb276e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:06.447854 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fe8ae-9a4b-43e6-b405-c0bb71bb276e None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:06.448129 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fe8ae-9a4b-43e6-b405-c0bb71bb276e None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:06.448399 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fe8ae-9a4b-43e6-b405-c0bb71bb276e None admin] PATH_INFO: `/v3/services/image` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:06.448990 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17fe8ae-9a4b-43e6-b405-c0bb71bb276e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:06.450392 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17fe8ae-9a4b-43e6-b405-c0bb71bb276e None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:06.460688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-c17fe8ae-9a4b-43e6-b405-c0bb71bb276e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 10:43:06.460688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:43:06.460688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 10:43:06.460688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 10:43:06.460688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 10:43:06.460688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 10:43:06.460688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 10:43:06.460688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:43:06.460688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 10:43:06.460688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:43:06.460688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 10:43:06.460688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:43:06.460688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:43:06.460688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:43:06.460688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:43:06.460688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:43:06.460688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:43:06.462766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:43:06.462766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:43:06.462766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:43:06.462766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:43:06.462766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:43:06.462766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:43:06.462766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 10:43:06.462766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 10:43:06.462766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 10:43:06.462766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 10:43:06.462766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:43:06.462766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:43:06.462766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:43:06.462766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:43:06.462766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:43:06.462766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:43:06.463616 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:43:06.463616 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:43:06.463616 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:43:06.463616 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:43:06.463616 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:43:06.463616 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:43:06.463616 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:43:06.463616 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:43:06.463616 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:43:06.463616 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:43:06.463616 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 10:43:06.463616 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:43:06.463616 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 10:43:06.463616 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:43:06.463616 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 530/1056] 10.222.0.27 () {56 vars in 1105 bytes} [Sun Aug 7 10:43:06 2022] GET /identity/v3/services/image => generated 86 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:43:06.470995 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a9c8e-e533-465e-80a2-01afe5e93d48 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:06.502443 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:06.579741 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a9c8e-e533-465e-80a2-01afe5e93d48 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:06.613751 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8652462-a893-4fa4-a583-a1505e9e9f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:06.614357 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8652462-a893-4fa4-a583-a1505e9e9f0f None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:06.614697 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8652462-a893-4fa4-a583-a1505e9e9f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:06.614963 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8652462-a893-4fa4-a583-a1505e9e9f0f None admin] PATH_INFO: `/v3/services` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:06.615645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8652462-a893-4fa4-a583-a1505e9e9f0f None admin] RBAC: Adding query filter params (name=image) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:06.615940 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8652462-a893-4fa4-a583-a1505e9e9f0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:06.617278 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8652462-a893-4fa4-a583-a1505e9e9f0f None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:06.626917 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 527/1057] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:43:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:06.629035 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fe8ae-9a4b-43e6-b405-c0bb71bb276e None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:06.735868 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fe8ae-9a4b-43e6-b405-c0bb71bb276e None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:06.745183 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:06.774380 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d696c-719a-40be-8cf9-640f7b1fd15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:06.775212 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d696c-719a-40be-8cf9-640f7b1fd15f None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:06.775627 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d696c-719a-40be-8cf9-640f7b1fd15f None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:06.776063 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d696c-719a-40be-8cf9-640f7b1fd15f None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:06.776823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d696c-719a-40be-8cf9-640f7b1fd15f None admin] RBAC: Adding query filter params (type=image) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:06.777264 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d696c-719a-40be-8cf9-640f7b1fd15f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:06.778852 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d696c-719a-40be-8cf9-640f7b1fd15f None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:06.785971 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 531/1058] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:43:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:06.791602 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8652462-a893-4fa4-a583-a1505e9e9f0f None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:06.883981 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:06.894565 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8652462-a893-4fa4-a583-a1505e9e9f0f None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:06.927579 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0d190-0504-4abe-bcb1-0e6e1c06d471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:06.928249 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0d190-0504-4abe-bcb1-0e6e1c06d471 None admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:06.928592 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0d190-0504-4abe-bcb1-0e6e1c06d471 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:06.928927 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0d190-0504-4abe-bcb1-0e6e1c06d471 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:06.929676 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc0d190-0504-4abe-bcb1-0e6e1c06d471 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:06.931085 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc0d190-0504-4abe-bcb1-0e6e1c06d471 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:06.950705 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 528/1059] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:43:06 2022] POST /identity/v3/endpoints => generated 327 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 10:43:08.131890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce40374-382f-45c8-b042-df63f0b4d621 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:08.132407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce40374-382f-45c8-b042-df63f0b4d621 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:08.132407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce40374-382f-45c8-b042-df63f0b4d621 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:08.134113 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 532/1060] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:43:08.139006 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24b354-f41a-43bb-9705-495fb1917824 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:08.139404 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24b354-f41a-43bb-9705-495fb1917824 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:08.139548 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24b354-f41a-43bb-9705-495fb1917824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:08.157932 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-9a24b354-f41a-43bb-9705-495fb1917824 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:43:08.159101 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-9a24b354-f41a-43bb-9705-495fb1917824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:43:08.232476 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 529/1061] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:43:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:43:08.254945 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce40374-382f-45c8-b042-df63f0b4d621 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:08.335367 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b99d6-c2be-42c7-8a01-d2aebe4a3f49 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:08.335653 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b99d6-c2be-42c7-8a01-d2aebe4a3f49 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:08.335928 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b99d6-c2be-42c7-8a01-d2aebe4a3f49 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:08.337262 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 530/1062] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:43:08.344618 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b08b14-dc14-4a6e-a199-d3002236ffd6 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:08.344618 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b08b14-dc14-4a6e-a199-d3002236ffd6 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:08.344618 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b08b14-dc14-4a6e-a199-d3002236ffd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:08.360704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-91b08b14-dc14-4a6e-a199-d3002236ffd6 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:43:08.361886 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-91b08b14-dc14-4a6e-a199-d3002236ffd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:43:08.365433 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce40374-382f-45c8-b042-df63f0b4d621 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:08.403738 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a9ab7-a53c-4fbe-9d71-09d0478c8320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:08.404370 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a9ab7-a53c-4fbe-9d71-09d0478c8320 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:08.404653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a9ab7-a53c-4fbe-9d71-09d0478c8320 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:08.404925 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a9ab7-a53c-4fbe-9d71-09d0478c8320 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:08.415770 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a9ab7-a53c-4fbe-9d71-09d0478c8320 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:43:08.420371 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-238a9ab7-a53c-4fbe-9d71-09d0478c8320 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:43:08.420371 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:43:08.420371 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:43:08.420371 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:43:08.420371 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:43:08.420371 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:43:08.420371 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:43:08.420371 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:43:08.420371 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:43:08.420371 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:43:08.420371 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:43:08.420371 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:43:08.420371 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:43:08.420371 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:43:08.420371 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:43:08.420371 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:43:08.421369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:43:08.421369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:43:08.421369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:43:08.421369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:43:08.421369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:43:08.421369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:43:08.421369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:43:08.421369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:43:08.421369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:43:08.421369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:43:08.421369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:43:08.421369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:43:08.421369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:43:08.421369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:43:08.421369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:43:08.421369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:43:08.422759 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:43:08.422759 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:43:08.422759 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:43:08.422759 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:43:08.422759 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:43:08.422759 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:43:08.422759 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:43:08.422759 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:43:08.422759 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:43:08.422759 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:43:08.422759 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:43:08.422759 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:43:08.422759 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 533/1063] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:43:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:43:08.428252 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a9ab7-a53c-4fbe-9d71-09d0478c8320 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:08.435665 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 531/1064] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:43:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 10:43:08.458243 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b08b14-dc14-4a6e-a199-d3002236ffd6 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:08.461667 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:08.469617 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:08.545669 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a9ab7-a53c-4fbe-9d71-09d0478c8320 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:08.565281 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b08b14-dc14-4a6e-a199-d3002236ffd6 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:08.581614 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ab8bc-e6ea-44dd-9898-6da3af554b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:08.582215 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ab8bc-e6ea-44dd-9898-6da3af554b9e None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:08.582489 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ab8bc-e6ea-44dd-9898-6da3af554b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:08.582756 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ab8bc-e6ea-44dd-9898-6da3af554b9e None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:08.583414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ab8bc-e6ea-44dd-9898-6da3af554b9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:08.583711 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ab8bc-e6ea-44dd-9898-6da3af554b9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:08.585118 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ab8bc-e6ea-44dd-9898-6da3af554b9e None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:08.593574 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 534/1065] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:43:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:08.599368 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ab8bc-e6ea-44dd-9898-6da3af554b9e None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:08.600805 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a847b-a331-4b60-84f4-f4e13a15a6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:08.601475 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a847b-a331-4b60-84f4-f4e13a15a6ce None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:08.601748 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a847b-a331-4b60-84f4-f4e13a15a6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:08.602016 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a847b-a331-4b60-84f4-f4e13a15a6ce None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:08.612854 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a847b-a331-4b60-84f4-f4e13a15a6ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:43:08.617522 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-a55a847b-a331-4b60-84f4-f4e13a15a6ce None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 10:43:08.617522 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:43:08.617522 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:43:08.617522 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:43:08.617522 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:43:08.617522 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:43:08.617522 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:43:08.617522 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:43:08.617522 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:43:08.617522 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:43:08.617522 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:43:08.617522 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:43:08.617522 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:43:08.617522 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:43:08.617522 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:43:08.617522 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:43:08.618466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:43:08.618466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:43:08.618466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:43:08.618466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:43:08.618466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:43:08.618466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:43:08.618466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:43:08.618466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:43:08.618466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:43:08.618466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:43:08.618466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:43:08.618466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:43:08.618466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:43:08.618466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:43:08.618466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:43:08.618466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:43:08.619823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:43:08.619823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:43:08.619823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:43:08.619823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:43:08.619823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:43:08.619823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:43:08.619823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:43:08.619823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:43:08.619823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:43:08.619823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:43:08.619823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 10:43:08.619823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:43:08.619823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 532/1066] 10.222.0.27 () {56 vars in 1120 bytes} [Sun Aug 7 10:43:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:43:08.624997 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a847b-a331-4b60-84f4-f4e13a15a6ce None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:08.693465 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:08.698103 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:08.705597 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ab8bc-e6ea-44dd-9898-6da3af554b9e None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:08.736198 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a847b-a331-4b60-84f4-f4e13a15a6ce None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:08.739747 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64b8d4-b834-497d-a9a8-8f38e837c4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:08.740364 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64b8d4-b834-497d-a9a8-8f38e837c4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:08.740655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64b8d4-b834-497d-a9a8-8f38e837c4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:08.740904 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64b8d4-b834-497d-a9a8-8f38e837c4f6 None admin] PATH_INFO: `/v3/users/bc2eb6bcdc304551bdc331f3576f65ad` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:08.742046 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64b8d4-b834-497d-a9a8-8f38e837c4f6 None admin] RBAC: Authorizing `identity:get_user(user_id=bc2eb6bcdc304551bdc331f3576f65ad)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:08.743445 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64b8d4-b834-497d-a9a8-8f38e837c4f6 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:08.745179 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 535/1067] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:43:08 2022] GET /identity/v3/users/bc2eb6bcdc304551bdc331f3576f65ad => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:43:08.751133 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64b8d4-b834-497d-a9a8-8f38e837c4f6 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:08.779186 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bb63b-ca8a-49d2-8a5b-525517d12eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:08.780094 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bb63b-ca8a-49d2-8a5b-525517d12eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:08.780495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bb63b-ca8a-49d2-8a5b-525517d12eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:08.780884 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bb63b-ca8a-49d2-8a5b-525517d12eb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:08.781971 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282bb63b-ca8a-49d2-8a5b-525517d12eb8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:08.782475 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282bb63b-ca8a-49d2-8a5b-525517d12eb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:08.784105 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282bb63b-ca8a-49d2-8a5b-525517d12eb8 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:08.800756 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 533/1068] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Aug 7 10:43:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:43:08.801910 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bb63b-ca8a-49d2-8a5b-525517d12eb8 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:08.862730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64b8d4-b834-497d-a9a8-8f38e837c4f6 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:08.897963 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17346417-45da-47aa-bd1c-1bc65f88454b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:08.898587 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17346417-45da-47aa-bd1c-1bc65f88454b None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:08.898868 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17346417-45da-47aa-bd1c-1bc65f88454b None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:08.899141 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17346417-45da-47aa-bd1c-1bc65f88454b None admin] PATH_INFO: `/v3/projects/6b2d2eaf9cdd49e7871435856d504020` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:08.900274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17346417-45da-47aa-bd1c-1bc65f88454b None admin] RBAC: Authorizing `identity:get_project(project_id=6b2d2eaf9cdd49e7871435856d504020)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:08.901719 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17346417-45da-47aa-bd1c-1bc65f88454b None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:08.903640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 536/1069] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:43:08 2022] GET /identity/v3/projects/6b2d2eaf9cdd49e7871435856d504020 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:43:08.909694 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17346417-45da-47aa-bd1c-1bc65f88454b None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:08.917670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bb63b-ca8a-49d2-8a5b-525517d12eb8 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:08.941051 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:08.948617 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:08.957895 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ee946-86da-460d-9d8c-8b61463a3bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:08.958520 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ee946-86da-460d-9d8c-8b61463a3bce None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:08.958791 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ee946-86da-460d-9d8c-8b61463a3bce None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:08.959058 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ee946-86da-460d-9d8c-8b61463a3bce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:08.970170 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ee946-86da-460d-9d8c-8b61463a3bce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:08.971590 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ee946-86da-460d-9d8c-8b61463a3bce None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:08.986239 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-dd0ee946-86da-460d-9d8c-8b61463a3bce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:43:08.986239 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:43:08.986239 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:43:08.986239 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:43:08.986239 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:43:08.986239 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:43:08.986239 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:43:08.986239 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:43:08.986239 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:43:08.986239 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:43:08.986239 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:43:08.986239 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:43:08.986239 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:43:08.986239 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:43:08.986239 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:43:08.986239 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:43:08.987410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:43:08.987410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:43:08.987410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:43:08.987410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:43:08.987410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:43:08.987410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:43:08.987410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:43:08.987410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:43:08.987410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:43:08.987410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:43:08.987410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:43:08.987410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:43:08.987410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:43:08.987410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:43:08.987410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:43:08.987410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:43:08.987410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:43:08.988702 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:43:08.988702 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:43:08.988702 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:43:08.988702 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 534/1070] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:43:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:43:08.988702 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5e2ad-01a4-4486-871c-eca26ffed4b4 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:08.988702 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5e2ad-01a4-4486-871c-eca26ffed4b4 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:08.989053 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5e2ad-01a4-4486-871c-eca26ffed4b4 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:08.990266 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 535/1071] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:43:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:43:08.994211 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5e2ad-01a4-4486-871c-eca26ffed4b4 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:09.019761 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17346417-45da-47aa-bd1c-1bc65f88454b None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:09.052901 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a43a0-0d5b-4ad3-bab1-6f7640f0a72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:09.053586 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a43a0-0d5b-4ad3-bab1-6f7640f0a72b None admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:09.053854 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a43a0-0d5b-4ad3-bab1-6f7640f0a72b None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:09.054119 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a43a0-0d5b-4ad3-bab1-6f7640f0a72b None admin] PATH_INFO: `/v3/projects/6b2d2eaf9cdd49e7871435856d504020/users/bc2eb6bcdc304551bdc331f3576f65ad/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:09.056019 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a43a0-0d5b-4ad3-bab1-6f7640f0a72b None admin] RBAC: Authorizing `identity:create_grant(project_id=6b2d2eaf9cdd49e7871435856d504020, user_id=bc2eb6bcdc304551bdc331f3576f65ad, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:09.057458 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a43a0-0d5b-4ad3-bab1-6f7640f0a72b None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:09.070564 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 537/1072] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 7 10:43:08 2022] PUT /identity/v3/projects/6b2d2eaf9cdd49e7871435856d504020/users/bc2eb6bcdc304551bdc331f3576f65ad/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 10:43:09.074653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164a423-dbe6-44e4-925b-07bba13c250c None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:09.075122 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164a423-dbe6-44e4-925b-07bba13c250c None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:09.075567 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164a423-dbe6-44e4-925b-07bba13c250c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:09.095323 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-0164a423-dbe6-44e4-925b-07bba13c250c None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:43:09.096553 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-0164a423-dbe6-44e4-925b-07bba13c250c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:43:09.098096 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5e2ad-01a4-4486-871c-eca26ffed4b4 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:09.138195 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec24bc-b5d4-4a8b-ad00-e3e120d1272e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:09.138811 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec24bc-b5d4-4a8b-ad00-e3e120d1272e None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:09.139088 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec24bc-b5d4-4a8b-ad00-e3e120d1272e None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:09.139633 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec24bc-b5d4-4a8b-ad00-e3e120d1272e None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:09.140002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec24bc-b5d4-4a8b-ad00-e3e120d1272e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:09.140305 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec24bc-b5d4-4a8b-ad00-e3e120d1272e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:09.142283 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec24bc-b5d4-4a8b-ad00-e3e120d1272e None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:09.160895 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 536/1073] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:09.162390 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec24bc-b5d4-4a8b-ad00-e3e120d1272e None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:09.182836 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 538/1074] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:43:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:43:09.206193 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164a423-dbe6-44e4-925b-07bba13c250c None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:09.209784 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:09.232197 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:09.282775 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec24bc-b5d4-4a8b-ad00-e3e120d1272e None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:09.316787 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560bdcc-8ce2-48bb-9a66-2f195a497392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:09.317416 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560bdcc-8ce2-48bb-9a66-2f195a497392 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:09.317694 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560bdcc-8ce2-48bb-9a66-2f195a497392 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:09.317964 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560bdcc-8ce2-48bb-9a66-2f195a497392 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:09.319999 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164a423-dbe6-44e4-925b-07bba13c250c None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:09.325073 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4560bdcc-8ce2-48bb-9a66-2f195a497392 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:09.326531 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4560bdcc-8ce2-48bb-9a66-2f195a497392 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:09.341591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-4560bdcc-8ce2-48bb-9a66-2f195a497392 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 10:43:09.341591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:43:09.341591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:43:09.341591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:43:09.341591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:43:09.341591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:43:09.341591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:43:09.341591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:43:09.341591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:43:09.341591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:43:09.341591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:43:09.341591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:43:09.341591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:43:09.341591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:43:09.341591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:43:09.341591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:43:09.342586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:43:09.342586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:43:09.342586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:43:09.342586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:43:09.342586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:43:09.342586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:43:09.342586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:43:09.342586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:43:09.342586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:43:09.342586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:43:09.342586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:43:09.342586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:43:09.342586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:43:09.342586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:43:09.342586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:43:09.342586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:43:09.342586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:43:09.342586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:43:09.343538 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:43:09.343538 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:43:09.343538 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:43:09.343538 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:43:09.343538 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:43:09.343538 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:43:09.343538 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:43:09.343538 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:43:09.343538 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 10:43:09.343538 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:43:09.347618 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 537/1075] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Aug 7 10:43:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:43:09.348887 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560bdcc-8ce2-48bb-9a66-2f195a497392 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:09.363134 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f34d7c-dbe1-47a2-babd-702c0fc08f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:09.363819 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f34d7c-dbe1-47a2-babd-702c0fc08f13 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:09.364088 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f34d7c-dbe1-47a2-babd-702c0fc08f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:09.364359 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f34d7c-dbe1-47a2-babd-702c0fc08f13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:09.434989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f34d7c-dbe1-47a2-babd-702c0fc08f13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:09.436434 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f34d7c-dbe1-47a2-babd-702c0fc08f13 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:09.455564 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:09.459725 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560bdcc-8ce2-48bb-9a66-2f195a497392 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:09.461765 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:09.497078 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11401cbd-0f56-4e4f-8bc2-445d11b9c423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:09.497813 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11401cbd-0f56-4e4f-8bc2-445d11b9c423 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:09.498093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11401cbd-0f56-4e4f-8bc2-445d11b9c423 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:09.498360 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11401cbd-0f56-4e4f-8bc2-445d11b9c423 None admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:09.499090 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11401cbd-0f56-4e4f-8bc2-445d11b9c423 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:09.499392 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11401cbd-0f56-4e4f-8bc2-445d11b9c423 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:09.501454 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11401cbd-0f56-4e4f-8bc2-445d11b9c423 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:09.518730 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 538/1076] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Aug 7 10:43:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:09.524273 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11401cbd-0f56-4e4f-8bc2-445d11b9c423 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:09.554250 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 539/1077] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:43:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 10:43:09.559932 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f34d7c-dbe1-47a2-babd-702c0fc08f13 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:09.632456 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11401cbd-0f56-4e4f-8bc2-445d11b9c423 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:09.663757 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f34d7c-dbe1-47a2-babd-702c0fc08f13 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:09.670309 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c1246-a08f-4a14-8f25-3e1755ee9e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:09.671549 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c1246-a08f-4a14-8f25-3e1755ee9e95 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:09.672001 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c1246-a08f-4a14-8f25-3e1755ee9e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:09.673059 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c1246-a08f-4a14-8f25-3e1755ee9e95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:09.684021 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910c1246-a08f-4a14-8f25-3e1755ee9e95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:09.684609 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:09.685746 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910c1246-a08f-4a14-8f25-3e1755ee9e95 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:09.699565 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d602c5-8c01-4f69-9f6d-4b567c6e5da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:09.700185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d602c5-8c01-4f69-9f6d-4b567c6e5da7 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:09.700457 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d602c5-8c01-4f69-9f6d-4b567c6e5da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:09.700572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-910c1246-a08f-4a14-8f25-3e1755ee9e95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:43:09.700572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:43:09.700572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:43:09.700572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:43:09.700572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:43:09.700572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:43:09.700572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:43:09.700572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:43:09.700572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:43:09.700572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:43:09.700572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:43:09.700572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:43:09.700572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:43:09.700572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:43:09.700572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:43:09.700572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:43:09.701518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:43:09.701518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:43:09.701518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:43:09.701518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:43:09.701518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:43:09.701518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:43:09.701518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:43:09.701518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:43:09.701518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:43:09.701518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:43:09.701518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:43:09.701518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:43:09.701518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:43:09.701518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:43:09.701518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:43:09.701518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:43:09.701518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:43:09.703140 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:43:09.703140 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:43:09.703140 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:43:09.703347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d602c5-8c01-4f69-9f6d-4b567c6e5da7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:09.703419 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 539/1078] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:43:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:43:09.707164 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c1246-a08f-4a14-8f25-3e1755ee9e95 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:09.713143 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d602c5-8c01-4f69-9f6d-4b567c6e5da7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:09.714555 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d602c5-8c01-4f69-9f6d-4b567c6e5da7 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:09.717984 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:09.732656 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-00d602c5-8c01-4f69-9f6d-4b567c6e5da7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:43:09.732656 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:43:09.732656 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:43:09.732656 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:43:09.732656 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:43:09.732656 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:43:09.732656 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:43:09.732656 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:43:09.732656 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:43:09.732656 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:43:09.732656 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:43:09.732656 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:43:09.732656 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:43:09.732656 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:43:09.732656 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:43:09.732656 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:43:09.733688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:43:09.733688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:43:09.733688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:43:09.733688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:43:09.733688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:43:09.733688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:43:09.733688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:43:09.733688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:43:09.733688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:43:09.733688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:43:09.733688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:43:09.733688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:43:09.733688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:43:09.733688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:43:09.733688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:43:09.733688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:43:09.733688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:43:09.734621 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:43:09.734621 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:43:09.734621 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:43:09.734621 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 540/1079] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:43:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:43:09.739535 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d602c5-8c01-4f69-9f6d-4b567c6e5da7 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:09.816373 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c1246-a08f-4a14-8f25-3e1755ee9e95 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:09.852128 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba944c-752d-4d6b-89ca-6c981cd181dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:09.852728 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba944c-752d-4d6b-89ca-6c981cd181dd None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:09.852998 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba944c-752d-4d6b-89ca-6c981cd181dd None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:09.853262 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba944c-752d-4d6b-89ca-6c981cd181dd None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:09.853610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d602c5-8c01-4f69-9f6d-4b567c6e5da7 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:09.853985 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba944c-752d-4d6b-89ca-6c981cd181dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:09.854283 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba944c-752d-4d6b-89ca-6c981cd181dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:09.855663 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba944c-752d-4d6b-89ca-6c981cd181dd None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:09.873243 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 540/1080] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:43:09.874687 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba944c-752d-4d6b-89ca-6c981cd181dd None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:09.888751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22bed0-2fda-4bf5-805f-15487bf78407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:09.889384 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22bed0-2fda-4bf5-805f-15487bf78407 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:09.889659 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22bed0-2fda-4bf5-805f-15487bf78407 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:09.889926 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22bed0-2fda-4bf5-805f-15487bf78407 None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:09.890646 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a22bed0-2fda-4bf5-805f-15487bf78407 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:09.891062 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a22bed0-2fda-4bf5-805f-15487bf78407 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:09.892872 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a22bed0-2fda-4bf5-805f-15487bf78407 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:09.905291 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 541/1081] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:09.951179 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:09.989681 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba944c-752d-4d6b-89ca-6c981cd181dd None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:10.025931 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b43c0-bb7d-4a9e-9b4e-2cb89b03ffb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:10.026570 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b43c0-bb7d-4a9e-9b4e-2cb89b03ffb3 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:10.026840 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b43c0-bb7d-4a9e-9b4e-2cb89b03ffb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:10.027106 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b43c0-bb7d-4a9e-9b4e-2cb89b03ffb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:10.034462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b43c0-bb7d-4a9e-9b4e-2cb89b03ffb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:10.035904 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b43c0-bb7d-4a9e-9b4e-2cb89b03ffb3 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:10.048306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-995b43c0-bb7d-4a9e-9b4e-2cb89b03ffb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:43:10.048306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:43:10.048306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:43:10.048306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:43:10.048306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:43:10.048306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:43:10.048306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:43:10.048306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:43:10.048306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:43:10.048306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:43:10.048306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:43:10.048306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:43:10.048306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:43:10.048306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:43:10.048306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:43:10.049289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:43:10.049289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:43:10.049289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:43:10.049289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:43:10.049289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:43:10.049289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:43:10.049289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:43:10.049289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:43:10.049289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:43:10.049289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:43:10.049289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:43:10.049289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:43:10.049289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:43:10.049289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:43:10.049289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:43:10.049289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:43:10.049289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:43:10.050568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:43:10.050568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:43:10.050568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:43:10.050568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:43:10.050568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:43:10.050568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:43:10.050568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:43:10.050568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:43:10.053784 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 541/1082] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:43:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:43:10.055205 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22bed0-2fda-4bf5-805f-15487bf78407 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:10.092688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:10.167507 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22bed0-2fda-4bf5-805f-15487bf78407 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:10.204425 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5c72e-7764-4520-9208-c732bc45a35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:10.205063 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5c72e-7764-4520-9208-c732bc45a35d None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:10.205284 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5c72e-7764-4520-9208-c732bc45a35d None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:10.205687 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5c72e-7764-4520-9208-c732bc45a35d None admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:10.206371 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5c72e-7764-4520-9208-c732bc45a35d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:10.206668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5c72e-7764-4520-9208-c732bc45a35d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:10.208074 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5c72e-7764-4520-9208-c732bc45a35d None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:10.220020 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 542/1083] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:43:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:43:10.225907 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b43c0-bb7d-4a9e-9b4e-2cb89b03ffb3 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:10.321823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b43c0-bb7d-4a9e-9b4e-2cb89b03ffb3 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:10.348245 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:10.356946 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4029a8d9-7f1d-45ae-9f6c-d9cbbda4935d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:10.357637 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029a8d9-7f1d-45ae-9f6c-d9cbbda4935d None admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:10.357941 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029a8d9-7f1d-45ae-9f6c-d9cbbda4935d None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:10.358213 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4029a8d9-7f1d-45ae-9f6c-d9cbbda4935d None admin] PATH_INFO: `/v3/projects/62eed8550ae3403f8a75894dbd19cf4a/users/f98cb7abbb8942cebb71aa98da80a05a/roles/051acd6762694d9985183bf0b8860800` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:10.360940 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029a8d9-7f1d-45ae-9f6c-d9cbbda4935d None admin] RBAC: Authorizing `identity:create_grant(project_id=62eed8550ae3403f8a75894dbd19cf4a, user_id=f98cb7abbb8942cebb71aa98da80a05a, role_id=051acd6762694d9985183bf0b8860800)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:10.362416 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4029a8d9-7f1d-45ae-9f6c-d9cbbda4935d None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:10.374779 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 542/1084] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 7 10:43:10 2022] PUT /identity/v3/projects/62eed8550ae3403f8a75894dbd19cf4a/users/f98cb7abbb8942cebb71aa98da80a05a/roles/051acd6762694d9985183bf0b8860800 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:43:11.067109 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeea7e0-a1de-4c40-b2c5-a22279ab5803 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:11.067386 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeea7e0-a1de-4c40-b2c5-a22279ab5803 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:11.067652 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeea7e0-a1de-4c40-b2c5-a22279ab5803 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:11.069034 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 543/1085] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:43:11.074246 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4b39a-3631-4be0-b001-02341f38a87f None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:11.074527 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4b39a-3631-4be0-b001-02341f38a87f None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:11.074797 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4b39a-3631-4be0-b001-02341f38a87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:11.092812 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-ecd4b39a-3631-4be0-b001-02341f38a87f None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:43:11.094005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ecd4b39a-3631-4be0-b001-02341f38a87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:43:11.157791 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 543/1086] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:43:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:43:11.180593 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeea7e0-a1de-4c40-b2c5-a22279ab5803 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:11.268666 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:11.278408 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeea7e0-a1de-4c40-b2c5-a22279ab5803 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:11.311857 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e47e7-9c8c-4b77-8395-5792bd5ec7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:11.312467 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e47e7-9c8c-4b77-8395-5792bd5ec7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:11.312745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e47e7-9c8c-4b77-8395-5792bd5ec7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:11.313014 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e47e7-9c8c-4b77-8395-5792bd5ec7e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:11.322877 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e47e7-9c8c-4b77-8395-5792bd5ec7e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:43:11.327432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-242e47e7-9c8c-4b77-8395-5792bd5ec7e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:43:11.327432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:43:11.327432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:43:11.327432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:43:11.327432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:43:11.327432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:43:11.327432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:43:11.327432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:43:11.327432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:43:11.327432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:43:11.327432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:43:11.327432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:43:11.327432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:43:11.327432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:43:11.327432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:43:11.327432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:43:11.328349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:43:11.328349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:43:11.328349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:43:11.328349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:43:11.328349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:43:11.328349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:43:11.328349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:43:11.328349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:43:11.328349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:43:11.328349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:43:11.328349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:43:11.328349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:43:11.328349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:43:11.328349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:43:11.328349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:43:11.328349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:43:11.329240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:43:11.329240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:43:11.329240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:43:11.329240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:43:11.329240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:43:11.329240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:43:11.329240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:43:11.329240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:43:11.329240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:43:11.329240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:43:11.329240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:43:11.329240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:43:11.329240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 544/1087] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:43:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:43:11.334503 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4b39a-3631-4be0-b001-02341f38a87f None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:11.431116 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4b39a-3631-4be0-b001-02341f38a87f None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:11.448487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:11.467183 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623a17b-4513-4fbe-afdb-88a0b0a38555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:11.467786 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623a17b-4513-4fbe-afdb-88a0b0a38555 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:11.468080 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623a17b-4513-4fbe-afdb-88a0b0a38555 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:11.468349 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623a17b-4513-4fbe-afdb-88a0b0a38555 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:11.469016 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623a17b-4513-4fbe-afdb-88a0b0a38555 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:11.469967 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623a17b-4513-4fbe-afdb-88a0b0a38555 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:11.471317 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623a17b-4513-4fbe-afdb-88a0b0a38555 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:11.479416 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 544/1088] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:43:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:11.485069 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e47e7-9c8c-4b77-8395-5792bd5ec7e8 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:11.582024 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e47e7-9c8c-4b77-8395-5792bd5ec7e8 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:11.614902 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d85095-8c21-44cc-85dc-c483b7d770bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:11.615518 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d85095-8c21-44cc-85dc-c483b7d770bf None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:11.615791 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d85095-8c21-44cc-85dc-c483b7d770bf None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:11.616064 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d85095-8c21-44cc-85dc-c483b7d770bf None admin] PATH_INFO: `/v3/users/bc2eb6bcdc304551bdc331f3576f65ad` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:11.617163 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d85095-8c21-44cc-85dc-c483b7d770bf None admin] RBAC: Authorizing `identity:get_user(user_id=bc2eb6bcdc304551bdc331f3576f65ad)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:11.618594 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d85095-8c21-44cc-85dc-c483b7d770bf None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:11.620319 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 545/1089] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:43:11 2022] GET /identity/v3/users/bc2eb6bcdc304551bdc331f3576f65ad => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:43:11.626176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623a17b-4513-4fbe-afdb-88a0b0a38555 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:11.722054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623a17b-4513-4fbe-afdb-88a0b0a38555 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:11.753736 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc56ef8-f382-45a2-9da1-a581a172afd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:11.754327 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc56ef8-f382-45a2-9da1-a581a172afd9 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:11.754621 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc56ef8-f382-45a2-9da1-a581a172afd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:11.754870 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc56ef8-f382-45a2-9da1-a581a172afd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:11.801455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:11.820943 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc56ef8-f382-45a2-9da1-a581a172afd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:11.822417 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc56ef8-f382-45a2-9da1-a581a172afd9 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:11.915946 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 545/1090] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:43:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 10:43:11.921778 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d85095-8c21-44cc-85dc-c483b7d770bf None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:11.943324 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:12.020233 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d85095-8c21-44cc-85dc-c483b7d770bf None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:12.054125 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32a343-cd39-41b8-875d-c1741238dd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:12.054745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32a343-cd39-41b8-875d-c1741238dd65 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:12.055078 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32a343-cd39-41b8-875d-c1741238dd65 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:12.055356 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32a343-cd39-41b8-875d-c1741238dd65 None admin] PATH_INFO: `/v3/projects/6b2d2eaf9cdd49e7871435856d504020` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:12.056457 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32a343-cd39-41b8-875d-c1741238dd65 None admin] RBAC: Authorizing `identity:get_project(project_id=6b2d2eaf9cdd49e7871435856d504020)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:12.057983 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32a343-cd39-41b8-875d-c1741238dd65 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:12.059638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 546/1091] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:43:11 2022] GET /identity/v3/projects/6b2d2eaf9cdd49e7871435856d504020 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:12.065740 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc56ef8-f382-45a2-9da1-a581a172afd9 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:12.142790 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:12.162390 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc56ef8-f382-45a2-9da1-a581a172afd9 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:12.194933 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53989868-feb3-4a0b-9925-e8287592bde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:12.195474 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53989868-feb3-4a0b-9925-e8287592bde9 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:12.195753 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53989868-feb3-4a0b-9925-e8287592bde9 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:12.196022 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53989868-feb3-4a0b-9925-e8287592bde9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:12.196751 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53989868-feb3-4a0b-9925-e8287592bde9 None admin] RBAC: Adding query filter params (role.id=9da6e501237c405ca021a9d9f6173caf, scope.project.id=6b2d2eaf9cdd49e7871435856d504020, user.id=bc2eb6bcdc304551bdc331f3576f65ad) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:12.197055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53989868-feb3-4a0b-9925-e8287592bde9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:12.198547 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53989868-feb3-4a0b-9925-e8287592bde9 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:12.204669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 546/1092] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:43:12 2022] GET /identity/v3/role_assignments?user.id=bc2eb6bcdc304551bdc331f3576f65ad&scope.project.id=6b2d2eaf9cdd49e7871435856d504020&role.id=9da6e501237c405ca021a9d9f6173caf => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:12.360213 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2e0d9-8b7f-41a4-82e5-a5430204fbeb None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:12.360704 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2e0d9-8b7f-41a4-82e5-a5430204fbeb None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:12.360797 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2e0d9-8b7f-41a4-82e5-a5430204fbeb None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:12.362153 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 547/1093] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:43:12.367355 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283fb7f-25ac-48ed-9990-a083e41c5fcc None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:12.367740 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283fb7f-25ac-48ed-9990-a083e41c5fcc None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:12.367894 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283fb7f-25ac-48ed-9990-a083e41c5fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:12.386731 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-4283fb7f-25ac-48ed-9990-a083e41c5fcc None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:43:12.387905 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-4283fb7f-25ac-48ed-9990-a083e41c5fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:43:12.453127 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 547/1094] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:43:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:43:12.475849 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2e0d9-8b7f-41a4-82e5-a5430204fbeb None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:12.563506 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:12.577303 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2e0d9-8b7f-41a4-82e5-a5430204fbeb None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:12.611625 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac83cd-4685-4a05-8935-ec5924a4abd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:12.612249 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac83cd-4685-4a05-8935-ec5924a4abd4 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:12.612524 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac83cd-4685-4a05-8935-ec5924a4abd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:12.612789 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac83cd-4685-4a05-8935-ec5924a4abd4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:12.623028 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac83cd-4685-4a05-8935-ec5924a4abd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:43:12.627655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-d8ac83cd-4685-4a05-8935-ec5924a4abd4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 10:43:12.627655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:43:12.627655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:43:12.627655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:43:12.627655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:43:12.627655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:43:12.627655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:43:12.627655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:43:12.627655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:43:12.627655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:43:12.627655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:43:12.627655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:43:12.627655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:43:12.627655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:43:12.627655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:43:12.627655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:43:12.628843 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:43:12.628843 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:43:12.628843 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:43:12.628843 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:43:12.628843 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:43:12.628843 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:43:12.628843 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:43:12.628843 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:43:12.628843 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:43:12.628843 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:43:12.628843 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:43:12.628843 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:43:12.628843 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:43:12.628843 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:43:12.628843 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:43:12.628843 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:43:12.629750 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:43:12.629750 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:43:12.629750 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:43:12.629750 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:43:12.629750 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:43:12.629750 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:43:12.629750 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:43:12.629750 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:43:12.629750 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:43:12.629750 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:43:12.629750 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 10:43:12.629750 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:43:12.629750 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 548/1095] 10.222.0.27 () {56 vars in 1120 bytes} [Sun Aug 7 10:43:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:43:12.635001 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283fb7f-25ac-48ed-9990-a083e41c5fcc None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:12.708977 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:12.733296 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283fb7f-25ac-48ed-9990-a083e41c5fcc None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:12.766148 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8fdd5-4f24-4ed6-8a82-892bc7c2b3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:12.766741 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8fdd5-4f24-4ed6-8a82-892bc7c2b3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:12.767013 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8fdd5-4f24-4ed6-8a82-892bc7c2b3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:12.767280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8fdd5-4f24-4ed6-8a82-892bc7c2b3e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:12.767932 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8fdd5-4f24-4ed6-8a82-892bc7c2b3e6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:12.768226 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8fdd5-4f24-4ed6-8a82-892bc7c2b3e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:12.769595 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8fdd5-4f24-4ed6-8a82-892bc7c2b3e6 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:12.777156 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 548/1096] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Aug 7 10:43:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:12.783228 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac83cd-4685-4a05-8935-ec5924a4abd4 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:12.880760 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac83cd-4685-4a05-8935-ec5924a4abd4 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:12.915874 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3cc37-aca4-46e6-8002-247b0824362e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:12.916499 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3cc37-aca4-46e6-8002-247b0824362e None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:12.916773 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3cc37-aca4-46e6-8002-247b0824362e None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:12.917044 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3cc37-aca4-46e6-8002-247b0824362e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:12.927149 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3cc37-aca4-46e6-8002-247b0824362e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:12.928808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3cc37-aca4-46e6-8002-247b0824362e None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:12.937421 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:12.944135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-2ba3cc37-aca4-46e6-8002-247b0824362e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:43:12.944135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:43:12.944135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:43:12.944135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:43:12.944135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:43:12.944135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:43:12.944135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:43:12.944135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:43:12.944135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:43:12.944135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:43:12.944135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:43:12.944135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:43:12.944135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:43:12.944135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:43:12.944135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:43:12.944135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:43:12.945344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:43:12.945344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:43:12.945344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:43:12.945344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:43:12.945344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:43:12.945344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:43:12.945344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:43:12.945344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:43:12.945344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:43:12.945344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:43:12.945344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:43:12.945344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:43:12.945344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:43:12.945344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:43:12.945344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:43:12.945344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:43:12.945344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:43:12.946310 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:43:12.946310 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:43:12.946310 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:43:12.946310 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 549/1097] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:43:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:43:12.951206 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8fdd5-4f24-4ed6-8a82-892bc7c2b3e6 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:13.049597 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8fdd5-4f24-4ed6-8a82-892bc7c2b3e6 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:13.082096 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc051180-8fac-4504-8bd0-1d9251af627b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:13.082690 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc051180-8fac-4504-8bd0-1d9251af627b None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:13.082966 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc051180-8fac-4504-8bd0-1d9251af627b None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:13.083234 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc051180-8fac-4504-8bd0-1d9251af627b None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:13.083877 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc051180-8fac-4504-8bd0-1d9251af627b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:13.084199 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc051180-8fac-4504-8bd0-1d9251af627b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:13.085614 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc051180-8fac-4504-8bd0-1d9251af627b None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:13.088041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:13.098338 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 549/1098] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:13.104079 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3cc37-aca4-46e6-8002-247b0824362e None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:13.203974 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3cc37-aca4-46e6-8002-247b0824362e None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:13.241429 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014580bb-0fd0-4e32-933e-6fd6031edcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:13.241429 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014580bb-0fd0-4e32-933e-6fd6031edcf7 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:13.241429 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014580bb-0fd0-4e32-933e-6fd6031edcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:13.241429 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014580bb-0fd0-4e32-933e-6fd6031edcf7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:13.248212 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014580bb-0fd0-4e32-933e-6fd6031edcf7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:13.249708 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014580bb-0fd0-4e32-933e-6fd6031edcf7 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:13.260544 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-014580bb-0fd0-4e32-933e-6fd6031edcf7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 10:43:13.260544 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:43:13.260544 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:43:13.260544 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:43:13.260544 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:43:13.260544 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:43:13.260544 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:43:13.260544 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:43:13.260544 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:43:13.260544 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:43:13.260544 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:43:13.260544 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:43:13.260544 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:43:13.260544 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:43:13.260544 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:43:13.260544 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:43:13.261760 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:43:13.261760 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:43:13.261760 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:43:13.261760 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:43:13.261760 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:43:13.261760 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:43:13.261760 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:43:13.261760 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:43:13.261760 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:43:13.261760 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:43:13.261760 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:43:13.261760 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:43:13.261760 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:43:13.261760 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:43:13.261760 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:43:13.261760 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:43:13.261760 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:43:13.261760 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:43:13.262718 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:43:13.262718 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:43:13.262718 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:43:13.262718 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:43:13.262718 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:43:13.262718 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:43:13.262718 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:43:13.262718 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:43:13.262718 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 10:43:13.262718 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:43:13.262718 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 550/1099] 10.222.0.27 () {56 vars in 1093 bytes} [Sun Aug 7 10:43:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:43:13.268498 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc051180-8fac-4504-8bd0-1d9251af627b None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:13.368769 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc051180-8fac-4504-8bd0-1d9251af627b None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:13.401880 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c68e6-8d39-411b-b2be-5c3b36656c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:13.402474 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c68e6-8d39-411b-b2be-5c3b36656c45 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:13.402749 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c68e6-8d39-411b-b2be-5c3b36656c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:13.403016 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c68e6-8d39-411b-b2be-5c3b36656c45 None admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:13.403735 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c68e6-8d39-411b-b2be-5c3b36656c45 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:13.404032 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c68e6-8d39-411b-b2be-5c3b36656c45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:13.405475 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c68e6-8d39-411b-b2be-5c3b36656c45 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:13.422826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 550/1100] 10.222.0.27 () {56 vars in 1133 bytes} [Sun Aug 7 10:43:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:13.428520 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014580bb-0fd0-4e32-933e-6fd6031edcf7 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:13.486640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:13.528962 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014580bb-0fd0-4e32-933e-6fd6031edcf7 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:13.565702 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f8d5b-4c73-4375-8e91-c9192413fd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:13.566297 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f8d5b-4c73-4375-8e91-c9192413fd11 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:13.566567 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f8d5b-4c73-4375-8e91-c9192413fd11 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:13.566827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f8d5b-4c73-4375-8e91-c9192413fd11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:13.632913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f8d5b-4c73-4375-8e91-c9192413fd11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:13.634371 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f8d5b-4c73-4375-8e91-c9192413fd11 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:13.689359 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:13.731037 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 551/1101] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:43:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 10:43:13.737526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c68e6-8d39-411b-b2be-5c3b36656c45 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:13.790908 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:13.837103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c68e6-8d39-411b-b2be-5c3b36656c45 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:13.870475 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529500d5-423a-4496-87e8-68a4a5e0786b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:13.871341 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529500d5-423a-4496-87e8-68a4a5e0786b None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:13.871613 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529500d5-423a-4496-87e8-68a4a5e0786b None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:13.871872 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529500d5-423a-4496-87e8-68a4a5e0786b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:13.881731 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529500d5-423a-4496-87e8-68a4a5e0786b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:13.883203 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529500d5-423a-4496-87e8-68a4a5e0786b None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:13.897466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-529500d5-423a-4496-87e8-68a4a5e0786b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:43:13.897466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:43:13.897466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:43:13.897466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:43:13.897466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:43:13.897466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:43:13.897466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:43:13.897466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:43:13.897466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:43:13.897466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:43:13.897466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:43:13.897466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:43:13.897466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:43:13.897466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:43:13.897466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:43:13.897466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:43:13.898588 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:43:13.898588 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:43:13.898588 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:43:13.898588 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:43:13.898588 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:43:13.898588 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:43:13.898588 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:43:13.898588 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:43:13.898588 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:43:13.898588 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:43:13.898588 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:43:13.898588 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:43:13.898588 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:43:13.898588 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:43:13.898588 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:43:13.898588 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:43:13.898588 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:43:13.899728 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:43:13.899728 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:43:13.899728 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:43:13.901479 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 551/1102] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:43:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:43:13.904205 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f8d5b-4c73-4375-8e91-c9192413fd11 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:14.004566 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f8d5b-4c73-4375-8e91-c9192413fd11 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:14.038897 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75be84-d80b-45f0-b5e0-1d06712e1437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:14.039524 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75be84-d80b-45f0-b5e0-1d06712e1437 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:14.039798 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75be84-d80b-45f0-b5e0-1d06712e1437 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:14.040065 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75be84-d80b-45f0-b5e0-1d06712e1437 None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:14.040693 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75be84-d80b-45f0-b5e0-1d06712e1437 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:14.040987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75be84-d80b-45f0-b5e0-1d06712e1437 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:14.042503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75be84-d80b-45f0-b5e0-1d06712e1437 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:14.054070 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 552/1103] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:14.059705 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529500d5-423a-4496-87e8-68a4a5e0786b None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:14.155173 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529500d5-423a-4496-87e8-68a4a5e0786b None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:14.162378 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:14.189093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82810364-aafd-47bf-aa15-7b0075449ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:14.189764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82810364-aafd-47bf-aa15-7b0075449ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:14.190043 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82810364-aafd-47bf-aa15-7b0075449ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:14.190313 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82810364-aafd-47bf-aa15-7b0075449ac7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:14.196749 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82810364-aafd-47bf-aa15-7b0075449ac7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:14.198212 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82810364-aafd-47bf-aa15-7b0075449ac7 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:14.208988 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-82810364-aafd-47bf-aa15-7b0075449ac7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:43:14.208988 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:43:14.208988 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:43:14.208988 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:43:14.208988 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:43:14.208988 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:43:14.208988 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:43:14.208988 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:43:14.208988 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:43:14.208988 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:43:14.208988 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:43:14.208988 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:43:14.208988 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:43:14.208988 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:43:14.208988 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:43:14.210041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:43:14.210041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:43:14.210041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:43:14.210041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:43:14.210041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:43:14.210041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:43:14.210041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:43:14.210041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:43:14.210041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:43:14.210041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:43:14.210041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:43:14.210041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:43:14.210041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:43:14.210041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:43:14.210041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:43:14.210041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:43:14.210041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:43:14.215837 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:43:14.215837 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:43:14.215837 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:43:14.215837 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:43:14.215837 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:43:14.215837 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:43:14.215837 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:43:14.215837 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:43:14.215837 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 552/1104] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:43:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:43:14.216377 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75be84-d80b-45f0-b5e0-1d06712e1437 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:14.225245 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26d697-ecee-4bec-af4c-4f1eec94a6aa None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:14.225668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26d697-ecee-4bec-af4c-4f1eec94a6aa None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:14.225938 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26d697-ecee-4bec-af4c-4f1eec94a6aa None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:14.227248 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 553/1105] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 10:43:14.232053 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97255d-a2cb-45d3-b951-99bc1732aa59 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:14.232335 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97255d-a2cb-45d3-b951-99bc1732aa59 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:14.232605 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97255d-a2cb-45d3-b951-99bc1732aa59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:14.241165 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:14.250977 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-8f97255d-a2cb-45d3-b951-99bc1732aa59 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:43:14.252161 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-8f97255d-a2cb-45d3-b951-99bc1732aa59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:43:14.316407 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 554/1106] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:43:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 10:43:14.319496 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75be84-d80b-45f0-b5e0-1d06712e1437 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:14.340445 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97255d-a2cb-45d3-b951-99bc1732aa59 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:14.355727 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c31c2e-10cc-4058-ad47-fa6760bff1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:14.356359 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c31c2e-10cc-4058-ad47-fa6760bff1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:14.356636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c31c2e-10cc-4058-ad47-fa6760bff1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:14.356903 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c31c2e-10cc-4058-ad47-fa6760bff1b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:14.357623 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c31c2e-10cc-4058-ad47-fa6760bff1b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:14.357922 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c31c2e-10cc-4058-ad47-fa6760bff1b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:14.359335 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c31c2e-10cc-4058-ad47-fa6760bff1b5 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:14.372117 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 553/1107] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:43:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:43:14.378038 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c31c2e-10cc-4058-ad47-fa6760bff1b5 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:14.433836 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:14.440716 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97255d-a2cb-45d3-b951-99bc1732aa59 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:14.457375 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:14.475300 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5a9e0-cbef-48d8-bc85-12ddb1ec8468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:14.475913 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5a9e0-cbef-48d8-bc85-12ddb1ec8468 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:14.476187 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5a9e0-cbef-48d8-bc85-12ddb1ec8468 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:14.476454 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5a9e0-cbef-48d8-bc85-12ddb1ec8468 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:14.477016 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c31c2e-10cc-4058-ad47-fa6760bff1b5 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:14.477561 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5a9e0-cbef-48d8-bc85-12ddb1ec8468 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:14.478989 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5a9e0-cbef-48d8-bc85-12ddb1ec8468 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:14.480703 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 555/1108] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:43:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:43:14.486675 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5a9e0-cbef-48d8-bc85-12ddb1ec8468 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:14.513118 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dfc2f6-3039-4718-aec9-40ed2b3588d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:14.513752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfc2f6-3039-4718-aec9-40ed2b3588d1 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:14.514023 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfc2f6-3039-4718-aec9-40ed2b3588d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:14.514291 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfc2f6-3039-4718-aec9-40ed2b3588d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:14.515007 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dfc2f6-3039-4718-aec9-40ed2b3588d1 None admin] RBAC: Adding query filter params (role.id=051acd6762694d9985183bf0b8860800, scope.project.id=62eed8550ae3403f8a75894dbd19cf4a, user.id=f98cb7abbb8942cebb71aa98da80a05a) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:14.515309 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dfc2f6-3039-4718-aec9-40ed2b3588d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:14.516706 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dfc2f6-3039-4718-aec9-40ed2b3588d1 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:14.522832 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 554/1109] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:43:14 2022] GET /identity/v3/role_assignments?user.id=f98cb7abbb8942cebb71aa98da80a05a&scope.project.id=62eed8550ae3403f8a75894dbd19cf4a&role.id=051acd6762694d9985183bf0b8860800 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:43:14.591974 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5a9e0-cbef-48d8-bc85-12ddb1ec8468 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:14.627231 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cd69c-6a9d-4856-a6f5-777162ed517c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:14.627856 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cd69c-6a9d-4856-a6f5-777162ed517c None admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:14.628133 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cd69c-6a9d-4856-a6f5-777162ed517c None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:14.628399 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cd69c-6a9d-4856-a6f5-777162ed517c None admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:14.629059 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34cd69c-6a9d-4856-a6f5-777162ed517c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:14.630531 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34cd69c-6a9d-4856-a6f5-777162ed517c None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:14.653082 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 556/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 7 10:43:14 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 10:43:16.671379 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33dbca-9046-483c-9ebe-424cd92286b3 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:16.671920 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33dbca-9046-483c-9ebe-424cd92286b3 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:16.671920 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33dbca-9046-483c-9ebe-424cd92286b3 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:16.673773 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 555/1111] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:43:16.678739 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aff837-e3d6-413e-9f90-5e0eefd42dea None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:16.679100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aff837-e3d6-413e-9f90-5e0eefd42dea None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:16.679280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aff837-e3d6-413e-9f90-5e0eefd42dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:16.697279 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-91aff837-e3d6-413e-9f90-5e0eefd42dea None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:43:16.698488 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-91aff837-e3d6-413e-9f90-5e0eefd42dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:43:16.712018 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:16.763492 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 557/1112] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:43:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:43:16.785827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33dbca-9046-483c-9ebe-424cd92286b3 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:16.882987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33dbca-9046-483c-9ebe-424cd92286b3 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:16.915322 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745e5dd-8034-4122-989a-ca2874478897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:16.915917 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745e5dd-8034-4122-989a-ca2874478897 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:16.916186 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745e5dd-8034-4122-989a-ca2874478897 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:16.916449 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745e5dd-8034-4122-989a-ca2874478897 None admin] PATH_INFO: `/v3/roles/4269d6d5c6c048728859af681b3610fb` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:16.917831 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745e5dd-8034-4122-989a-ca2874478897 None admin] RBAC: Authorizing `identity:get_role(role_id=4269d6d5c6c048728859af681b3610fb)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:16.919158 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745e5dd-8034-4122-989a-ca2874478897 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:16.920438 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 556/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:43:16 2022] GET /identity/v3/roles/4269d6d5c6c048728859af681b3610fb => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:16.926595 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aff837-e3d6-413e-9f90-5e0eefd42dea None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:17.027161 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aff837-e3d6-413e-9f90-5e0eefd42dea None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:17.061902 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e806d36-da04-4bb5-b982-a877f3157b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:17.062527 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e806d36-da04-4bb5-b982-a877f3157b3e None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:17.062852 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e806d36-da04-4bb5-b982-a877f3157b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:17.063127 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e806d36-da04-4bb5-b982-a877f3157b3e None admin] PATH_INFO: `/v3/users/c4a2d03536dc4522a94c6ad8468c6a1f` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:17.076005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e806d36-da04-4bb5-b982-a877f3157b3e None admin] RBAC: Authorizing `identity:get_user(user_id=c4a2d03536dc4522a94c6ad8468c6a1f)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:17.077464 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e806d36-da04-4bb5-b982-a877f3157b3e None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:17.079186 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 558/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:43:16 2022] GET /identity/v3/users/c4a2d03536dc4522a94c6ad8468c6a1f => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:17.085123 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745e5dd-8034-4122-989a-ca2874478897 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:17.100196 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:17.184677 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745e5dd-8034-4122-989a-ca2874478897 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:17.218578 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aeb99e-6182-46d4-acff-485bd05d9630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:17.219195 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aeb99e-6182-46d4-acff-485bd05d9630 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:17.219469 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aeb99e-6182-46d4-acff-485bd05d9630 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:17.219734 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aeb99e-6182-46d4-acff-485bd05d9630 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:17.284178 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aeb99e-6182-46d4-acff-485bd05d9630 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:17.285620 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aeb99e-6182-46d4-acff-485bd05d9630 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:17.298362 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:17.380884 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 557/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:43:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 10:43:17.386728 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e806d36-da04-4bb5-b982-a877f3157b3e None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:17.397676 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:17.482434 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e806d36-da04-4bb5-b982-a877f3157b3e None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:17.514358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f82ba-6337-428a-aa92-0eea67efd271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:17.514961 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f82ba-6337-428a-aa92-0eea67efd271 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:17.515234 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f82ba-6337-428a-aa92-0eea67efd271 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:17.515499 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f82ba-6337-428a-aa92-0eea67efd271 None admin] PATH_INFO: `/v3/projects/6b2d2eaf9cdd49e7871435856d504020` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:17.517143 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f82ba-6337-428a-aa92-0eea67efd271 None admin] RBAC: Authorizing `identity:get_project(project_id=6b2d2eaf9cdd49e7871435856d504020)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:17.518573 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f82ba-6337-428a-aa92-0eea67efd271 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:17.520165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 559/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:43:17 2022] GET /identity/v3/projects/6b2d2eaf9cdd49e7871435856d504020 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:17.526326 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aeb99e-6182-46d4-acff-485bd05d9630 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:17.620857 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aeb99e-6182-46d4-acff-485bd05d9630 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:17.633629 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:17.654224 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f510987e-6aeb-4196-adcd-afcdbadba379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:17.654806 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510987e-6aeb-4196-adcd-afcdbadba379 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:17.655081 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510987e-6aeb-4196-adcd-afcdbadba379 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:17.655349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f510987e-6aeb-4196-adcd-afcdbadba379 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:17.656060 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510987e-6aeb-4196-adcd-afcdbadba379 None admin] RBAC: Adding query filter params (role.id=4269d6d5c6c048728859af681b3610fb, scope.project.id=6b2d2eaf9cdd49e7871435856d504020, user.id=c4a2d03536dc4522a94c6ad8468c6a1f) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:17.656363 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510987e-6aeb-4196-adcd-afcdbadba379 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:17.658496 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f510987e-6aeb-4196-adcd-afcdbadba379 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:17.663644 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 558/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:43:17 2022] GET /identity/v3/role_assignments?user.id=c4a2d03536dc4522a94c6ad8468c6a1f&scope.project.id=6b2d2eaf9cdd49e7871435856d504020&role.id=4269d6d5c6c048728859af681b3610fb => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:19.611250 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dfef9-4eec-4d0b-8760-999261c940f9 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:19.611751 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dfef9-4eec-4d0b-8760-999261c940f9 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:19.611751 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dfef9-4eec-4d0b-8760-999261c940f9 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:19.613063 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 560/1118] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:43:19.618181 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd9353-caf8-4deb-a648-01563167e8cd None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:19.618551 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd9353-caf8-4deb-a648-01563167e8cd None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:19.618719 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd9353-caf8-4deb-a648-01563167e8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:19.636918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-5ddd9353-caf8-4deb-a648-01563167e8cd None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:43:19.638098 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-5ddd9353-caf8-4deb-a648-01563167e8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:43:19.702022 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 559/1119] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:43:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:43:19.723766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dfef9-4eec-4d0b-8760-999261c940f9 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:19.799008 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:19.825181 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dfef9-4eec-4d0b-8760-999261c940f9 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:19.861688 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f49d09-f0eb-45bd-8005-25b5d2a6e35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:19.862302 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f49d09-f0eb-45bd-8005-25b5d2a6e35e None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:19.862576 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f49d09-f0eb-45bd-8005-25b5d2a6e35e None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:19.862843 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f49d09-f0eb-45bd-8005-25b5d2a6e35e None admin] PATH_INFO: `/v3/roles/4269d6d5c6c048728859af681b3610fb` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:19.864232 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f49d09-f0eb-45bd-8005-25b5d2a6e35e None admin] RBAC: Authorizing `identity:get_role(role_id=4269d6d5c6c048728859af681b3610fb)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:19.865616 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f49d09-f0eb-45bd-8005-25b5d2a6e35e None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:19.866926 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 561/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:43:19 2022] GET /identity/v3/roles/4269d6d5c6c048728859af681b3610fb => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:19.873007 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd9353-caf8-4deb-a648-01563167e8cd None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:19.967540 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd9353-caf8-4deb-a648-01563167e8cd None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:19.975072 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:20.001117 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512bb7d-2300-4d65-9558-9ce74d35b9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:20.001749 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512bb7d-2300-4d65-9558-9ce74d35b9ec None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:20.002024 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512bb7d-2300-4d65-9558-9ce74d35b9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:20.002290 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512bb7d-2300-4d65-9558-9ce74d35b9ec None admin] PATH_INFO: `/v3/users/c4a2d03536dc4522a94c6ad8468c6a1f` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:20.003390 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512bb7d-2300-4d65-9558-9ce74d35b9ec None admin] RBAC: Authorizing `identity:get_user(user_id=c4a2d03536dc4522a94c6ad8468c6a1f)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:20.004807 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512bb7d-2300-4d65-9558-9ce74d35b9ec None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:20.006440 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 560/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:43:19 2022] GET /identity/v3/users/c4a2d03536dc4522a94c6ad8468c6a1f => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:20.012078 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f49d09-f0eb-45bd-8005-25b5d2a6e35e None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:20.108695 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f49d09-f0eb-45bd-8005-25b5d2a6e35e None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:20.149192 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777e3e4-0e4d-4a31-b2b0-737491fc06f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:20.149192 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777e3e4-0e4d-4a31-b2b0-737491fc06f4 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:20.149192 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777e3e4-0e4d-4a31-b2b0-737491fc06f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:20.149192 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777e3e4-0e4d-4a31-b2b0-737491fc06f4 None admin] PATH_INFO: `/v3/projects/6b2d2eaf9cdd49e7871435856d504020` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:20.149672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777e3e4-0e4d-4a31-b2b0-737491fc06f4 None admin] RBAC: Authorizing `identity:get_project(project_id=6b2d2eaf9cdd49e7871435856d504020)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:20.149672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777e3e4-0e4d-4a31-b2b0-737491fc06f4 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:20.150963 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 562/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:43:20 2022] GET /identity/v3/projects/6b2d2eaf9cdd49e7871435856d504020 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:20.157024 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512bb7d-2300-4d65-9558-9ce74d35b9ec None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:20.252808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512bb7d-2300-4d65-9558-9ce74d35b9ec None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:20.285292 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe18cb1-b840-404d-a331-87f3c6e884ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:20.285954 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe18cb1-b840-404d-a331-87f3c6e884ee None admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:20.286227 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe18cb1-b840-404d-a331-87f3c6e884ee None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:20.286494 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe18cb1-b840-404d-a331-87f3c6e884ee None admin] PATH_INFO: `/v3/projects/6b2d2eaf9cdd49e7871435856d504020/users/c4a2d03536dc4522a94c6ad8468c6a1f/roles/4269d6d5c6c048728859af681b3610fb` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:20.288590 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe18cb1-b840-404d-a331-87f3c6e884ee None admin] RBAC: Authorizing `identity:create_grant(project_id=6b2d2eaf9cdd49e7871435856d504020, user_id=c4a2d03536dc4522a94c6ad8468c6a1f, role_id=4269d6d5c6c048728859af681b3610fb)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:20.290044 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe18cb1-b840-404d-a331-87f3c6e884ee None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:20.302256 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 561/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 7 10:43:20 2022] PUT /identity/v3/projects/6b2d2eaf9cdd49e7871435856d504020/users/c4a2d03536dc4522a94c6ad8468c6a1f/roles/4269d6d5c6c048728859af681b3610fb => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:43:22.257828 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d519daa-4f9c-4ff2-b50f-7c7482c6073b None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:22.258375 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d519daa-4f9c-4ff2-b50f-7c7482c6073b None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:22.258375 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d519daa-4f9c-4ff2-b50f-7c7482c6073b None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:22.259683 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 563/1124] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:43:22.264678 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6115e-4b42-406a-b11e-b402bc4d6fab None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:22.265065 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6115e-4b42-406a-b11e-b402bc4d6fab None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:22.265221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6115e-4b42-406a-b11e-b402bc4d6fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:22.283721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-c9d6115e-4b42-406a-b11e-b402bc4d6fab None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:43:22.284892 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-c9d6115e-4b42-406a-b11e-b402bc4d6fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:43:22.310078 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:22.350817 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 562/1125] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:43:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:43:22.374447 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d519daa-4f9c-4ff2-b50f-7c7482c6073b None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:22.388850 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:22.471894 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d519daa-4f9c-4ff2-b50f-7c7482c6073b None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:22.504650 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d00e2-fbad-45f7-8039-daed73c546b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:22.505250 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d00e2-fbad-45f7-8039-daed73c546b5 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:22.505548 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d00e2-fbad-45f7-8039-daed73c546b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:22.505817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d00e2-fbad-45f7-8039-daed73c546b5 None admin] PATH_INFO: `/v3/roles/4269d6d5c6c048728859af681b3610fb` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:22.507164 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d00e2-fbad-45f7-8039-daed73c546b5 None admin] RBAC: Authorizing `identity:get_role(role_id=4269d6d5c6c048728859af681b3610fb)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:22.508585 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d00e2-fbad-45f7-8039-daed73c546b5 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:22.509865 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 564/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:43:22 2022] GET /identity/v3/roles/4269d6d5c6c048728859af681b3610fb => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:22.515583 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6115e-4b42-406a-b11e-b402bc4d6fab None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:22.611807 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6115e-4b42-406a-b11e-b402bc4d6fab None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:22.644881 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64259b-1612-4751-aca0-69b535db8aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:22.645522 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64259b-1612-4751-aca0-69b535db8aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:22.645802 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64259b-1612-4751-aca0-69b535db8aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:22.646074 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64259b-1612-4751-aca0-69b535db8aa8 None admin] PATH_INFO: `/v3/users/c4a2d03536dc4522a94c6ad8468c6a1f` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:22.647188 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c64259b-1612-4751-aca0-69b535db8aa8 None admin] RBAC: Authorizing `identity:get_user(user_id=c4a2d03536dc4522a94c6ad8468c6a1f)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:22.648594 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c64259b-1612-4751-aca0-69b535db8aa8 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:22.650175 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 563/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:43:22 2022] GET /identity/v3/users/c4a2d03536dc4522a94c6ad8468c6a1f => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:22.655677 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d00e2-fbad-45f7-8039-daed73c546b5 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:22.733016 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:22.753139 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d00e2-fbad-45f7-8039-daed73c546b5 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:22.785553 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621e57e-f0da-4a6c-acdc-1549e722a67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:22.786087 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621e57e-f0da-4a6c-acdc-1549e722a67e None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:22.786368 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621e57e-f0da-4a6c-acdc-1549e722a67e None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:22.786639 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621e57e-f0da-4a6c-acdc-1549e722a67e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:22.850517 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621e57e-f0da-4a6c-acdc-1549e722a67e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:22.851942 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621e57e-f0da-4a6c-acdc-1549e722a67e None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:22.927398 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:22.946726 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 565/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:43:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 10:43:22.952623 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64259b-1612-4751-aca0-69b535db8aa8 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:22.983267 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:23.049593 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64259b-1612-4751-aca0-69b535db8aa8 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:23.082280 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3597909-df85-453b-a753-68a940b9830e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:23.082882 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3597909-df85-453b-a753-68a940b9830e None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:23.083156 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3597909-df85-453b-a753-68a940b9830e None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:23.083418 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3597909-df85-453b-a753-68a940b9830e None admin] PATH_INFO: `/v3/projects/6b2d2eaf9cdd49e7871435856d504020` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:23.084499 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3597909-df85-453b-a753-68a940b9830e None admin] RBAC: Authorizing `identity:get_project(project_id=6b2d2eaf9cdd49e7871435856d504020)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:23.085942 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3597909-df85-453b-a753-68a940b9830e None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:23.087560 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 564/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:43:22 2022] GET /identity/v3/projects/6b2d2eaf9cdd49e7871435856d504020 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:23.093596 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621e57e-f0da-4a6c-acdc-1549e722a67e None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:23.188986 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621e57e-f0da-4a6c-acdc-1549e722a67e None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:23.221625 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f26ae0-1358-4ceb-b883-7f92409d0040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:23.222210 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f26ae0-1358-4ceb-b883-7f92409d0040 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:23.222491 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f26ae0-1358-4ceb-b883-7f92409d0040 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:23.222767 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f26ae0-1358-4ceb-b883-7f92409d0040 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:23.223489 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f26ae0-1358-4ceb-b883-7f92409d0040 None admin] RBAC: Adding query filter params (role.id=4269d6d5c6c048728859af681b3610fb, scope.project.id=6b2d2eaf9cdd49e7871435856d504020, user.id=c4a2d03536dc4522a94c6ad8468c6a1f) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:23.223795 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f26ae0-1358-4ceb-b883-7f92409d0040 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:23.225207 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f26ae0-1358-4ceb-b883-7f92409d0040 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:23.230771 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 566/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:43:23 2022] GET /identity/v3/role_assignments?user.id=c4a2d03536dc4522a94c6ad8468c6a1f&scope.project.id=6b2d2eaf9cdd49e7871435856d504020&role.id=4269d6d5c6c048728859af681b3610fb => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:25.242980 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69812f-1977-48ea-9766-70d1838836e2 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:25.243611 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69812f-1977-48ea-9766-70d1838836e2 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:25.243611 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69812f-1977-48ea-9766-70d1838836e2 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:25.244861 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 565/1131] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:43:25.250269 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585b83b-0f08-4fbb-8b5b-b424c1669d15 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:25.251232 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585b83b-0f08-4fbb-8b5b-b424c1669d15 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:25.251444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585b83b-0f08-4fbb-8b5b-b424c1669d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:25.268858 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-2585b83b-0f08-4fbb-8b5b-b424c1669d15 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:43:25.270057 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-2585b83b-0f08-4fbb-8b5b-b424c1669d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:43:25.309675 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:25.335683 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 567/1132] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:43:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:43:25.358580 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69812f-1977-48ea-9766-70d1838836e2 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:25.453707 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:25.457749 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69812f-1977-48ea-9766-70d1838836e2 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:25.491203 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cc0b9-0b0e-4de2-ac93-90b697724a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:25.491810 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cc0b9-0b0e-4de2-ac93-90b697724a49 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:25.492087 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cc0b9-0b0e-4de2-ac93-90b697724a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:25.492356 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cc0b9-0b0e-4de2-ac93-90b697724a49 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:25.493534 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9cc0b9-0b0e-4de2-ac93-90b697724a49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:25.494897 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9cc0b9-0b0e-4de2-ac93-90b697724a49 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:25.496695 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 566/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:43:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:25.502958 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585b83b-0f08-4fbb-8b5b-b424c1669d15 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:25.603346 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585b83b-0f08-4fbb-8b5b-b424c1669d15 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:25.636022 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79db9a-e055-4a64-888d-0d52e6baab70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:25.636614 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79db9a-e055-4a64-888d-0d52e6baab70 None admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:25.636890 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79db9a-e055-4a64-888d-0d52e6baab70 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:25.637161 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79db9a-e055-4a64-888d-0d52e6baab70 None admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:25.637821 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79db9a-e055-4a64-888d-0d52e6baab70 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:25.639241 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79db9a-e055-4a64-888d-0d52e6baab70 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:25.665911 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 568/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 7 10:43:25 2022] POST /identity/v3/projects => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:43:27.636111 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c47f0-2b09-47bc-be29-9c0befadc878 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:27.636642 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c47f0-2b09-47bc-be29-9c0befadc878 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:27.636642 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c47f0-2b09-47bc-be29-9c0befadc878 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:27.638028 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 567/1135] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:43:27.643710 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9827d7-aa0f-43f5-8e24-821509532359 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:27.644112 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9827d7-aa0f-43f5-8e24-821509532359 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:27.644253 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9827d7-aa0f-43f5-8e24-821509532359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:27.662203 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-ac9827d7-aa0f-43f5-8e24-821509532359 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:43:27.663365 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ac9827d7-aa0f-43f5-8e24-821509532359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:43:27.682900 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:27.727493 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 569/1136] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:43:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:43:27.751937 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c47f0-2b09-47bc-be29-9c0befadc878 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:27.849331 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c47f0-2b09-47bc-be29-9c0befadc878 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:27.882087 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537aeb69-9a8c-4c8e-9bff-5c2d04131c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:27.882691 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537aeb69-9a8c-4c8e-9bff-5c2d04131c93 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:27.882965 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537aeb69-9a8c-4c8e-9bff-5c2d04131c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:27.883230 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537aeb69-9a8c-4c8e-9bff-5c2d04131c93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:27.884323 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537aeb69-9a8c-4c8e-9bff-5c2d04131c93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:27.885764 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537aeb69-9a8c-4c8e-9bff-5c2d04131c93 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:27.887356 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 568/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:43:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:27.893551 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9827d7-aa0f-43f5-8e24-821509532359 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:27.986196 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9827d7-aa0f-43f5-8e24-821509532359 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:28.019963 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e4970-46d1-4acd-9e34-aedb614764cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:28.020558 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e4970-46d1-4acd-9e34-aedb614764cd None admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:28.020830 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e4970-46d1-4acd-9e34-aedb614764cd None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:28.021094 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e4970-46d1-4acd-9e34-aedb614764cd None admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:28.021779 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e4970-46d1-4acd-9e34-aedb614764cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:28.023178 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e4970-46d1-4acd-9e34-aedb614764cd None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:28.043073 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 570/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 7 10:43:27 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:43:30.059443 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c31eb7-b334-4ecf-bba5-d18b4b63e136 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:30.059979 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c31eb7-b334-4ecf-bba5-d18b4b63e136 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:30.059979 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c31eb7-b334-4ecf-bba5-d18b4b63e136 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:30.061321 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 569/1139] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:43:30.066679 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecd3c2-4f25-42fe-aa98-2d2d8afc7662 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:30.067095 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecd3c2-4f25-42fe-aa98-2d2d8afc7662 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:30.067209 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecd3c2-4f25-42fe-aa98-2d2d8afc7662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:30.084750 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-f6ecd3c2-4f25-42fe-aa98-2d2d8afc7662 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:43:30.085961 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-f6ecd3c2-4f25-42fe-aa98-2d2d8afc7662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:43:30.092905 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:30.151114 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 571/1140] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:43:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:43:30.174310 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c31eb7-b334-4ecf-bba5-d18b4b63e136 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:30.209232 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:30.272517 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c31eb7-b334-4ecf-bba5-d18b4b63e136 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:30.304816 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc39bfd-8c20-4934-8f66-f44f82ea84ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:30.305445 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc39bfd-8c20-4934-8f66-f44f82ea84ef None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:30.305721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc39bfd-8c20-4934-8f66-f44f82ea84ef None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:30.305988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc39bfd-8c20-4934-8f66-f44f82ea84ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:30.315736 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc39bfd-8c20-4934-8f66-f44f82ea84ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:43:30.320257 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-9cc39bfd-8c20-4934-8f66-f44f82ea84ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:43:30.320257 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:43:30.320257 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:43:30.320257 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:43:30.320257 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:43:30.320257 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:43:30.320257 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:43:30.320257 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:43:30.320257 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:43:30.320257 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:43:30.320257 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:43:30.320257 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:43:30.320257 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:43:30.320257 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:43:30.320257 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:43:30.320257 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:43:30.321463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:43:30.321463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:43:30.321463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:43:30.321463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:43:30.321463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:43:30.321463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:43:30.321463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:43:30.321463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:43:30.321463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:43:30.321463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:43:30.321463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:43:30.321463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:43:30.321463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:43:30.321463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:43:30.321463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:43:30.321463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:43:30.322562 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:43:30.322562 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:43:30.322562 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:43:30.322562 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:43:30.322562 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:43:30.322562 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:43:30.322562 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:43:30.322562 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:43:30.322562 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:43:30.322562 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:43:30.322562 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:43:30.322562 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:43:30.322562 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 570/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:43:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:43:30.327526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecd3c2-4f25-42fe-aa98-2d2d8afc7662 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:30.424198 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecd3c2-4f25-42fe-aa98-2d2d8afc7662 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:30.456376 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c098a92-33a9-4cd3-afb3-09a566e2e478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:30.456964 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c098a92-33a9-4cd3-afb3-09a566e2e478 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:30.457236 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c098a92-33a9-4cd3-afb3-09a566e2e478 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:30.457535 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c098a92-33a9-4cd3-afb3-09a566e2e478 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:30.458189 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c098a92-33a9-4cd3-afb3-09a566e2e478 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:30.458487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c098a92-33a9-4cd3-afb3-09a566e2e478 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:30.459832 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c098a92-33a9-4cd3-afb3-09a566e2e478 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:30.467419 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 572/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:43:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:30.473819 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc39bfd-8c20-4934-8f66-f44f82ea84ef None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:30.564959 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:30.570947 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc39bfd-8c20-4934-8f66-f44f82ea84ef None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:30.603526 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4ca8f-9b44-4db3-8b25-9bcdb66541af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:30.604130 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4ca8f-9b44-4db3-8b25-9bcdb66541af None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:30.604404 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4ca8f-9b44-4db3-8b25-9bcdb66541af None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:30.604671 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4ca8f-9b44-4db3-8b25-9bcdb66541af None admin] PATH_INFO: `/v3/users/976a6707677647728aa2c34891b1d8ef` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:30.617775 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4ca8f-9b44-4db3-8b25-9bcdb66541af None admin] RBAC: Authorizing `identity:get_user(user_id=976a6707677647728aa2c34891b1d8ef)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:30.619176 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4ca8f-9b44-4db3-8b25-9bcdb66541af None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:30.620736 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 571/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:43:30 2022] GET /identity/v3/users/976a6707677647728aa2c34891b1d8ef => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:30.627099 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c098a92-33a9-4cd3-afb3-09a566e2e478 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:30.635253 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:30.732438 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c098a92-33a9-4cd3-afb3-09a566e2e478 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:30.764788 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01d7ef-171c-4dbd-b3ce-c6a2bae4339b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:30.765416 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01d7ef-171c-4dbd-b3ce-c6a2bae4339b None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:30.765694 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01d7ef-171c-4dbd-b3ce-c6a2bae4339b None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:30.765986 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01d7ef-171c-4dbd-b3ce-c6a2bae4339b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:30.830099 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01d7ef-171c-4dbd-b3ce-c6a2bae4339b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:30.831551 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01d7ef-171c-4dbd-b3ce-c6a2bae4339b None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:30.834061 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:30.926522 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 573/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:43:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 10:43:30.932419 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4ca8f-9b44-4db3-8b25-9bcdb66541af None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:31.034417 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4ca8f-9b44-4db3-8b25-9bcdb66541af None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:31.066766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcb8a4-753a-49c4-9071-5903c659558d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:31.067391 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcb8a4-753a-49c4-9071-5903c659558d None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:31.067667 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcb8a4-753a-49c4-9071-5903c659558d None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:31.067936 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcb8a4-753a-49c4-9071-5903c659558d None admin] PATH_INFO: `/v3/projects/0aae0fa8b3ed44d89ae2257e0af250ef` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:31.069048 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dcb8a4-753a-49c4-9071-5903c659558d None admin] RBAC: Authorizing `identity:get_project(project_id=0aae0fa8b3ed44d89ae2257e0af250ef)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:31.070491 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dcb8a4-753a-49c4-9071-5903c659558d None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:31.072124 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 572/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:43:30 2022] GET /identity/v3/projects/0aae0fa8b3ed44d89ae2257e0af250ef => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:31.078874 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01d7ef-171c-4dbd-b3ce-c6a2bae4339b None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:31.174165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01d7ef-171c-4dbd-b3ce-c6a2bae4339b None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:31.176411 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:31.206653 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63f2e5-576f-48df-b123-21f55d757722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:31.207229 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63f2e5-576f-48df-b123-21f55d757722 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:31.207500 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63f2e5-576f-48df-b123-21f55d757722 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:31.207764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63f2e5-576f-48df-b123-21f55d757722 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:31.208477 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63f2e5-576f-48df-b123-21f55d757722 None admin] RBAC: Adding query filter params (role.id=9da6e501237c405ca021a9d9f6173caf, scope.project.id=0aae0fa8b3ed44d89ae2257e0af250ef, user.id=976a6707677647728aa2c34891b1d8ef) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:31.208777 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63f2e5-576f-48df-b123-21f55d757722 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:31.210203 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63f2e5-576f-48df-b123-21f55d757722 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:31.215288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 574/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:43:31 2022] GET /identity/v3/role_assignments?user.id=976a6707677647728aa2c34891b1d8ef&scope.project.id=0aae0fa8b3ed44d89ae2257e0af250ef&role.id=9da6e501237c405ca021a9d9f6173caf => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:33.177766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e0217-75be-4b9a-96f7-323e6c209342 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:33.178308 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e0217-75be-4b9a-96f7-323e6c209342 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:33.178308 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e0217-75be-4b9a-96f7-323e6c209342 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:33.179648 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 573/1147] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:43:33.184834 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e26d19-1c8f-4bfc-bd7a-c2254fe85a5a None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:33.185199 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e26d19-1c8f-4bfc-bd7a-c2254fe85a5a None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:33.185408 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e26d19-1c8f-4bfc-bd7a-c2254fe85a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:33.203609 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-f8e26d19-1c8f-4bfc-bd7a-c2254fe85a5a None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:43:33.204776 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-f8e26d19-1c8f-4bfc-bd7a-c2254fe85a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:43:33.268103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 575/1148] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:43:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:43:33.289673 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e0217-75be-4b9a-96f7-323e6c209342 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:33.314346 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:33.389986 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e0217-75be-4b9a-96f7-323e6c209342 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:33.421960 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bb6f7-6b85-437c-9419-a5006b490d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:33.423083 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bb6f7-6b85-437c-9419-a5006b490d6b None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:33.423359 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bb6f7-6b85-437c-9419-a5006b490d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:33.423629 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bb6f7-6b85-437c-9419-a5006b490d6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:33.433467 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749bb6f7-6b85-437c-9419-a5006b490d6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:43:33.438579 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-749bb6f7-6b85-437c-9419-a5006b490d6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:43:33.438579 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:43:33.438579 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:43:33.438579 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:43:33.438579 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:43:33.438579 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:43:33.438579 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:43:33.438579 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:43:33.438579 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:43:33.438579 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:43:33.438579 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:43:33.438579 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:43:33.438579 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:43:33.438579 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:43:33.438579 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:43:33.438579 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:43:33.439661 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:43:33.439661 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:43:33.439661 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:43:33.439661 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:43:33.439661 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:43:33.439661 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:43:33.439661 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:43:33.439661 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:43:33.439661 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:43:33.439661 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:43:33.439661 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:43:33.439661 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:43:33.439661 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:43:33.439661 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:43:33.439661 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:43:33.439661 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:43:33.440568 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:43:33.440568 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:43:33.440568 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:43:33.440568 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:43:33.440568 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:43:33.440568 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:43:33.440568 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:43:33.440568 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:43:33.440568 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:43:33.440568 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:43:33.440568 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:43:33.440568 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:43:33.440568 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 574/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:43:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:43:33.445705 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e26d19-1c8f-4bfc-bd7a-c2254fe85a5a None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:33.537727 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:33.541959 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e26d19-1c8f-4bfc-bd7a-c2254fe85a5a None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:33.576581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ee314-aed4-45e1-90e6-5f472c21ecd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:33.577174 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ee314-aed4-45e1-90e6-5f472c21ecd0 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:33.577771 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ee314-aed4-45e1-90e6-5f472c21ecd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:33.578055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ee314-aed4-45e1-90e6-5f472c21ecd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:33.579492 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ee314-aed4-45e1-90e6-5f472c21ecd0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:33.579798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ee314-aed4-45e1-90e6-5f472c21ecd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:33.581672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ee314-aed4-45e1-90e6-5f472c21ecd0 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:33.590530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 576/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:43:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:33.596385 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bb6f7-6b85-437c-9419-a5006b490d6b None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:33.673843 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:33.691571 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749bb6f7-6b85-437c-9419-a5006b490d6b None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:33.724181 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff6082-8259-41e3-8b98-7a00f36cca48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:33.724774 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff6082-8259-41e3-8b98-7a00f36cca48 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:33.725044 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff6082-8259-41e3-8b98-7a00f36cca48 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:33.725306 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff6082-8259-41e3-8b98-7a00f36cca48 None admin] PATH_INFO: `/v3/users/976a6707677647728aa2c34891b1d8ef` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:33.726417 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff6082-8259-41e3-8b98-7a00f36cca48 None admin] RBAC: Authorizing `identity:get_user(user_id=976a6707677647728aa2c34891b1d8ef)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:33.727817 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff6082-8259-41e3-8b98-7a00f36cca48 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:33.729392 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 575/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:43:33 2022] GET /identity/v3/users/976a6707677647728aa2c34891b1d8ef => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:33.735018 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ee314-aed4-45e1-90e6-5f472c21ecd0 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:33.831221 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ee314-aed4-45e1-90e6-5f472c21ecd0 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:33.862649 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e4758-a649-4b70-94b9-d648e0bcaa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:33.863255 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e4758-a649-4b70-94b9-d648e0bcaa57 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:33.863529 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e4758-a649-4b70-94b9-d648e0bcaa57 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:33.863796 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e4758-a649-4b70-94b9-d648e0bcaa57 None admin] PATH_INFO: `/v3/projects/0aae0fa8b3ed44d89ae2257e0af250ef` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:33.864898 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e4758-a649-4b70-94b9-d648e0bcaa57 None admin] RBAC: Authorizing `identity:get_project(project_id=0aae0fa8b3ed44d89ae2257e0af250ef)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:33.866343 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e4758-a649-4b70-94b9-d648e0bcaa57 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:33.867940 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 577/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:43:33 2022] GET /identity/v3/projects/0aae0fa8b3ed44d89ae2257e0af250ef => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:33.874015 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff6082-8259-41e3-8b98-7a00f36cca48 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:33.970060 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff6082-8259-41e3-8b98-7a00f36cca48 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:34.004537 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58756c9d-c6ab-45c9-9cc8-e6b4c909f648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:34.005172 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58756c9d-c6ab-45c9-9cc8-e6b4c909f648 None admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:34.005479 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58756c9d-c6ab-45c9-9cc8-e6b4c909f648 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:34.005774 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58756c9d-c6ab-45c9-9cc8-e6b4c909f648 None admin] PATH_INFO: `/v3/projects/0aae0fa8b3ed44d89ae2257e0af250ef/users/976a6707677647728aa2c34891b1d8ef/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:34.007684 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58756c9d-c6ab-45c9-9cc8-e6b4c909f648 None admin] RBAC: Authorizing `identity:create_grant(project_id=0aae0fa8b3ed44d89ae2257e0af250ef, user_id=976a6707677647728aa2c34891b1d8ef, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:34.009086 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58756c9d-c6ab-45c9-9cc8-e6b4c909f648 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:34.021750 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 576/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 7 10:43:33 2022] PUT /identity/v3/projects/0aae0fa8b3ed44d89ae2257e0af250ef/users/976a6707677647728aa2c34891b1d8ef/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:43:36.036655 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb511af-a7b8-4995-b44c-537bac834e6d None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:36.037223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb511af-a7b8-4995-b44c-537bac834e6d None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:36.037223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb511af-a7b8-4995-b44c-537bac834e6d None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:36.038551 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 578/1154] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:43:36.043589 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f5977-26c9-4af8-8530-fbea48e04ada None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:36.043966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f5977-26c9-4af8-8530-fbea48e04ada None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:36.044118 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f5977-26c9-4af8-8530-fbea48e04ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:36.062032 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-ae3f5977-26c9-4af8-8530-fbea48e04ada None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:43:36.063716 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-ae3f5977-26c9-4af8-8530-fbea48e04ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:43:36.066383 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:36.128937 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 577/1155] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:43:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:43:36.152135 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb511af-a7b8-4995-b44c-537bac834e6d None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:36.180359 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:36.261799 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb511af-a7b8-4995-b44c-537bac834e6d None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:36.293288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0958c02-afb2-4901-9084-f32ebee5b883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:36.293872 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0958c02-afb2-4901-9084-f32ebee5b883 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:36.294146 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0958c02-afb2-4901-9084-f32ebee5b883 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:36.294412 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0958c02-afb2-4901-9084-f32ebee5b883 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:36.305075 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0958c02-afb2-4901-9084-f32ebee5b883 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:43:36.309706 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-f0958c02-afb2-4901-9084-f32ebee5b883 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:43:36.309706 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:43:36.309706 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:43:36.309706 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:43:36.309706 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:43:36.309706 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:43:36.309706 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:43:36.309706 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:43:36.309706 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:43:36.309706 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:43:36.309706 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:43:36.309706 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:43:36.309706 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:43:36.309706 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:43:36.309706 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:43:36.309706 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:43:36.310769 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:43:36.310769 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:43:36.310769 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:43:36.310769 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:43:36.310769 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:43:36.310769 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:43:36.310769 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:43:36.310769 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:43:36.310769 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:43:36.310769 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:43:36.310769 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:43:36.310769 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:43:36.310769 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:43:36.310769 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:43:36.310769 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:43:36.310769 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:43:36.316714 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:43:36.316714 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:43:36.316714 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:43:36.316714 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:43:36.316714 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:43:36.316714 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:43:36.316714 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:43:36.316714 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:43:36.316714 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:43:36.316714 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:43:36.316714 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:43:36.316714 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:43:36.316714 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 579/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:43:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:43:36.318600 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f5977-26c9-4af8-8530-fbea48e04ada None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:36.413072 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f5977-26c9-4af8-8530-fbea48e04ada None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:36.446274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55480594-48da-46ea-9680-8e4804ce87a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:36.446865 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55480594-48da-46ea-9680-8e4804ce87a7 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:36.447137 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55480594-48da-46ea-9680-8e4804ce87a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:36.447402 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55480594-48da-46ea-9680-8e4804ce87a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:36.448054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55480594-48da-46ea-9680-8e4804ce87a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:36.448349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55480594-48da-46ea-9680-8e4804ce87a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:36.449714 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55480594-48da-46ea-9680-8e4804ce87a7 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:36.457444 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 578/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:43:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:36.463131 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0958c02-afb2-4901-9084-f32ebee5b883 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:36.548488 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:36.560317 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0958c02-afb2-4901-9084-f32ebee5b883 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:36.592065 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6890fe4-d4ae-4ba0-b194-1a8db97fc617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:36.592679 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6890fe4-d4ae-4ba0-b194-1a8db97fc617 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:36.592956 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6890fe4-d4ae-4ba0-b194-1a8db97fc617 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:36.593227 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6890fe4-d4ae-4ba0-b194-1a8db97fc617 None admin] PATH_INFO: `/v3/users/976a6707677647728aa2c34891b1d8ef` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:36.594857 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6890fe4-d4ae-4ba0-b194-1a8db97fc617 None admin] RBAC: Authorizing `identity:get_user(user_id=976a6707677647728aa2c34891b1d8ef)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:36.596261 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6890fe4-d4ae-4ba0-b194-1a8db97fc617 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:36.597840 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 580/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:43:36 2022] GET /identity/v3/users/976a6707677647728aa2c34891b1d8ef => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:36.603463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55480594-48da-46ea-9680-8e4804ce87a7 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:36.606313 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:36.702958 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55480594-48da-46ea-9680-8e4804ce87a7 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:36.735865 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ba8e2-cf3a-4889-b6ea-907275c633ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:36.736444 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ba8e2-cf3a-4889-b6ea-907275c633ce None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:36.736721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ba8e2-cf3a-4889-b6ea-907275c633ce None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:36.736990 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ba8e2-cf3a-4889-b6ea-907275c633ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:36.801391 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ba8e2-cf3a-4889-b6ea-907275c633ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:36.802757 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ba8e2-cf3a-4889-b6ea-907275c633ce None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:36.804476 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:36.897944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 579/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:43:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 10:43:36.903674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6890fe4-d4ae-4ba0-b194-1a8db97fc617 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:36.999464 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6890fe4-d4ae-4ba0-b194-1a8db97fc617 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:37.031614 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9007a1e-c060-40bf-b1c8-1a65b081c2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:37.032230 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9007a1e-c060-40bf-b1c8-1a65b081c2c1 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:37.032507 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9007a1e-c060-40bf-b1c8-1a65b081c2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:37.032775 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9007a1e-c060-40bf-b1c8-1a65b081c2c1 None admin] PATH_INFO: `/v3/projects/0aae0fa8b3ed44d89ae2257e0af250ef` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:37.033902 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9007a1e-c060-40bf-b1c8-1a65b081c2c1 None admin] RBAC: Authorizing `identity:get_project(project_id=0aae0fa8b3ed44d89ae2257e0af250ef)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:37.035312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9007a1e-c060-40bf-b1c8-1a65b081c2c1 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:37.036919 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 581/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:43:36 2022] GET /identity/v3/projects/0aae0fa8b3ed44d89ae2257e0af250ef => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:37.043022 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ba8e2-cf3a-4889-b6ea-907275c633ce None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:37.138896 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ba8e2-cf3a-4889-b6ea-907275c633ce None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:37.140350 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:37.172952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3f882-6007-4b11-808a-c051f4fd06f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:37.173555 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3f882-6007-4b11-808a-c051f4fd06f2 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:37.173828 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3f882-6007-4b11-808a-c051f4fd06f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:37.174091 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3f882-6007-4b11-808a-c051f4fd06f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:37.174798 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3f882-6007-4b11-808a-c051f4fd06f2 None admin] RBAC: Adding query filter params (role.id=9da6e501237c405ca021a9d9f6173caf, scope.project.id=0aae0fa8b3ed44d89ae2257e0af250ef, user.id=976a6707677647728aa2c34891b1d8ef) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:37.175095 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3f882-6007-4b11-808a-c051f4fd06f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:37.176492 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3f882-6007-4b11-808a-c051f4fd06f2 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:37.182004 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 580/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:43:37 2022] GET /identity/v3/role_assignments?user.id=976a6707677647728aa2c34891b1d8ef&scope.project.id=0aae0fa8b3ed44d89ae2257e0af250ef&role.id=9da6e501237c405ca021a9d9f6173caf => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:39.155886 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12251f8e-b412-4a77-9c53-01aa09c00ec7 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:39.156485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12251f8e-b412-4a77-9c53-01aa09c00ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:39.156485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12251f8e-b412-4a77-9c53-01aa09c00ec7 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:39.157839 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 582/1162] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:43:39.162926 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426e006-1dc0-49e7-bb99-252c5197acb1 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:39.163367 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426e006-1dc0-49e7-bb99-252c5197acb1 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:39.163466 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426e006-1dc0-49e7-bb99-252c5197acb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:39.181513 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-b426e006-1dc0-49e7-bb99-252c5197acb1 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:43:39.182692 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-b426e006-1dc0-49e7-bb99-252c5197acb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:43:39.246383 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 581/1163] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:43:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:43:39.268498 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12251f8e-b412-4a77-9c53-01aa09c00ec7 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:39.293307 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:39.376289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12251f8e-b412-4a77-9c53-01aa09c00ec7 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:39.408820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6528fca-a729-48f5-bc60-0d14da5dd4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:39.409367 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6528fca-a729-48f5-bc60-0d14da5dd4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:39.409648 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6528fca-a729-48f5-bc60-0d14da5dd4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:39.409912 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6528fca-a729-48f5-bc60-0d14da5dd4d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:39.473143 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6528fca-a729-48f5-bc60-0d14da5dd4d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:39.474588 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6528fca-a729-48f5-bc60-0d14da5dd4d6 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:39.496624 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:39.567868 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 583/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:43:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 10:43:39.573992 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426e006-1dc0-49e7-bb99-252c5197acb1 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:39.672426 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:39.679107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426e006-1dc0-49e7-bb99-252c5197acb1 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:39.712594 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0fd96-ce51-4737-9c50-a81b00f0d5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:39.713202 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0fd96-ce51-4737-9c50-a81b00f0d5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:39.713509 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0fd96-ce51-4737-9c50-a81b00f0d5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:39.713778 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0fd96-ce51-4737-9c50-a81b00f0d5e0 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:39.720151 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0fd96-ce51-4737-9c50-a81b00f0d5e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:39.721586 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0fd96-ce51-4737-9c50-a81b00f0d5e0 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:39.732338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-7bb0fd96-ce51-4737-9c50-a81b00f0d5e0 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 07 10:43:39.732338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:43:39.732338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 07 10:43:39.732338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 07 10:43:39.732338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:43:39.732338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:43:39.732338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:43:39.732338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:43:39.732338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 07 10:43:39.732338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:43:39.732338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 10:43:39.732338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:43:39.732338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:43:39.732338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:43:39.732338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:43:39.732338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:43:39.732338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:43:39.733428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:43:39.733428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:43:39.733428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:43:39.733428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:43:39.733428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:43:39.733428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:43:39.733428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:43:39.733428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:43:39.733428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:43:39.733428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:43:39.733428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:43:39.733428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:43:39.733428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:43:39.733428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:43:39.733428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:43:39.733428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:43:39.734329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:43:39.734329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:43:39.734329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:43:39.734329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:43:39.734329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:43:39.734329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:43:39.734329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:43:39.734329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:43:39.734329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:43:39.734329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:43:39.734329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 07 10:43:39.734329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:43:39.734329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 07 10:43:39.734329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:43:39.734329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 582/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Aug 7 10:43:39 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:43:39.739747 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6528fca-a729-48f5-bc60-0d14da5dd4d6 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:39.835374 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6528fca-a729-48f5-bc60-0d14da5dd4d6 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:39.857539 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:39.868097 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2084db-68b1-4b52-8dd5-5e85d78cd384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:39.868677 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2084db-68b1-4b52-8dd5-5e85d78cd384 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:39.868949 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2084db-68b1-4b52-8dd5-5e85d78cd384 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:39.869211 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2084db-68b1-4b52-8dd5-5e85d78cd384 None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:39.869871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2084db-68b1-4b52-8dd5-5e85d78cd384 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:39.870167 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2084db-68b1-4b52-8dd5-5e85d78cd384 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:39.871510 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2084db-68b1-4b52-8dd5-5e85d78cd384 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:39.879105 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 584/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Sun Aug 7 10:43:39 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:41.825982 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724132a-5857-4e4c-9892-ef824e7ab36d None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:41.826506 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724132a-5857-4e4c-9892-ef824e7ab36d None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:41.826506 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724132a-5857-4e4c-9892-ef824e7ab36d None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:41.827854 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 583/1167] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:43:41.833465 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d3c46-0b76-4d58-b886-37850148fd84 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:41.833826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d3c46-0b76-4d58-b886-37850148fd84 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:41.833998 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d3c46-0b76-4d58-b886-37850148fd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:41.851331 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-7f9d3c46-0b76-4d58-b886-37850148fd84 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:43:41.852498 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-7f9d3c46-0b76-4d58-b886-37850148fd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:43:41.915548 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 585/1168] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:43:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:43:41.937485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724132a-5857-4e4c-9892-ef824e7ab36d None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:42.035361 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724132a-5857-4e4c-9892-ef824e7ab36d None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:42.067893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e6d7f-bd5a-45ce-a371-3889beb19da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:42.068481 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e6d7f-bd5a-45ce-a371-3889beb19da2 None admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:42.068755 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e6d7f-bd5a-45ce-a371-3889beb19da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:42.069022 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e6d7f-bd5a-45ce-a371-3889beb19da2 None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:42.069711 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e6d7f-bd5a-45ce-a371-3889beb19da2 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:42.071053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e6d7f-bd5a-45ce-a371-3889beb19da2 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:42.086934 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 584/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Sun Aug 7 10:43:41 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 10:43:44.116464 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8be6fd-5169-4212-9159-10ca8f0d40cc None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:44.116990 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8be6fd-5169-4212-9159-10ca8f0d40cc None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:44.116990 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8be6fd-5169-4212-9159-10ca8f0d40cc None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:44.118384 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 586/1170] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:43:44.123797 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bf22e-9e9a-4237-aa53-a08e3a836763 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:44.124212 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bf22e-9e9a-4237-aa53-a08e3a836763 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:44.124346 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bf22e-9e9a-4237-aa53-a08e3a836763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:44.143023 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-703bf22e-9e9a-4237-aa53-a08e3a836763 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:43:44.144193 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-703bf22e-9e9a-4237-aa53-a08e3a836763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:43:44.154519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:44.209257 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 585/1171] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:43:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:43:44.235106 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8be6fd-5169-4212-9159-10ca8f0d40cc None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:44.332382 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8be6fd-5169-4212-9159-10ca8f0d40cc None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:44.349039 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:44.365542 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397bd12-7c41-492b-b124-5f82c44358be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:44.366152 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397bd12-7c41-492b-b124-5f82c44358be None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:44.366424 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397bd12-7c41-492b-b124-5f82c44358be None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:44.366738 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397bd12-7c41-492b-b124-5f82c44358be None admin] PATH_INFO: `/v3/domains/5c442a299c674ee18cb5cc46cb5f2f4f` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:44.377428 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397bd12-7c41-492b-b124-5f82c44358be None admin] RBAC: Authorizing `identity:get_domain(domain_id=5c442a299c674ee18cb5cc46cb5f2f4f)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:44.379581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397bd12-7c41-492b-b124-5f82c44358be None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:44.380411 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 587/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Sun Aug 7 10:43:44 2022] GET /identity/v3/domains/5c442a299c674ee18cb5cc46cb5f2f4f => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:44.386286 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703bf22e-9e9a-4237-aa53-a08e3a836763 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:44.487806 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703bf22e-9e9a-4237-aa53-a08e3a836763 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:44.520896 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83ccdf-84bf-4cab-a03d-a0c3dec66812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:44.521516 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83ccdf-84bf-4cab-a03d-a0c3dec66812 None admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:44.521797 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83ccdf-84bf-4cab-a03d-a0c3dec66812 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:44.522069 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83ccdf-84bf-4cab-a03d-a0c3dec66812 None admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:44.522698 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83ccdf-84bf-4cab-a03d-a0c3dec66812 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:44.524115 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83ccdf-84bf-4cab-a03d-a0c3dec66812 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:44.543228 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:44.551338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 586/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 7 10:43:44 2022] POST /identity/v3/projects => generated 361 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:43:46.552808 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a3c06-17cc-4190-97de-a3c75b2e8625 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:46.553360 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a3c06-17cc-4190-97de-a3c75b2e8625 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:46.553360 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a3c06-17cc-4190-97de-a3c75b2e8625 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:46.554700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 588/1174] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:43:46.559862 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac6dae-e766-4210-9180-5f5f8405dc9c None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:46.560240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac6dae-e766-4210-9180-5f5f8405dc9c None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:46.560404 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac6dae-e766-4210-9180-5f5f8405dc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:46.579158 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-2aac6dae-e766-4210-9180-5f5f8405dc9c None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:43:46.580330 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-2aac6dae-e766-4210-9180-5f5f8405dc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:43:46.644030 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 587/1175] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:43:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:43:46.667797 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a3c06-17cc-4190-97de-a3c75b2e8625 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:46.768050 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a3c06-17cc-4190-97de-a3c75b2e8625 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:46.799908 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f019f-17e5-4d60-b8c3-ed3ca077453f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:46.800518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f019f-17e5-4d60-b8c3-ed3ca077453f None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:46.800795 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f019f-17e5-4d60-b8c3-ed3ca077453f None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:46.801071 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f019f-17e5-4d60-b8c3-ed3ca077453f None admin] PATH_INFO: `/v3/domains/5c442a299c674ee18cb5cc46cb5f2f4f` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:46.802195 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f019f-17e5-4d60-b8c3-ed3ca077453f None admin] RBAC: Authorizing `identity:get_domain(domain_id=5c442a299c674ee18cb5cc46cb5f2f4f)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:46.803613 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f019f-17e5-4d60-b8c3-ed3ca077453f None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:46.805164 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 589/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Sun Aug 7 10:43:46 2022] GET /identity/v3/domains/5c442a299c674ee18cb5cc46cb5f2f4f => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:46.810976 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac6dae-e766-4210-9180-5f5f8405dc9c None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:46.905760 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac6dae-e766-4210-9180-5f5f8405dc9c None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:46.931017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:46.939347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d613b36-cd7d-46d9-9f99-bd48b980c45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:46.939938 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d613b36-cd7d-46d9-9f99-bd48b980c45c None admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:46.940215 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d613b36-cd7d-46d9-9f99-bd48b980c45c None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:46.940486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d613b36-cd7d-46d9-9f99-bd48b980c45c None admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:46.941116 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d613b36-cd7d-46d9-9f99-bd48b980c45c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:46.942564 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d613b36-cd7d-46d9-9f99-bd48b980c45c None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:46.962373 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 588/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 7 10:43:46 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:43:48.970984 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369d8ea-df13-4eeb-81b9-8a110cca24fe None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:48.971535 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369d8ea-df13-4eeb-81b9-8a110cca24fe None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:48.971535 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369d8ea-df13-4eeb-81b9-8a110cca24fe None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:48.972860 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 590/1178] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:43:48.977989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e675549-811b-4bc4-8e1d-6292752822e5 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:48.978406 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e675549-811b-4bc4-8e1d-6292752822e5 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:48.978518 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e675549-811b-4bc4-8e1d-6292752822e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:48.997436 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-8e675549-811b-4bc4-8e1d-6292752822e5 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:43:48.998624 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-8e675549-811b-4bc4-8e1d-6292752822e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:43:49.063667 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 589/1179] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:43:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:43:49.086048 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9369d8ea-df13-4eeb-81b9-8a110cca24fe None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:49.133654 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:49.185364 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9369d8ea-df13-4eeb-81b9-8a110cca24fe None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:49.217200 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2b9c9-d000-4716-97c1-2d6d698a99ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:49.217834 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2b9c9-d000-4716-97c1-2d6d698a99ef None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:49.218113 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2b9c9-d000-4716-97c1-2d6d698a99ef None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:49.218382 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2b9c9-d000-4716-97c1-2d6d698a99ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:49.228533 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2b9c9-d000-4716-97c1-2d6d698a99ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:43:49.233089 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-eba2b9c9-d000-4716-97c1-2d6d698a99ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:43:49.233089 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:43:49.233089 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:43:49.233089 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:43:49.233089 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:43:49.233089 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:43:49.233089 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:43:49.233089 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:43:49.233089 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:43:49.233089 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:43:49.233089 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:43:49.233089 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:43:49.233089 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:43:49.233089 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:43:49.233089 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:43:49.233089 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:43:49.234223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:43:49.234223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:43:49.234223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:43:49.234223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:43:49.234223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:43:49.234223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:43:49.234223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:43:49.234223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:43:49.234223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:43:49.234223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:43:49.234223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:43:49.234223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:43:49.234223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:43:49.234223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:43:49.234223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:43:49.234223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:43:49.235853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:43:49.235853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:43:49.235853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:43:49.235853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:43:49.235853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:43:49.235853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:43:49.235853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:43:49.235853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:43:49.235853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:43:49.235853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:43:49.235853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:43:49.235853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:43:49.235853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 591/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:43:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:43:49.240658 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e675549-811b-4bc4-8e1d-6292752822e5 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:49.337111 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e675549-811b-4bc4-8e1d-6292752822e5 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:49.351385 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:49.372417 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcdcb99-ae37-46a9-9141-7f9b806cdc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:49.373018 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdcb99-ae37-46a9-9141-7f9b806cdc68 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:49.373295 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdcb99-ae37-46a9-9141-7f9b806cdc68 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:49.373592 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdcb99-ae37-46a9-9141-7f9b806cdc68 None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:49.374253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcdcb99-ae37-46a9-9141-7f9b806cdc68 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:49.374556 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcdcb99-ae37-46a9-9141-7f9b806cdc68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:49.375906 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcdcb99-ae37-46a9-9141-7f9b806cdc68 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:49.383636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 590/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:43:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:49.389303 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2b9c9-d000-4716-97c1-2d6d698a99ef None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:49.485747 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2b9c9-d000-4716-97c1-2d6d698a99ef None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:49.492155 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:49.518292 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fea43-4814-4f44-91e9-fa2740e0b562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:49.518894 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fea43-4814-4f44-91e9-fa2740e0b562 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:49.519164 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fea43-4814-4f44-91e9-fa2740e0b562 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:49.519427 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fea43-4814-4f44-91e9-fa2740e0b562 None admin] PATH_INFO: `/v3/users/9dcbab1ac7ae479e8df93801dd4368b9` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:49.532377 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400fea43-4814-4f44-91e9-fa2740e0b562 None admin] RBAC: Authorizing `identity:get_user(user_id=9dcbab1ac7ae479e8df93801dd4368b9)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:49.533838 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400fea43-4814-4f44-91e9-fa2740e0b562 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:49.535400 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 592/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:43:49 2022] GET /identity/v3/users/9dcbab1ac7ae479e8df93801dd4368b9 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:49.541048 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcdcb99-ae37-46a9-9141-7f9b806cdc68 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:49.636493 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcdcb99-ae37-46a9-9141-7f9b806cdc68 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:49.668644 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f59fe-3de3-4f58-8f84-f038f2d3fcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:49.669218 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f59fe-3de3-4f58-8f84-f038f2d3fcf4 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:49.669519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f59fe-3de3-4f58-8f84-f038f2d3fcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:49.669785 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f59fe-3de3-4f58-8f84-f038f2d3fcf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:49.713508 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:49.736472 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9f59fe-3de3-4f58-8f84-f038f2d3fcf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:49.737867 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9f59fe-3de3-4f58-8f84-f038f2d3fcf4 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:49.836822 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 591/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:43:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 10:43:49.842875 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fea43-4814-4f44-91e9-fa2740e0b562 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:49.936794 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fea43-4814-4f44-91e9-fa2740e0b562 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:49.968755 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac709c-971e-4f06-a556-9150c6a098f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:49.969379 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac709c-971e-4f06-a556-9150c6a098f6 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:49.969654 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac709c-971e-4f06-a556-9150c6a098f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:49.969917 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac709c-971e-4f06-a556-9150c6a098f6 None admin] PATH_INFO: `/v3/projects/9a003e4a61244394ae1e4b0e90701489` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:49.971006 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac709c-971e-4f06-a556-9150c6a098f6 None admin] RBAC: Authorizing `identity:get_project(project_id=9a003e4a61244394ae1e4b0e90701489)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:49.972413 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac709c-971e-4f06-a556-9150c6a098f6 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:49.974021 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 593/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:43:49 2022] GET /identity/v3/projects/9a003e4a61244394ae1e4b0e90701489 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:49.980045 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f59fe-3de3-4f58-8f84-f038f2d3fcf4 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:50.058665 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:50.081094 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f59fe-3de3-4f58-8f84-f038f2d3fcf4 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:50.114898 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222aa14-ea44-4477-8d5e-bd49394c2e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:50.115488 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222aa14-ea44-4477-8d5e-bd49394c2e9b None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:50.115762 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222aa14-ea44-4477-8d5e-bd49394c2e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:50.116029 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222aa14-ea44-4477-8d5e-bd49394c2e9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:50.116737 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222aa14-ea44-4477-8d5e-bd49394c2e9b None admin] RBAC: Adding query filter params (role.id=9da6e501237c405ca021a9d9f6173caf, scope.project.id=9a003e4a61244394ae1e4b0e90701489, user.id=9dcbab1ac7ae479e8df93801dd4368b9) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:50.117038 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222aa14-ea44-4477-8d5e-bd49394c2e9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:50.118461 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222aa14-ea44-4477-8d5e-bd49394c2e9b None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:50.123926 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 592/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:43:49 2022] GET /identity/v3/role_assignments?user.id=9dcbab1ac7ae479e8df93801dd4368b9&scope.project.id=9a003e4a61244394ae1e4b0e90701489&role.id=9da6e501237c405ca021a9d9f6173caf => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:52.077636 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe49ad-e0eb-4530-a220-b46975bf5ed2 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:52.078159 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe49ad-e0eb-4530-a220-b46975bf5ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:52.078159 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe49ad-e0eb-4530-a220-b46975bf5ed2 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:52.080089 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 594/1186] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:43:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:43:52.085182 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb30a1-66cb-44fb-91f0-39e918ebf774 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:52.085595 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb30a1-66cb-44fb-91f0-39e918ebf774 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:52.085757 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb30a1-66cb-44fb-91f0-39e918ebf774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:52.103243 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-d1bb30a1-66cb-44fb-91f0-39e918ebf774 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:43:52.104405 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-d1bb30a1-66cb-44fb-91f0-39e918ebf774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:43:52.168518 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 593/1187] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:43:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:43:52.190073 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe49ad-e0eb-4530-a220-b46975bf5ed2 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:52.221139 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:52.290073 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe49ad-e0eb-4530-a220-b46975bf5ed2 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:52.322995 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700c185-e304-4570-b9a3-1827d47a533a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:52.323596 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700c185-e304-4570-b9a3-1827d47a533a None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:52.323874 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700c185-e304-4570-b9a3-1827d47a533a None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:52.324141 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700c185-e304-4570-b9a3-1827d47a533a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:52.334748 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700c185-e304-4570-b9a3-1827d47a533a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:43:52.339272 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-9700c185-e304-4570-b9a3-1827d47a533a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:43:52.339272 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:43:52.339272 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:43:52.339272 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:43:52.339272 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:43:52.339272 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:43:52.339272 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:43:52.339272 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:43:52.339272 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:43:52.339272 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:43:52.339272 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:43:52.339272 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:43:52.339272 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:43:52.339272 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:43:52.339272 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:43:52.339272 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:43:52.340368 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:43:52.340368 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:43:52.340368 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:43:52.340368 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:43:52.340368 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:43:52.340368 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:43:52.340368 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:43:52.340368 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:43:52.340368 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:43:52.340368 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:43:52.340368 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:43:52.340368 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:43:52.340368 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:43:52.340368 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:43:52.340368 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:43:52.340368 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:43:52.341456 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:43:52.341456 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:43:52.341456 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:43:52.341456 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:43:52.341456 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:43:52.341456 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:43:52.341456 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:43:52.341456 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:43:52.341456 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:43:52.341456 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:43:52.341456 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:43:52.341456 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:43:52.341456 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 595/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:43:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:43:52.346569 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb30a1-66cb-44fb-91f0-39e918ebf774 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:52.413323 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:52.443267 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb30a1-66cb-44fb-91f0-39e918ebf774 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:52.475719 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f77139-2889-4d4b-b317-4e7ead41ff5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:52.476311 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f77139-2889-4d4b-b317-4e7ead41ff5d None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:52.476586 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f77139-2889-4d4b-b317-4e7ead41ff5d None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:52.476857 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f77139-2889-4d4b-b317-4e7ead41ff5d None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:52.477542 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f77139-2889-4d4b-b317-4e7ead41ff5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:52.477841 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f77139-2889-4d4b-b317-4e7ead41ff5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:52.479185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f77139-2889-4d4b-b317-4e7ead41ff5d None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:52.486919 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 594/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:43:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:52.493161 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700c185-e304-4570-b9a3-1827d47a533a None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:52.581128 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:52.590059 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700c185-e304-4570-b9a3-1827d47a533a None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:52.621963 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be15dfa-6c7f-43a2-ba5e-6ff6e4009415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:52.622836 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be15dfa-6c7f-43a2-ba5e-6ff6e4009415 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:52.623109 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be15dfa-6c7f-43a2-ba5e-6ff6e4009415 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:52.623373 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be15dfa-6c7f-43a2-ba5e-6ff6e4009415 None admin] PATH_INFO: `/v3/users/9dcbab1ac7ae479e8df93801dd4368b9` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:52.624476 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be15dfa-6c7f-43a2-ba5e-6ff6e4009415 None admin] RBAC: Authorizing `identity:get_user(user_id=9dcbab1ac7ae479e8df93801dd4368b9)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:52.626536 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be15dfa-6c7f-43a2-ba5e-6ff6e4009415 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:52.628075 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 596/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:43:52 2022] GET /identity/v3/users/9dcbab1ac7ae479e8df93801dd4368b9 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:52.633744 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f77139-2889-4d4b-b317-4e7ead41ff5d None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:52.729409 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f77139-2889-4d4b-b317-4e7ead41ff5d None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:52.757910 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:52.763043 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d09c8-1e0b-4a49-b31a-313cafbfd875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:52.763648 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d09c8-1e0b-4a49-b31a-313cafbfd875 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:52.763925 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d09c8-1e0b-4a49-b31a-313cafbfd875 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:52.764193 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d09c8-1e0b-4a49-b31a-313cafbfd875 None admin] PATH_INFO: `/v3/projects/9a003e4a61244394ae1e4b0e90701489` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:52.765295 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d09c8-1e0b-4a49-b31a-313cafbfd875 None admin] RBAC: Authorizing `identity:get_project(project_id=9a003e4a61244394ae1e4b0e90701489)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:52.766743 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d09c8-1e0b-4a49-b31a-313cafbfd875 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:52.768344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 595/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:43:52 2022] GET /identity/v3/projects/9a003e4a61244394ae1e4b0e90701489 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:52.774021 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be15dfa-6c7f-43a2-ba5e-6ff6e4009415 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:52.869035 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be15dfa-6c7f-43a2-ba5e-6ff6e4009415 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:52.901433 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43c527-cb0c-48e6-a3ef-31c4cb4564a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:52.902062 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43c527-cb0c-48e6-a3ef-31c4cb4564a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:52.902334 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43c527-cb0c-48e6-a3ef-31c4cb4564a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:52.902601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43c527-cb0c-48e6-a3ef-31c4cb4564a2 None admin] PATH_INFO: `/v3/projects/9a003e4a61244394ae1e4b0e90701489/users/9dcbab1ac7ae479e8df93801dd4368b9/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:52.904440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43c527-cb0c-48e6-a3ef-31c4cb4564a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a003e4a61244394ae1e4b0e90701489, user_id=9dcbab1ac7ae479e8df93801dd4368b9, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:52.905865 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43c527-cb0c-48e6-a3ef-31c4cb4564a2 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:52.918715 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 597/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 7 10:43:52 2022] PUT /identity/v3/projects/9a003e4a61244394ae1e4b0e90701489/users/9dcbab1ac7ae479e8df93801dd4368b9/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:43:54.928782 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd306fe-8cc3-4627-80eb-24d460605929 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:54.929367 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd306fe-8cc3-4627-80eb-24d460605929 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:54.929367 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd306fe-8cc3-4627-80eb-24d460605929 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:54.930693 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 596/1193] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:43:54.935803 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e64ea-629f-40cb-adfa-f1ae60be0222 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:54.936211 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e64ea-629f-40cb-adfa-f1ae60be0222 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:54.936347 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e64ea-629f-40cb-adfa-f1ae60be0222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:54.954437 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-4a0e64ea-629f-40cb-adfa-f1ae60be0222 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:43:54.955601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-4a0e64ea-629f-40cb-adfa-f1ae60be0222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:43:54.969013 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:55.024705 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 598/1194] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:43:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:43:55.047744 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd306fe-8cc3-4627-80eb-24d460605929 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:55.147918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd306fe-8cc3-4627-80eb-24d460605929 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:55.180378 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60301bb-bb95-4e0a-be4b-2e3cc0bd294d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:55.180951 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60301bb-bb95-4e0a-be4b-2e3cc0bd294d None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:55.181231 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60301bb-bb95-4e0a-be4b-2e3cc0bd294d None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:55.181531 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60301bb-bb95-4e0a-be4b-2e3cc0bd294d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:55.191899 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60301bb-bb95-4e0a-be4b-2e3cc0bd294d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:43:55.196503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-b60301bb-bb95-4e0a-be4b-2e3cc0bd294d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:43:55.196503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:43:55.196503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:43:55.196503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:43:55.196503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:43:55.196503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:43:55.196503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:43:55.196503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:43:55.196503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:43:55.196503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:43:55.196503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:43:55.196503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:43:55.196503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:43:55.196503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:43:55.196503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:43:55.196503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:43:55.197626 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:43:55.197626 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:43:55.197626 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:43:55.197626 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:43:55.197626 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:43:55.197626 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:43:55.197626 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:43:55.197626 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:43:55.197626 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:43:55.197626 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:43:55.197626 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:43:55.197626 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:43:55.197626 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:43:55.197626 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:43:55.197626 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:43:55.197626 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:43:55.198669 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:43:55.198669 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:43:55.198669 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:43:55.198669 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:43:55.198669 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:43:55.198669 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:43:55.198669 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:43:55.198669 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:43:55.198669 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:43:55.198669 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:43:55.198669 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:43:55.198669 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:43:55.198669 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 597/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:43:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:43:55.204051 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e64ea-629f-40cb-adfa-f1ae60be0222 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:55.297706 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e64ea-629f-40cb-adfa-f1ae60be0222 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:55.330431 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2015406-81b4-4515-9d76-623e42c1c24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:55.331022 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2015406-81b4-4515-9d76-623e42c1c24e None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:55.331290 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2015406-81b4-4515-9d76-623e42c1c24e None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:55.331549 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2015406-81b4-4515-9d76-623e42c1c24e None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:55.332203 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2015406-81b4-4515-9d76-623e42c1c24e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:55.332495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2015406-81b4-4515-9d76-623e42c1c24e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:55.333878 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2015406-81b4-4515-9d76-623e42c1c24e None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:55.345835 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 599/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:43:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:55.347539 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60301bb-bb95-4e0a-be4b-2e3cc0bd294d None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:55.404464 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:55.443539 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60301bb-bb95-4e0a-be4b-2e3cc0bd294d None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:55.475400 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875bd81-0d1a-49ed-9a73-1095011d4ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:55.476011 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875bd81-0d1a-49ed-9a73-1095011d4ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:55.476283 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875bd81-0d1a-49ed-9a73-1095011d4ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:55.476549 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e875bd81-0d1a-49ed-9a73-1095011d4ca3 None admin] PATH_INFO: `/v3/users/9dcbab1ac7ae479e8df93801dd4368b9` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:55.477671 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e875bd81-0d1a-49ed-9a73-1095011d4ca3 None admin] RBAC: Authorizing `identity:get_user(user_id=9dcbab1ac7ae479e8df93801dd4368b9)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:55.479082 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e875bd81-0d1a-49ed-9a73-1095011d4ca3 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:55.480625 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 598/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Sun Aug 7 10:43:55 2022] GET /identity/v3/users/9dcbab1ac7ae479e8df93801dd4368b9 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:55.486275 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2015406-81b4-4515-9d76-623e42c1c24e None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:55.502361 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:55.583843 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2015406-81b4-4515-9d76-623e42c1c24e None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:55.616811 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3847ec9-b764-46ab-b5b8-9c409d3f5f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:55.617431 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3847ec9-b764-46ab-b5b8-9c409d3f5f27 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:55.617711 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3847ec9-b764-46ab-b5b8-9c409d3f5f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:55.617982 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3847ec9-b764-46ab-b5b8-9c409d3f5f27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:55.682992 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3847ec9-b764-46ab-b5b8-9c409d3f5f27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:55.684433 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3847ec9-b764-46ab-b5b8-9c409d3f5f27 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:55.698058 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:55.779541 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 600/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:43:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 10:43:55.785614 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875bd81-0d1a-49ed-9a73-1095011d4ca3 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:55.880983 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e875bd81-0d1a-49ed-9a73-1095011d4ca3 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:55.905514 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:55.913600 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb7e94-d3e7-4292-b90d-06ebec689697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:55.914201 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb7e94-d3e7-4292-b90d-06ebec689697 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:55.914472 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb7e94-d3e7-4292-b90d-06ebec689697 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:55.914736 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb7e94-d3e7-4292-b90d-06ebec689697 None admin] PATH_INFO: `/v3/projects/9a003e4a61244394ae1e4b0e90701489` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:55.915821 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb7e94-d3e7-4292-b90d-06ebec689697 None admin] RBAC: Authorizing `identity:get_project(project_id=9a003e4a61244394ae1e4b0e90701489)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:55.917212 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb7e94-d3e7-4292-b90d-06ebec689697 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:55.918821 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 599/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Sun Aug 7 10:43:55 2022] GET /identity/v3/projects/9a003e4a61244394ae1e4b0e90701489 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:43:55.925285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3847ec9-b764-46ab-b5b8-9c409d3f5f27 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:43:56.020538 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3847ec9-b764-46ab-b5b8-9c409d3f5f27 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:43:56.033560 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:43:56.053724 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2df250-824d-4f41-a833-e0c14fbc7527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:43:56.054338 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2df250-824d-4f41-a833-e0c14fbc7527 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:43:56.054612 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2df250-824d-4f41-a833-e0c14fbc7527 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:43:56.054879 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2df250-824d-4f41-a833-e0c14fbc7527 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:43:56.055605 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2df250-824d-4f41-a833-e0c14fbc7527 None admin] RBAC: Adding query filter params (role.id=9da6e501237c405ca021a9d9f6173caf, scope.project.id=9a003e4a61244394ae1e4b0e90701489, user.id=9dcbab1ac7ae479e8df93801dd4368b9) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:43:56.055907 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2df250-824d-4f41-a833-e0c14fbc7527 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:43:56.057307 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2df250-824d-4f41-a833-e0c14fbc7527 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:43:56.063395 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 601/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:43:55 2022] GET /identity/v3/role_assignments?user.id=9dcbab1ac7ae479e8df93801dd4368b9&scope.project.id=9a003e4a61244394ae1e4b0e90701489&role.id=9da6e501237c405ca021a9d9f6173caf => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:44:05.909871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=2 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:44:06.060317 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=12 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:44:50.617195 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cb1e5-b0c2-4cc0-a876-070a29b7150f None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:44:50.617818 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cb1e5-b0c2-4cc0-a876-070a29b7150f None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:44:50.617818 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cb1e5-b0c2-4cc0-a876-070a29b7150f None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:44:50.619970 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 600/1201] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:44:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:44:50.626282 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d79c3-8b37-40ed-9023-86bd445f51c2 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:44:50.626759 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d79c3-8b37-40ed-9023-86bd445f51c2 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:44:50.626845 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d79c3-8b37-40ed-9023-86bd445f51c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:44:50.648147 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-363d79c3-8b37-40ed-9023-86bd445f51c2 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:44:50.649857 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-363d79c3-8b37-40ed-9023-86bd445f51c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:44:50.737366 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 602/1202] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:44:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:44:50.768493 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cb1e5-b0c2-4cc0-a876-070a29b7150f None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:44:50.895451 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cb1e5-b0c2-4cc0-a876-070a29b7150f None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:44:50.935860 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc6312-4c10-4b99-859a-9966eb9c9804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:44:50.936590 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc6312-4c10-4b99-859a-9966eb9c9804 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:44:50.937029 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc6312-4c10-4b99-859a-9966eb9c9804 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:44:50.937292 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc6312-4c10-4b99-859a-9966eb9c9804 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:44:50.949950 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc6312-4c10-4b99-859a-9966eb9c9804 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:44:50.951972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc6312-4c10-4b99-859a-9966eb9c9804 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:44:50.970591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-02fc6312-4c10-4b99-859a-9966eb9c9804 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:44:50.970591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:44:50.970591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:44:50.970591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:44:50.970591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:44:50.970591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:44:50.970591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:44:50.970591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:44:50.970591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:44:50.970591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:44:50.970591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:44:50.970591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:44:50.970591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:44:50.970591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:44:50.970591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:44:50.970591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:44:50.971728 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:44:50.971728 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:44:50.971728 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:44:50.971728 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:44:50.971728 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:44:50.971728 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:44:50.971728 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:44:50.971728 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:44:50.971728 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:44:50.971728 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:44:50.971728 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:44:50.971728 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:44:50.971728 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:44:50.971728 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:44:50.971728 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:44:50.971728 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:44:50.971728 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:44:50.972716 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:44:50.972716 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:44:50.972716 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:44:50.972716 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 601/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:44:50.979583 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d79c3-8b37-40ed-9023-86bd445f51c2 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:44:51.126879 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d79c3-8b37-40ed-9023-86bd445f51c2 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:44:51.172088 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:44:51.179279 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71560c-cbf1-4734-b96e-e8c04085d49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:44:51.180212 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71560c-cbf1-4734-b96e-e8c04085d49f None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:44:51.180768 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71560c-cbf1-4734-b96e-e8c04085d49f None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:44:51.181110 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71560c-cbf1-4734-b96e-e8c04085d49f None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:44:51.181926 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71560c-cbf1-4734-b96e-e8c04085d49f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:44:51.182297 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71560c-cbf1-4734-b96e-e8c04085d49f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:44:51.184266 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71560c-cbf1-4734-b96e-e8c04085d49f None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:44:51.199153 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 603/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:44:51.205812 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc6312-4c10-4b99-859a-9966eb9c9804 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:44:51.294284 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:44:51.375645 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc6312-4c10-4b99-859a-9966eb9c9804 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:44:51.419641 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed73ea7-20fd-46e4-9e6b-43c56d63d6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:44:51.420294 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed73ea7-20fd-46e4-9e6b-43c56d63d6cc None admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:44:51.420565 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed73ea7-20fd-46e4-9e6b-43c56d63d6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:44:51.420840 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed73ea7-20fd-46e4-9e6b-43c56d63d6cc None admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:44:51.421931 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed73ea7-20fd-46e4-9e6b-43c56d63d6cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:44:51.423500 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed73ea7-20fd-46e4-9e6b-43c56d63d6cc None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:44:51.462466 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 602/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Sun Aug 7 10:44:51 2022] POST /identity/v3/users => generated 251 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 10:44:53.769130 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d093ec-ec14-4fca-9424-7c42736c78a2 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:44:53.769723 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d093ec-ec14-4fca-9424-7c42736c78a2 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:44:53.769817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d093ec-ec14-4fca-9424-7c42736c78a2 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:44:53.771164 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 604/1206] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:44:53.777031 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae64041-9db1-4932-84d1-96680252cc63 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:44:53.777477 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae64041-9db1-4932-84d1-96680252cc63 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:44:53.777616 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae64041-9db1-4932-84d1-96680252cc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:44:53.798488 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-0ae64041-9db1-4932-84d1-96680252cc63 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:44:53.799871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-0ae64041-9db1-4932-84d1-96680252cc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:44:53.877336 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 603/1207] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:44:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:44:53.901117 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d093ec-ec14-4fca-9424-7c42736c78a2 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:44:54.035838 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d093ec-ec14-4fca-9424-7c42736c78a2 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:44:54.074277 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f6aaa-822d-41ee-a6ed-df132cbc4754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:44:54.074900 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f6aaa-822d-41ee-a6ed-df132cbc4754 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:44:54.075178 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f6aaa-822d-41ee-a6ed-df132cbc4754 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:44:54.075487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f6aaa-822d-41ee-a6ed-df132cbc4754 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:44:54.086814 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f6aaa-822d-41ee-a6ed-df132cbc4754 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:44:54.091426 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-0b3f6aaa-822d-41ee-a6ed-df132cbc4754 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:44:54.091426 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:44:54.091426 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:44:54.091426 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:44:54.091426 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:44:54.091426 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:44:54.091426 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:44:54.091426 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:44:54.091426 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:44:54.091426 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:44:54.091426 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:44:54.091426 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:44:54.091426 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:44:54.091426 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:44:54.091426 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:44:54.091426 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:44:54.092444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:44:54.092444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:44:54.092444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:44:54.092444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:44:54.092444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:44:54.092444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:44:54.092444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:44:54.092444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:44:54.092444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:44:54.092444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:44:54.092444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:44:54.092444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:44:54.092444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:44:54.092444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:44:54.092444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:44:54.092444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:44:54.094820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:44:54.094820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:44:54.094820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:44:54.094820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:44:54.094820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:44:54.094820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:44:54.094820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:44:54.094820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:44:54.094820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:44:54.094820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:44:54.094820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:44:54.094820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:44:54.099191 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 605/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 7 10:44:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:44:54.102578 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae64041-9db1-4932-84d1-96680252cc63 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:44:54.145597 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:44:54.217033 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae64041-9db1-4932-84d1-96680252cc63 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:44:54.254978 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade11caf-6cc8-452b-8b8c-a51d8ea9622d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:44:54.255589 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade11caf-6cc8-452b-8b8c-a51d8ea9622d None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:44:54.255999 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade11caf-6cc8-452b-8b8c-a51d8ea9622d None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:44:54.256395 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade11caf-6cc8-452b-8b8c-a51d8ea9622d None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:44:54.257067 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade11caf-6cc8-452b-8b8c-a51d8ea9622d None admin] RBAC: Adding query filter params (name=service) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:44:54.257593 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade11caf-6cc8-452b-8b8c-a51d8ea9622d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:44:54.259112 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade11caf-6cc8-452b-8b8c-a51d8ea9622d None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:44:54.269393 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 604/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 7 10:44:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:44:54.276835 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f6aaa-822d-41ee-a6ed-df132cbc4754 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:44:54.332291 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:44:54.389273 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f6aaa-822d-41ee-a6ed-df132cbc4754 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:44:54.427360 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58048662-1078-40e3-bf8e-879ef2da35c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:44:54.428028 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58048662-1078-40e3-bf8e-879ef2da35c5 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:44:54.428304 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58048662-1078-40e3-bf8e-879ef2da35c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:44:54.428582 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58048662-1078-40e3-bf8e-879ef2da35c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:44:54.440353 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58048662-1078-40e3-bf8e-879ef2da35c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:44:54.441886 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58048662-1078-40e3-bf8e-879ef2da35c5 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:44:54.457376 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-58048662-1078-40e3-bf8e-879ef2da35c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:44:54.457376 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:44:54.457376 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:44:54.457376 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:44:54.457376 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:44:54.457376 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:44:54.457376 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:44:54.457376 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:44:54.457376 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:44:54.457376 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:44:54.457376 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:44:54.457376 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:44:54.457376 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:44:54.457376 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:44:54.457376 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:44:54.457376 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:44:54.458358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:44:54.458358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:44:54.458358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:44:54.458358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:44:54.458358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:44:54.458358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:44:54.458358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:44:54.458358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:44:54.458358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:44:54.458358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:44:54.458358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:44:54.458358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:44:54.458358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:44:54.458358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:44:54.458358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:44:54.458358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:44:54.458358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:44:54.462401 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:44:54.462401 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:44:54.462401 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:44:54.462401 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 606/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:44:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:44:54.464582 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade11caf-6cc8-452b-8b8c-a51d8ea9622d None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:44:54.583975 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:44:54.588871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade11caf-6cc8-452b-8b8c-a51d8ea9622d None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:44:54.628835 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2a45b-3ca2-483a-8560-3636df7136e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:44:54.629463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2a45b-3ca2-483a-8560-3636df7136e6 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:44:54.629733 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2a45b-3ca2-483a-8560-3636df7136e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:44:54.629998 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2a45b-3ca2-483a-8560-3636df7136e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:44:54.630653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e2a45b-3ca2-483a-8560-3636df7136e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:44:54.630923 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e2a45b-3ca2-483a-8560-3636df7136e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:44:54.632308 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e2a45b-3ca2-483a-8560-3636df7136e6 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:44:54.644960 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 605/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:44:54.650537 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58048662-1078-40e3-bf8e-879ef2da35c5 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:44:54.762854 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58048662-1078-40e3-bf8e-879ef2da35c5 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:44:54.765286 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:44:54.811121 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284905ea-7bef-4428-913a-4539dc8e0a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:44:54.812654 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284905ea-7bef-4428-913a-4539dc8e0a1e None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:44:54.813455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284905ea-7bef-4428-913a-4539dc8e0a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:44:54.813455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284905ea-7bef-4428-913a-4539dc8e0a1e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:44:54.821884 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284905ea-7bef-4428-913a-4539dc8e0a1e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:44:54.823484 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284905ea-7bef-4428-913a-4539dc8e0a1e None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:44:54.836552 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-284905ea-7bef-4428-913a-4539dc8e0a1e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 10:44:54.836552 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:44:54.836552 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:44:54.836552 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:44:54.836552 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:44:54.836552 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:44:54.836552 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:44:54.836552 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:44:54.836552 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:44:54.836552 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:44:54.836552 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:44:54.836552 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:44:54.836552 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:44:54.836552 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:44:54.836552 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:44:54.836552 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:44:54.837792 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:44:54.837792 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:44:54.837792 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:44:54.837792 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:44:54.837792 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:44:54.837792 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:44:54.837792 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:44:54.837792 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:44:54.837792 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:44:54.837792 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:44:54.837792 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:44:54.837792 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:44:54.837792 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:44:54.837792 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:44:54.837792 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:44:54.837792 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:44:54.837792 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:44:54.837792 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:44:54.839040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:44:54.839040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:44:54.839040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:44:54.839040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:44:54.839040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:44:54.839040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:44:54.839040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:44:54.839040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:44:54.839040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 10:44:54.839040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:44:54.839040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 607/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:44:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:44:54.844676 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2a45b-3ca2-483a-8560-3636df7136e6 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:44:54.961565 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2a45b-3ca2-483a-8560-3636df7136e6 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:44:55.000568 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b406a53-2759-4153-b57e-2d993594c920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:44:55.001192 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b406a53-2759-4153-b57e-2d993594c920 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:44:55.001526 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b406a53-2759-4153-b57e-2d993594c920 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:44:55.001783 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b406a53-2759-4153-b57e-2d993594c920 None admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:44:55.002516 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b406a53-2759-4153-b57e-2d993594c920 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:44:55.002794 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b406a53-2759-4153-b57e-2d993594c920 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:44:55.004275 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b406a53-2759-4153-b57e-2d993594c920 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:44:55.024305 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 606/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Sun Aug 7 10:44:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:44:55.030011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284905ea-7bef-4428-913a-4539dc8e0a1e None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:44:55.164621 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284905ea-7bef-4428-913a-4539dc8e0a1e None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:44:55.204241 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8857a98-1715-44b3-94f9-709be7acfb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:44:55.205050 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8857a98-1715-44b3-94f9-709be7acfb4d None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:44:55.205380 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8857a98-1715-44b3-94f9-709be7acfb4d None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:44:55.205708 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8857a98-1715-44b3-94f9-709be7acfb4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:44:55.240774 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:44:55.287835 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8857a98-1715-44b3-94f9-709be7acfb4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:44:55.290015 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8857a98-1715-44b3-94f9-709be7acfb4d None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:44:55.421924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 608/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:44:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 10:44:55.422576 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b406a53-2759-4153-b57e-2d993594c920 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:44:55.447409 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:44:55.542593 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b406a53-2759-4153-b57e-2d993594c920 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:44:55.585011 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2edd67-c09b-4c79-8e89-9710def08e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:44:55.585852 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2edd67-c09b-4c79-8e89-9710def08e57 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:44:55.586173 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2edd67-c09b-4c79-8e89-9710def08e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:44:55.586451 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2edd67-c09b-4c79-8e89-9710def08e57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:44:55.598613 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2edd67-c09b-4c79-8e89-9710def08e57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:44:55.600281 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2edd67-c09b-4c79-8e89-9710def08e57 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:44:55.616353 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-3b2edd67-c09b-4c79-8e89-9710def08e57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:44:55.616353 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:44:55.616353 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:44:55.616353 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:44:55.616353 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:44:55.616353 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:44:55.616353 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:44:55.616353 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:44:55.616353 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:44:55.616353 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:44:55.616353 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:44:55.616353 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:44:55.616353 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:44:55.616353 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:44:55.616353 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:44:55.616353 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:44:55.617397 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:44:55.617397 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:44:55.617397 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:44:55.617397 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:44:55.617397 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:44:55.617397 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:44:55.617397 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:44:55.617397 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:44:55.617397 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:44:55.617397 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:44:55.617397 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:44:55.617397 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:44:55.617397 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:44:55.617397 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:44:55.617397 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:44:55.617397 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:44:55.617397 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:44:55.623274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:44:55.623274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:44:55.623274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:44:55.623274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 607/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:44:55.623553 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8857a98-1715-44b3-94f9-709be7acfb4d None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:44:55.700856 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:44:55.745648 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8857a98-1715-44b3-94f9-709be7acfb4d None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:44:55.789046 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852d683-0968-4aec-badd-02329cb0db01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:44:55.789927 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852d683-0968-4aec-badd-02329cb0db01 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:44:55.790427 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852d683-0968-4aec-badd-02329cb0db01 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:44:55.790872 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852d683-0968-4aec-badd-02329cb0db01 None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:44:55.791830 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852d683-0968-4aec-badd-02329cb0db01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:44:55.792428 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852d683-0968-4aec-badd-02329cb0db01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:44:55.794187 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852d683-0968-4aec-badd-02329cb0db01 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:44:55.808695 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 609/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:44:55.813460 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2edd67-c09b-4c79-8e89-9710def08e57 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:44:55.901685 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:44:55.935238 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2edd67-c09b-4c79-8e89-9710def08e57 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:44:55.975891 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03217a-fb0f-41f2-bab4-1ed766a0ae9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:44:55.976400 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03217a-fb0f-41f2-bab4-1ed766a0ae9b None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:44:55.976752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03217a-fb0f-41f2-bab4-1ed766a0ae9b None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:44:55.977086 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03217a-fb0f-41f2-bab4-1ed766a0ae9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:44:55.985112 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03217a-fb0f-41f2-bab4-1ed766a0ae9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:44:55.986585 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03217a-fb0f-41f2-bab4-1ed766a0ae9b None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:44:55.998317 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-fa03217a-fb0f-41f2-bab4-1ed766a0ae9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:44:55.998317 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:44:55.998317 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:44:55.998317 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:44:55.998317 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:44:55.998317 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:44:55.998317 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:44:55.998317 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:44:55.998317 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:44:55.998317 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:44:55.998317 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:44:55.998317 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:44:55.998317 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:44:55.998317 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:44:55.998317 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:44:56.001061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:44:56.001061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:44:56.001061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:44:56.001061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:44:56.001061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:44:56.001061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:44:56.001061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:44:56.001061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:44:56.001061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:44:56.001061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:44:56.001061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:44:56.001061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:44:56.001061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:44:56.001061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:44:56.001061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:44:56.001061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:44:56.001061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:44:56.002411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:44:56.002411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:44:56.002411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:44:56.002411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:44:56.002411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:44:56.002411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:44:56.002411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:44:56.002411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:44:56.002411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 608/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:44:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:44:56.006690 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852d683-0968-4aec-badd-02329cb0db01 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:44:56.125395 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852d683-0968-4aec-badd-02329cb0db01 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:44:56.150352 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:44:56.164624 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06554f-a42e-4f4b-afff-deaa38fde2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:44:56.166412 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06554f-a42e-4f4b-afff-deaa38fde2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:44:56.166701 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06554f-a42e-4f4b-afff-deaa38fde2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:44:56.166970 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06554f-a42e-4f4b-afff-deaa38fde2c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:44:56.167665 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06554f-a42e-4f4b-afff-deaa38fde2c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:44:56.167994 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06554f-a42e-4f4b-afff-deaa38fde2c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:44:56.169413 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06554f-a42e-4f4b-afff-deaa38fde2c6 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:44:56.183373 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 610/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:44:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:44:56.190462 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03217a-fb0f-41f2-bab4-1ed766a0ae9b None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:44:56.300988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03217a-fb0f-41f2-bab4-1ed766a0ae9b None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:44:56.337197 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:44:56.347531 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958e17e-0981-42bc-9703-70ec4a28f304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:44:56.347866 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958e17e-0981-42bc-9703-70ec4a28f304 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:44:56.348364 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958e17e-0981-42bc-9703-70ec4a28f304 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:44:56.348769 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958e17e-0981-42bc-9703-70ec4a28f304 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:44:56.349912 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958e17e-0981-42bc-9703-70ec4a28f304 None admin] RBAC: Adding query filter params (role.id=bf9e51dafeac420f89a66e78e1463982, scope.project.id=62eed8550ae3403f8a75894dbd19cf4a, user.id=b33f797a9af946a4b296d973388891be) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:44:56.350514 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958e17e-0981-42bc-9703-70ec4a28f304 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:44:56.352621 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958e17e-0981-42bc-9703-70ec4a28f304 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:44:56.367638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 609/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:44:56 2022] GET /identity/v3/role_assignments?user.id=b33f797a9af946a4b296d973388891be&scope.project.id=62eed8550ae3403f8a75894dbd19cf4a&role.id=bf9e51dafeac420f89a66e78e1463982 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:44:58.456690 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacab59-f0c4-4a42-bf9a-b28eeaa5027c None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:44:58.457475 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacab59-f0c4-4a42-bf9a-b28eeaa5027c None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:44:58.457475 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacab59-f0c4-4a42-bf9a-b28eeaa5027c None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:44:58.458633 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 611/1220] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:44:58.463959 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad2186-f1db-4f37-855f-d02df19dca80 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:44:58.464557 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad2186-f1db-4f37-855f-d02df19dca80 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:44:58.464557 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad2186-f1db-4f37-855f-d02df19dca80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:44:58.485764 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-bdad2186-f1db-4f37-855f-d02df19dca80 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:44:58.487017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-bdad2186-f1db-4f37-855f-d02df19dca80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:44:58.558475 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 610/1221] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:44:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:44:58.585912 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceacab59-f0c4-4a42-bf9a-b28eeaa5027c None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:44:58.697995 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceacab59-f0c4-4a42-bf9a-b28eeaa5027c None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:44:58.731622 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d957878-b3c9-4100-868f-b494af8dfb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:44:58.732521 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d957878-b3c9-4100-868f-b494af8dfb45 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:44:58.732926 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d957878-b3c9-4100-868f-b494af8dfb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:44:58.733198 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d957878-b3c9-4100-868f-b494af8dfb45 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:44:58.744180 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d957878-b3c9-4100-868f-b494af8dfb45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:44:58.750632 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-8d957878-b3c9-4100-868f-b494af8dfb45 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:44:58.750632 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:44:58.750632 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:44:58.750632 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:44:58.750632 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:44:58.750632 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:44:58.750632 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:44:58.750632 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:44:58.750632 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:44:58.750632 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:44:58.750632 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:44:58.750632 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:44:58.750632 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:44:58.750632 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:44:58.750632 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:44:58.750632 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:44:58.752057 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:44:58.752057 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:44:58.752057 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:44:58.752057 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:44:58.752057 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:44:58.752057 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:44:58.752057 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:44:58.752057 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:44:58.752057 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:44:58.752057 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:44:58.752057 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:44:58.752057 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:44:58.752057 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:44:58.752057 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:44:58.752057 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:44:58.752057 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:44:58.753165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:44:58.753165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:44:58.753165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:44:58.753165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:44:58.753165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:44:58.753165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:44:58.753165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:44:58.753165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:44:58.753165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:44:58.753165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:44:58.753165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:44:58.753165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:44:58.753165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 612/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 7 10:44:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:44:58.758137 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad2186-f1db-4f37-855f-d02df19dca80 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:44:58.864502 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad2186-f1db-4f37-855f-d02df19dca80 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:44:58.893621 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:44:58.904820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5059a11-6569-4544-9a75-ff36b3ba0821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:44:58.905500 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5059a11-6569-4544-9a75-ff36b3ba0821 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:44:58.905803 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5059a11-6569-4544-9a75-ff36b3ba0821 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:44:58.906204 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5059a11-6569-4544-9a75-ff36b3ba0821 None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:44:58.906942 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5059a11-6569-4544-9a75-ff36b3ba0821 None admin] RBAC: Adding query filter params (name=service) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:44:58.907262 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5059a11-6569-4544-9a75-ff36b3ba0821 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:44:58.908628 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5059a11-6569-4544-9a75-ff36b3ba0821 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:44:58.916659 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 611/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 7 10:44:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:44:58.923576 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d957878-b3c9-4100-868f-b494af8dfb45 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:44:58.972954 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:44:59.044608 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d957878-b3c9-4100-868f-b494af8dfb45 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:44:59.083408 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dea8b7-c088-4c1c-aad5-ae8aa2121e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:44:59.084247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dea8b7-c088-4c1c-aad5-ae8aa2121e53 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:44:59.084870 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dea8b7-c088-4c1c-aad5-ae8aa2121e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:44:59.085303 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dea8b7-c088-4c1c-aad5-ae8aa2121e53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:44:59.102470 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dea8b7-c088-4c1c-aad5-ae8aa2121e53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:44:59.105458 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dea8b7-c088-4c1c-aad5-ae8aa2121e53 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:44:59.121764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-a6dea8b7-c088-4c1c-aad5-ae8aa2121e53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:44:59.121764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:44:59.121764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:44:59.121764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:44:59.121764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:44:59.121764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:44:59.121764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:44:59.121764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:44:59.121764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:44:59.121764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:44:59.121764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:44:59.121764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:44:59.121764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:44:59.121764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:44:59.121764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:44:59.121764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:44:59.122924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:44:59.122924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:44:59.122924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:44:59.122924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:44:59.122924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:44:59.122924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:44:59.122924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:44:59.122924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:44:59.122924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:44:59.122924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:44:59.122924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:44:59.122924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:44:59.122924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:44:59.122924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:44:59.122924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:44:59.122924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:44:59.122924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:44:59.124022 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:44:59.124022 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:44:59.124022 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:44:59.124022 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 613/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:44:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:44:59.131678 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5059a11-6569-4544-9a75-ff36b3ba0821 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:44:59.244616 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5059a11-6569-4544-9a75-ff36b3ba0821 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:44:59.278944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1bc4f-a06e-4da0-9647-a9f7e7d24268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:44:59.279543 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1bc4f-a06e-4da0-9647-a9f7e7d24268 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:44:59.279860 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1bc4f-a06e-4da0-9647-a9f7e7d24268 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:44:59.280131 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1bc4f-a06e-4da0-9647-a9f7e7d24268 None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:44:59.280804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d1bc4f-a06e-4da0-9647-a9f7e7d24268 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:44:59.281650 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d1bc4f-a06e-4da0-9647-a9f7e7d24268 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:44:59.283098 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d1bc4f-a06e-4da0-9647-a9f7e7d24268 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:44:59.302356 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 612/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:44:59.303906 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dea8b7-c088-4c1c-aad5-ae8aa2121e53 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:44:59.408248 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:44:59.415281 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dea8b7-c088-4c1c-aad5-ae8aa2121e53 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:44:59.450038 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026adb7-61f5-4445-b0b9-d159c89dfebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:44:59.450662 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026adb7-61f5-4445-b0b9-d159c89dfebd None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:44:59.450937 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026adb7-61f5-4445-b0b9-d159c89dfebd None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:44:59.451287 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026adb7-61f5-4445-b0b9-d159c89dfebd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:44:59.459248 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026adb7-61f5-4445-b0b9-d159c89dfebd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:44:59.460650 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026adb7-61f5-4445-b0b9-d159c89dfebd None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:44:59.473440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-7026adb7-61f5-4445-b0b9-d159c89dfebd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 10:44:59.473440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:44:59.473440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:44:59.473440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:44:59.473440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:44:59.473440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:44:59.473440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:44:59.473440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:44:59.473440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:44:59.473440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:44:59.473440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:44:59.473440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:44:59.473440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:44:59.473440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:44:59.473440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:44:59.473440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:44:59.474443 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:44:59.474443 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:44:59.474443 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:44:59.474443 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:44:59.474443 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:44:59.474443 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:44:59.474443 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:44:59.474443 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:44:59.474443 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:44:59.474443 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:44:59.474443 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:44:59.474443 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:44:59.474443 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:44:59.474443 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:44:59.474443 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:44:59.474443 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:44:59.474443 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:44:59.474443 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:44:59.475498 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:44:59.475498 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:44:59.475498 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:44:59.475498 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:44:59.475498 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:44:59.475498 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:44:59.475498 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:44:59.475498 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:44:59.475498 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 10:44:59.475498 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:44:59.479912 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 614/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:44:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:44:59.480913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1bc4f-a06e-4da0-9647-a9f7e7d24268 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:44:59.538728 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:44:59.596276 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1bc4f-a06e-4da0-9647-a9f7e7d24268 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:44:59.632354 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef43c89-daaf-45b9-ab2b-f1e951d18c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:44:59.632952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef43c89-daaf-45b9-ab2b-f1e951d18c8d None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:44:59.633221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef43c89-daaf-45b9-ab2b-f1e951d18c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:44:59.633513 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef43c89-daaf-45b9-ab2b-f1e951d18c8d None admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:44:59.634233 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef43c89-daaf-45b9-ab2b-f1e951d18c8d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:44:59.634529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef43c89-daaf-45b9-ab2b-f1e951d18c8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:44:59.635927 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef43c89-daaf-45b9-ab2b-f1e951d18c8d None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:44:59.654339 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 613/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Sun Aug 7 10:44:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:44:59.660428 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026adb7-61f5-4445-b0b9-d159c89dfebd None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:44:59.774306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026adb7-61f5-4445-b0b9-d159c89dfebd None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:44:59.811212 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523cb8b-79ee-49d5-ae7d-8354d5be0d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:44:59.811826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523cb8b-79ee-49d5-ae7d-8354d5be0d62 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:44:59.812168 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523cb8b-79ee-49d5-ae7d-8354d5be0d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:44:59.812440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523cb8b-79ee-49d5-ae7d-8354d5be0d62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:44:59.824368 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523cb8b-79ee-49d5-ae7d-8354d5be0d62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:44:59.826191 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523cb8b-79ee-49d5-ae7d-8354d5be0d62 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:44:59.843853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-6523cb8b-79ee-49d5-ae7d-8354d5be0d62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:44:59.843853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:44:59.843853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:44:59.843853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:44:59.843853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:44:59.843853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:44:59.843853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:44:59.843853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:44:59.843853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:44:59.843853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:44:59.843853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:44:59.843853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:44:59.843853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:44:59.843853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:44:59.843853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:44:59.843853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:44:59.845012 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:44:59.845012 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:44:59.845012 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:44:59.845012 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:44:59.845012 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:44:59.845012 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:44:59.845012 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:44:59.845012 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:44:59.845012 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:44:59.845012 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:44:59.845012 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:44:59.845012 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:44:59.845012 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:44:59.845012 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:44:59.845012 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:44:59.845012 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:44:59.845012 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:44:59.845950 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:44:59.845950 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:44:59.845950 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:44:59.845950 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 615/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:44:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:44:59.850905 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef43c89-daaf-45b9-ab2b-f1e951d18c8d None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:44:59.958871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef43c89-daaf-45b9-ab2b-f1e951d18c8d None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:44:59.961149 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:44:59.997649 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e51f3-4c0e-4697-a7e3-b0f547e1fe8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:44:59.998262 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e51f3-4c0e-4697-a7e3-b0f547e1fe8a None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:44:59.998565 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e51f3-4c0e-4697-a7e3-b0f547e1fe8a None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:44:59.998806 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e51f3-4c0e-4697-a7e3-b0f547e1fe8a None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:44:59.999804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e51f3-4c0e-4697-a7e3-b0f547e1fe8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:45:00.000043 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e51f3-4c0e-4697-a7e3-b0f547e1fe8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:00.001560 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e51f3-4c0e-4697-a7e3-b0f547e1fe8a None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:00.015120 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 614/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:45:00.021513 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523cb8b-79ee-49d5-ae7d-8354d5be0d62 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:00.032266 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:00.142700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523cb8b-79ee-49d5-ae7d-8354d5be0d62 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:00.183684 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdeadab-db81-40b5-8200-093077d9d9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:00.184315 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdeadab-db81-40b5-8200-093077d9d9b0 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:00.184586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdeadab-db81-40b5-8200-093077d9d9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:00.184852 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdeadab-db81-40b5-8200-093077d9d9b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:00.191789 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdeadab-db81-40b5-8200-093077d9d9b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:00.193215 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdeadab-db81-40b5-8200-093077d9d9b0 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:00.204950 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-6fdeadab-db81-40b5-8200-093077d9d9b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:45:00.204950 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:45:00.204950 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:45:00.204950 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:45:00.204950 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:45:00.204950 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:45:00.204950 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:45:00.204950 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:45:00.204950 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:45:00.204950 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:45:00.204950 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:45:00.204950 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:45:00.204950 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:45:00.204950 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:45:00.204950 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:45:00.206103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:45:00.206103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:45:00.206103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:45:00.206103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:45:00.206103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:45:00.206103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:45:00.206103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:45:00.206103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:45:00.206103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:45:00.206103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:45:00.206103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:45:00.206103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:45:00.206103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:45:00.206103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:45:00.206103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:45:00.206103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:45:00.206103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:45:00.207219 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:45:00.207219 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:45:00.207219 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:45:00.207219 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:45:00.207219 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:45:00.207219 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:45:00.207219 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:45:00.207219 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:45:00.207219 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 616/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:45:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:45:00.212870 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e51f3-4c0e-4697-a7e3-b0f547e1fe8a None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:00.321638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e51f3-4c0e-4697-a7e3-b0f547e1fe8a None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:00.358645 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e169e-d8a8-4cd6-8943-6a15e1805c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:00.359737 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e169e-d8a8-4cd6-8943-6a15e1805c05 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:00.360013 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e169e-d8a8-4cd6-8943-6a15e1805c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:00.360280 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e169e-d8a8-4cd6-8943-6a15e1805c05 None admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:00.360965 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e169e-d8a8-4cd6-8943-6a15e1805c05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:45:00.361265 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e169e-d8a8-4cd6-8943-6a15e1805c05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:00.362698 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e169e-d8a8-4cd6-8943-6a15e1805c05 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:00.376447 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 615/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:45:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:45:00.383472 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdeadab-db81-40b5-8200-093077d9d9b0 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:00.451906 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:00.491558 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdeadab-db81-40b5-8200-093077d9d9b0 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:00.530392 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c19b9-991f-4260-bce1-8109bba1d6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:00.531796 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c19b9-991f-4260-bce1-8109bba1d6ff None admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:00.532226 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c19b9-991f-4260-bce1-8109bba1d6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:00.532530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c19b9-991f-4260-bce1-8109bba1d6ff None admin] PATH_INFO: `/v3/projects/62eed8550ae3403f8a75894dbd19cf4a/users/b33f797a9af946a4b296d973388891be/roles/bf9e51dafeac420f89a66e78e1463982` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:00.551142 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c19b9-991f-4260-bce1-8109bba1d6ff None admin] RBAC: Authorizing `identity:create_grant(project_id=62eed8550ae3403f8a75894dbd19cf4a, user_id=b33f797a9af946a4b296d973388891be, role_id=bf9e51dafeac420f89a66e78e1463982)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:00.552770 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c19b9-991f-4260-bce1-8109bba1d6ff None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:00.567889 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 617/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 7 10:45:00 2022] PUT /identity/v3/projects/62eed8550ae3403f8a75894dbd19cf4a/users/b33f797a9af946a4b296d973388891be/roles/bf9e51dafeac420f89a66e78e1463982 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:45:02.623566 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99914a4-e3d0-418a-a9df-75ead8e8431d None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:02.624148 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99914a4-e3d0-418a-a9df-75ead8e8431d None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:02.624148 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99914a4-e3d0-418a-a9df-75ead8e8431d None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:02.625801 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 616/1233] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:45:02.630910 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f913eea-f9ed-4f47-9463-bc2538dd32c2 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:02.631487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f913eea-f9ed-4f47-9463-bc2538dd32c2 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:02.631487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f913eea-f9ed-4f47-9463-bc2538dd32c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:02.652504 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-2f913eea-f9ed-4f47-9463-bc2538dd32c2 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:45:02.654014 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-2f913eea-f9ed-4f47-9463-bc2538dd32c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:45:02.731949 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 618/1234] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:45:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:45:02.760454 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99914a4-e3d0-418a-a9df-75ead8e8431d None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:02.790979 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:02.872915 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99914a4-e3d0-418a-a9df-75ead8e8431d None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:02.910234 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082af53-ccf8-4cf9-81a1-851975382830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:02.910893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082af53-ccf8-4cf9-81a1-851975382830 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:02.911218 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082af53-ccf8-4cf9-81a1-851975382830 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:02.911520 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082af53-ccf8-4cf9-81a1-851975382830 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:02.923316 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082af53-ccf8-4cf9-81a1-851975382830 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:45:02.928633 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-c082af53-ccf8-4cf9-81a1-851975382830 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:45:02.928633 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:45:02.928633 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:45:02.928633 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:45:02.928633 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:45:02.928633 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:45:02.928633 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:45:02.928633 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:45:02.928633 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:45:02.928633 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:45:02.928633 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:45:02.928633 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:45:02.928633 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:45:02.928633 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:45:02.928633 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:45:02.928633 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:45:02.929730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:45:02.929730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:45:02.929730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:45:02.929730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:45:02.929730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:45:02.929730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:45:02.929730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:45:02.929730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:45:02.929730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:45:02.929730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:45:02.929730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:45:02.929730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:45:02.929730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:45:02.929730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:45:02.929730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:45:02.929730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:45:02.930790 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:45:02.930790 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:45:02.930790 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:45:02.930790 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:45:02.930790 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:45:02.930790 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:45:02.930790 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:45:02.930790 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:45:02.930790 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:45:02.930790 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:45:02.930790 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 10:45:02.930790 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:45:02.930790 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 617/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Sun Aug 7 10:45:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:45:02.936034 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f913eea-f9ed-4f47-9463-bc2538dd32c2 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:02.986363 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:03.049107 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f913eea-f9ed-4f47-9463-bc2538dd32c2 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:03.098419 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b28263-020e-493d-9c50-7719e8af43ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:03.099033 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b28263-020e-493d-9c50-7719e8af43ff None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:03.099313 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b28263-020e-493d-9c50-7719e8af43ff None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:03.100254 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b28263-020e-493d-9c50-7719e8af43ff None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:03.100367 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b28263-020e-493d-9c50-7719e8af43ff None admin] RBAC: Adding query filter params (name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:45:03.100580 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b28263-020e-493d-9c50-7719e8af43ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:03.101991 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b28263-020e-493d-9c50-7719e8af43ff None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:03.111023 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 619/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Sun Aug 7 10:45:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:45:03.116936 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082af53-ccf8-4cf9-81a1-851975382830 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:03.209813 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:03.227194 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082af53-ccf8-4cf9-81a1-851975382830 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:03.271564 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1693c73-b174-4428-a88a-de41e26bf5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:03.272439 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1693c73-b174-4428-a88a-de41e26bf5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:03.272808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1693c73-b174-4428-a88a-de41e26bf5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:03.273079 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1693c73-b174-4428-a88a-de41e26bf5e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:03.286196 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1693c73-b174-4428-a88a-de41e26bf5e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:03.288402 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1693c73-b174-4428-a88a-de41e26bf5e7 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:03.308027 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-e1693c73-b174-4428-a88a-de41e26bf5e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:45:03.308027 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:45:03.308027 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:45:03.308027 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:45:03.308027 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:45:03.308027 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:45:03.308027 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:45:03.308027 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:45:03.308027 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:45:03.308027 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:45:03.308027 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:45:03.308027 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:45:03.308027 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:45:03.308027 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:45:03.308027 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:45:03.308027 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:45:03.309219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:45:03.309219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:45:03.309219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:45:03.309219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:45:03.309219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:45:03.309219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:45:03.309219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:45:03.309219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:45:03.309219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:45:03.309219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:45:03.309219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:45:03.309219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:45:03.309219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:45:03.309219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:45:03.309219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:45:03.309219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:45:03.309219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:45:03.310293 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:45:03.310293 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:45:03.310293 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:45:03.310293 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 618/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:45:03.315651 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b28263-020e-493d-9c50-7719e8af43ff None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:03.435667 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b28263-020e-493d-9c50-7719e8af43ff None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:03.444693 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:03.472437 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5ebbd-28be-4326-82c5-6ff896ea328c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:03.472949 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5ebbd-28be-4326-82c5-6ff896ea328c None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:03.473352 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5ebbd-28be-4326-82c5-6ff896ea328c None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:03.473631 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5ebbd-28be-4326-82c5-6ff896ea328c None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:03.474267 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5ebbd-28be-4326-82c5-6ff896ea328c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:45:03.474565 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5ebbd-28be-4326-82c5-6ff896ea328c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:03.476232 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5ebbd-28be-4326-82c5-6ff896ea328c None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:03.490457 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 620/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:45:03.497137 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1693c73-b174-4428-a88a-de41e26bf5e7 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:03.604937 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1693c73-b174-4428-a88a-de41e26bf5e7 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:03.645269 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6990845d-8a90-4578-a65e-d68ed24c89b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:03.646034 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990845d-8a90-4578-a65e-d68ed24c89b7 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:03.646180 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990845d-8a90-4578-a65e-d68ed24c89b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:03.646468 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6990845d-8a90-4578-a65e-d68ed24c89b7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:03.649852 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:03.655632 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6990845d-8a90-4578-a65e-d68ed24c89b7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:03.657869 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6990845d-8a90-4578-a65e-d68ed24c89b7 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:03.669432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-6990845d-8a90-4578-a65e-d68ed24c89b7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 10:45:03.669432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:45:03.669432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:45:03.669432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:45:03.669432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:45:03.669432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:45:03.669432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:45:03.669432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:45:03.669432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:45:03.669432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:45:03.669432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:45:03.669432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:45:03.669432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:45:03.669432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:45:03.669432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:45:03.669432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:45:03.670885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:45:03.670885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:45:03.670885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:45:03.670885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:45:03.670885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:45:03.670885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:45:03.670885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:45:03.670885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:45:03.670885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:45:03.670885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:45:03.670885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:45:03.670885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:45:03.670885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:45:03.670885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:45:03.670885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:45:03.670885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:45:03.670885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:45:03.670885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:45:03.672100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:45:03.672100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:45:03.672100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:45:03.672100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:45:03.672100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:45:03.672100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:45:03.672100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:45:03.672100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:45:03.672100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 10:45:03.672100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:45:03.672100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 619/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:45:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:45:03.676607 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5ebbd-28be-4326-82c5-6ff896ea328c None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:03.783688 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5ebbd-28be-4326-82c5-6ff896ea328c None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:03.823054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd80944-d290-428b-8187-612f52169e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:03.823808 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd80944-d290-428b-8187-612f52169e97 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:03.824090 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd80944-d290-428b-8187-612f52169e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:03.824362 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd80944-d290-428b-8187-612f52169e97 None admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:03.825382 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd80944-d290-428b-8187-612f52169e97 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:45:03.825667 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd80944-d290-428b-8187-612f52169e97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:03.827489 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd80944-d290-428b-8187-612f52169e97 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:03.848162 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 621/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Sun Aug 7 10:45:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:45:03.855192 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6990845d-8a90-4578-a65e-d68ed24c89b7 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:03.968231 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6990845d-8a90-4578-a65e-d68ed24c89b7 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:04.012990 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c378b5-9bfc-4709-ae08-0fec9386e3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:04.013670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c378b5-9bfc-4709-ae08-0fec9386e3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:04.013950 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c378b5-9bfc-4709-ae08-0fec9386e3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:04.014230 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c378b5-9bfc-4709-ae08-0fec9386e3f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:04.090289 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:04.098225 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c378b5-9bfc-4709-ae08-0fec9386e3f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:04.100356 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c378b5-9bfc-4709-ae08-0fec9386e3f6 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:04.216021 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 620/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:45:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 10:45:04.222430 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd80944-d290-428b-8187-612f52169e97 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:04.254947 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:04.335704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd80944-d290-428b-8187-612f52169e97 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:04.375605 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d9c76-2282-48dc-a11b-1a6c6fde547e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:04.376436 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d9c76-2282-48dc-a11b-1a6c6fde547e None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:04.376780 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d9c76-2282-48dc-a11b-1a6c6fde547e None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:04.377142 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d9c76-2282-48dc-a11b-1a6c6fde547e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:04.388046 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d9c76-2282-48dc-a11b-1a6c6fde547e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:04.389536 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11d9c76-2282-48dc-a11b-1a6c6fde547e None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:04.405568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-f11d9c76-2282-48dc-a11b-1a6c6fde547e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:45:04.405568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:45:04.405568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:45:04.405568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:45:04.405568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:45:04.405568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:45:04.405568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:45:04.405568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:45:04.405568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:45:04.405568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:45:04.405568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:45:04.405568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:45:04.405568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:45:04.405568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:45:04.405568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:45:04.405568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:45:04.407242 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:45:04.407242 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:45:04.407242 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:45:04.407242 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:45:04.407242 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:45:04.407242 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:45:04.407242 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:45:04.407242 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:45:04.407242 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:45:04.407242 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:45:04.407242 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:45:04.407242 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:45:04.407242 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:45:04.407242 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:45:04.407242 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:45:04.407242 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:45:04.407242 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:45:04.408390 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:45:04.408390 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:45:04.408390 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:45:04.408390 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 622/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:45:04.413909 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c378b5-9bfc-4709-ae08-0fec9386e3f6 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:04.513919 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:04.522193 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c378b5-9bfc-4709-ae08-0fec9386e3f6 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:04.561973 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0b81a-6e92-4099-94a4-fc91abe8f381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:04.563121 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0b81a-6e92-4099-94a4-fc91abe8f381 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:04.563392 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0b81a-6e92-4099-94a4-fc91abe8f381 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:04.563653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0b81a-6e92-4099-94a4-fc91abe8f381 None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:04.564360 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0b81a-6e92-4099-94a4-fc91abe8f381 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:45:04.564581 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0b81a-6e92-4099-94a4-fc91abe8f381 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:04.566073 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0b81a-6e92-4099-94a4-fc91abe8f381 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:04.578407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 621/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:45:04.585190 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d9c76-2282-48dc-a11b-1a6c6fde547e None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:04.682572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:04.708468 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d9c76-2282-48dc-a11b-1a6c6fde547e None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:04.748459 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c817078-a33b-414f-beac-06ae7dd225e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:04.749210 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c817078-a33b-414f-beac-06ae7dd225e9 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:04.750448 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c817078-a33b-414f-beac-06ae7dd225e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:04.750717 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c817078-a33b-414f-beac-06ae7dd225e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:04.758169 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c817078-a33b-414f-beac-06ae7dd225e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:04.759612 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c817078-a33b-414f-beac-06ae7dd225e9 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:04.770885 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-9c817078-a33b-414f-beac-06ae7dd225e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:45:04.770885 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:45:04.770885 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:45:04.770885 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:45:04.770885 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:45:04.770885 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:45:04.770885 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:45:04.770885 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:45:04.770885 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:45:04.770885 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:45:04.770885 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:45:04.770885 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:45:04.770885 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:45:04.770885 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:45:04.770885 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:45:04.772033 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:45:04.772033 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:45:04.772033 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:45:04.772033 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:45:04.772033 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:45:04.772033 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:45:04.772033 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:45:04.772033 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:45:04.772033 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:45:04.772033 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:45:04.772033 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:45:04.772033 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:45:04.772033 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:45:04.772033 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:45:04.772033 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:45:04.772033 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:45:04.772033 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:45:04.773111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:45:04.773111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:45:04.773111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:45:04.773111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:45:04.773111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:45:04.773111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:45:04.773111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:45:04.773111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:45:04.773111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 623/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:45:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:45:04.777902 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0b81a-6e92-4099-94a4-fc91abe8f381 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:04.893075 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0b81a-6e92-4099-94a4-fc91abe8f381 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:04.927683 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a2082-dc2f-4a8d-96f1-8470321e7fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:04.928275 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a2082-dc2f-4a8d-96f1-8470321e7fac None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:04.928545 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a2082-dc2f-4a8d-96f1-8470321e7fac None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:04.928810 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a2082-dc2f-4a8d-96f1-8470321e7fac None admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:04.929520 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a2082-dc2f-4a8d-96f1-8470321e7fac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:45:04.929819 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a2082-dc2f-4a8d-96f1-8470321e7fac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:04.931227 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a2082-dc2f-4a8d-96f1-8470321e7fac None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:04.943729 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 622/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:45:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:45:04.949775 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c817078-a33b-414f-beac-06ae7dd225e9 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:05.068914 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c817078-a33b-414f-beac-06ae7dd225e9 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:05.104742 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f970db-c7fb-420c-9884-3d2bc2727b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:05.105366 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f970db-c7fb-420c-9884-3d2bc2727b3c None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:05.105647 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f970db-c7fb-420c-9884-3d2bc2727b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:05.105948 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f970db-c7fb-420c-9884-3d2bc2727b3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:05.106709 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f970db-c7fb-420c-9884-3d2bc2727b3c None admin] RBAC: Adding query filter params (role.id=bf9e51dafeac420f89a66e78e1463982, scope.project.id=62eed8550ae3403f8a75894dbd19cf4a, user.id=b33f797a9af946a4b296d973388891be) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:45:05.107035 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f970db-c7fb-420c-9884-3d2bc2727b3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:05.108472 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f970db-c7fb-420c-9884-3d2bc2727b3c None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:05.114967 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 624/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:45:04 2022] GET /identity/v3/role_assignments?user.id=b33f797a9af946a4b296d973388891be&scope.project.id=62eed8550ae3403f8a75894dbd19cf4a&role.id=bf9e51dafeac420f89a66e78e1463982 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:45:07.440285 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27ddd9-64d9-4a05-9ec2-4b83b563e113 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:07.441068 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27ddd9-64d9-4a05-9ec2-4b83b563e113 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:07.441068 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27ddd9-64d9-4a05-9ec2-4b83b563e113 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:07.442620 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 623/1247] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:45:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:45:07.450063 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162097f-f814-49d3-a17c-54cd9d32d3ee None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:07.450633 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162097f-f814-49d3-a17c-54cd9d32d3ee None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:07.450849 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162097f-f814-49d3-a17c-54cd9d32d3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:07.458894 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:07.474421 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-1162097f-f814-49d3-a17c-54cd9d32d3ee None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:45:07.475937 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-1162097f-f814-49d3-a17c-54cd9d32d3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:45:07.558646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 625/1248] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:45:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:45:07.587757 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27ddd9-64d9-4a05-9ec2-4b83b563e113 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:07.609963 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:07.707663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27ddd9-64d9-4a05-9ec2-4b83b563e113 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:07.752710 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1ea14-91d2-401e-a0c5-af4ec8d627d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:07.753530 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1ea14-91d2-401e-a0c5-af4ec8d627d2 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:07.753874 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1ea14-91d2-401e-a0c5-af4ec8d627d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:07.754144 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1ea14-91d2-401e-a0c5-af4ec8d627d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:07.766704 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1ea14-91d2-401e-a0c5-af4ec8d627d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:45:07.771387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-1cd1ea14-91d2-401e-a0c5-af4ec8d627d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:45:07.771387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:45:07.771387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:45:07.771387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:45:07.771387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:45:07.771387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:45:07.771387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:45:07.771387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:45:07.771387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:45:07.771387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:45:07.771387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:45:07.771387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:45:07.771387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:45:07.771387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:45:07.771387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:45:07.771387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:45:07.772620 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:45:07.772620 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:45:07.772620 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:45:07.772620 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:45:07.772620 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:45:07.772620 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:45:07.772620 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:45:07.772620 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:45:07.772620 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:45:07.772620 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:45:07.772620 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:45:07.772620 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:45:07.772620 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:45:07.772620 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:45:07.772620 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:45:07.772620 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:45:07.773913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:45:07.773913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:45:07.773913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:45:07.773913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:45:07.773913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:45:07.773913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:45:07.773913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:45:07.773913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:45:07.773913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:45:07.773913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:45:07.773913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:45:07.773913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:45:07.773913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 624/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:45:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:45:07.779588 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162097f-f814-49d3-a17c-54cd9d32d3ee None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:07.898545 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162097f-f814-49d3-a17c-54cd9d32d3ee None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:07.932160 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:07.938879 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a947d37-1221-45da-920d-15aa6f5aeff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:07.939495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a947d37-1221-45da-920d-15aa6f5aeff2 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:07.939776 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a947d37-1221-45da-920d-15aa6f5aeff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:07.940048 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a947d37-1221-45da-920d-15aa6f5aeff2 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:07.940840 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a947d37-1221-45da-920d-15aa6f5aeff2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:45:07.941141 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a947d37-1221-45da-920d-15aa6f5aeff2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:07.942594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a947d37-1221-45da-920d-15aa6f5aeff2 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:07.951754 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 626/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:45:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:45:07.958897 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1ea14-91d2-401e-a0c5-af4ec8d627d2 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:08.076785 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:08.110479 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1ea14-91d2-401e-a0c5-af4ec8d627d2 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:08.152751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894df81-a002-4a68-bb5d-549d94721c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:08.153508 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894df81-a002-4a68-bb5d-549d94721c5d None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:08.153833 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894df81-a002-4a68-bb5d-549d94721c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:08.154102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894df81-a002-4a68-bb5d-549d94721c5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:08.167180 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894df81-a002-4a68-bb5d-549d94721c5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:08.169066 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894df81-a002-4a68-bb5d-549d94721c5d None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:08.184885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-b894df81-a002-4a68-bb5d-549d94721c5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:45:08.184885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:45:08.184885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:45:08.184885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:45:08.184885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:45:08.184885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:45:08.184885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:45:08.184885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:45:08.184885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:45:08.184885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:45:08.184885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:45:08.184885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:45:08.184885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:45:08.184885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:45:08.184885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:45:08.184885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:45:08.186100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:45:08.186100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:45:08.186100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:45:08.186100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:45:08.186100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:45:08.186100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:45:08.186100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:45:08.186100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:45:08.186100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:45:08.186100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:45:08.186100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:45:08.186100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:45:08.186100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:45:08.186100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:45:08.186100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:45:08.186100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:45:08.186100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:45:08.187034 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:45:08.187034 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:45:08.187034 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:45:08.187034 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 625/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:45:08.192617 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a947d37-1221-45da-920d-15aa6f5aeff2 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:08.324077 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a947d37-1221-45da-920d-15aa6f5aeff2 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:08.362271 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05ad79-b268-4b75-94f2-b8e46573c1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:08.362874 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05ad79-b268-4b75-94f2-b8e46573c1ce None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:08.363148 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05ad79-b268-4b75-94f2-b8e46573c1ce None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:08.363418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05ad79-b268-4b75-94f2-b8e46573c1ce None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:08.364058 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05ad79-b268-4b75-94f2-b8e46573c1ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:45:08.364357 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05ad79-b268-4b75-94f2-b8e46573c1ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:08.365773 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05ad79-b268-4b75-94f2-b8e46573c1ce None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:08.389471 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 627/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:45:08.395674 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894df81-a002-4a68-bb5d-549d94721c5d None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:08.516756 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894df81-a002-4a68-bb5d-549d94721c5d None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:08.545111 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:08.553876 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28aff2-37fb-4151-af03-212bcb732d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:08.554497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28aff2-37fb-4151-af03-212bcb732d7a None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:08.554778 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28aff2-37fb-4151-af03-212bcb732d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:08.555033 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28aff2-37fb-4151-af03-212bcb732d7a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:08.563734 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28aff2-37fb-4151-af03-212bcb732d7a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:08.565165 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28aff2-37fb-4151-af03-212bcb732d7a None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:08.576550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-5a28aff2-37fb-4151-af03-212bcb732d7a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 10:45:08.576550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:45:08.576550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:45:08.576550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:45:08.576550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:45:08.576550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:45:08.576550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:45:08.576550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:45:08.576550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:45:08.576550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:45:08.576550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:45:08.576550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:45:08.576550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:45:08.576550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:45:08.576550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:45:08.576550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:45:08.578246 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:45:08.578246 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:45:08.578246 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:45:08.578246 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:45:08.578246 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:45:08.578246 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:45:08.578246 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:45:08.578246 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:45:08.578246 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:45:08.578246 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:45:08.578246 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:45:08.578246 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:45:08.578246 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:45:08.578246 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:45:08.578246 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:45:08.578246 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:45:08.578246 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:45:08.578246 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:45:08.579213 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:45:08.579213 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:45:08.579213 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:45:08.579213 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:45:08.579213 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:45:08.579213 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:45:08.579213 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:45:08.579213 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:45:08.579213 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 10:45:08.579213 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:45:08.579213 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 626/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:45:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:45:08.585349 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05ad79-b268-4b75-94f2-b8e46573c1ce None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:08.649278 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:08.703428 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05ad79-b268-4b75-94f2-b8e46573c1ce None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:08.740462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1193c7-444d-4a79-a97f-be67e8a67c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:08.741016 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1193c7-444d-4a79-a97f-be67e8a67c45 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:08.741294 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1193c7-444d-4a79-a97f-be67e8a67c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:08.741598 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1193c7-444d-4a79-a97f-be67e8a67c45 None admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:08.742384 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1193c7-444d-4a79-a97f-be67e8a67c45 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:45:08.742631 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1193c7-444d-4a79-a97f-be67e8a67c45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:08.744045 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1193c7-444d-4a79-a97f-be67e8a67c45 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:08.762520 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 628/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Sun Aug 7 10:45:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:45:08.768810 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28aff2-37fb-4151-af03-212bcb732d7a None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:08.883075 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28aff2-37fb-4151-af03-212bcb732d7a None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:08.926937 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4520e58-7648-480a-ad69-4dbe3199c37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:08.927740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4520e58-7648-480a-ad69-4dbe3199c37f None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:08.928115 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4520e58-7648-480a-ad69-4dbe3199c37f None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:08.928464 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4520e58-7648-480a-ad69-4dbe3199c37f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:08.987800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:09.001815 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4520e58-7648-480a-ad69-4dbe3199c37f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:09.003313 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4520e58-7648-480a-ad69-4dbe3199c37f None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:09.123894 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 627/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:45:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 10:45:09.130035 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1193c7-444d-4a79-a97f-be67e8a67c45 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:09.237495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1193c7-444d-4a79-a97f-be67e8a67c45 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:09.250681 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:09.273244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045555bd-5dfa-4649-a8a1-a2b741c03584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:09.273904 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045555bd-5dfa-4649-a8a1-a2b741c03584 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:09.274176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045555bd-5dfa-4649-a8a1-a2b741c03584 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:09.274440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045555bd-5dfa-4649-a8a1-a2b741c03584 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:09.285996 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045555bd-5dfa-4649-a8a1-a2b741c03584 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:09.287423 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045555bd-5dfa-4649-a8a1-a2b741c03584 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:09.301909 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-045555bd-5dfa-4649-a8a1-a2b741c03584 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:45:09.301909 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:45:09.301909 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:45:09.301909 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:45:09.301909 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:45:09.301909 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:45:09.301909 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:45:09.301909 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:45:09.301909 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:45:09.301909 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:45:09.301909 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:45:09.301909 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:45:09.301909 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:45:09.301909 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:45:09.301909 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:45:09.301909 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:45:09.303607 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:45:09.303607 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:45:09.303607 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:45:09.303607 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:45:09.303607 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:45:09.303607 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:45:09.303607 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:45:09.303607 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:45:09.303607 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:45:09.303607 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:45:09.303607 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:45:09.303607 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:45:09.303607 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:45:09.303607 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:45:09.303607 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:45:09.303607 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:45:09.303607 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:45:09.304845 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:45:09.304845 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:45:09.304845 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:45:09.304845 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 629/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:45:09.308841 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4520e58-7648-480a-ad69-4dbe3199c37f None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:09.410330 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:09.421435 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4520e58-7648-480a-ad69-4dbe3199c37f None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:09.456569 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a398e-0076-499e-9883-2a59334b237c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:09.457176 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a398e-0076-499e-9883-2a59334b237c None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:09.457484 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a398e-0076-499e-9883-2a59334b237c None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:09.457756 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a398e-0076-499e-9883-2a59334b237c None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:09.458392 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a398e-0076-499e-9883-2a59334b237c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:45:09.458684 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a398e-0076-499e-9883-2a59334b237c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:09.460028 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a398e-0076-499e-9883-2a59334b237c None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:09.471848 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 628/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:45:09.477633 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045555bd-5dfa-4649-a8a1-a2b741c03584 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:09.584543 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045555bd-5dfa-4649-a8a1-a2b741c03584 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:09.624055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70180837-37a6-4cc0-aeb1-1b10a350c8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:09.625504 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70180837-37a6-4cc0-aeb1-1b10a350c8ba None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:09.625744 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70180837-37a6-4cc0-aeb1-1b10a350c8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:09.626011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70180837-37a6-4cc0-aeb1-1b10a350c8ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:09.633485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70180837-37a6-4cc0-aeb1-1b10a350c8ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:09.634928 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70180837-37a6-4cc0-aeb1-1b10a350c8ba None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:09.647874 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-70180837-37a6-4cc0-aeb1-1b10a350c8ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:45:09.647874 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:45:09.647874 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:45:09.647874 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:45:09.647874 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:45:09.647874 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:45:09.647874 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:45:09.647874 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:45:09.647874 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:45:09.647874 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:45:09.647874 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:45:09.647874 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:45:09.647874 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:45:09.647874 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:45:09.647874 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:45:09.648838 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:45:09.648838 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:45:09.648838 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:45:09.648838 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:45:09.648838 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:45:09.648838 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:45:09.648838 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:45:09.648838 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:45:09.648838 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:45:09.648838 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:45:09.648838 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:45:09.648838 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:45:09.648838 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:45:09.648838 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:45:09.648838 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:45:09.648838 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:45:09.648838 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:45:09.649918 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:45:09.649918 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:45:09.649918 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:45:09.649918 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:45:09.649918 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:45:09.649918 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:45:09.649918 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:45:09.649918 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:45:09.649918 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 630/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:45:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:45:09.655037 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a398e-0076-499e-9883-2a59334b237c None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:09.762917 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a398e-0076-499e-9883-2a59334b237c None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:09.800432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35359857-f631-4583-8251-2afa10099042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:09.801254 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35359857-f631-4583-8251-2afa10099042 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:09.801629 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35359857-f631-4583-8251-2afa10099042 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:09.801955 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35359857-f631-4583-8251-2afa10099042 None admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:09.802880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35359857-f631-4583-8251-2afa10099042 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:45:09.803229 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35359857-f631-4583-8251-2afa10099042 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:09.805127 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35359857-f631-4583-8251-2afa10099042 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:09.817848 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 629/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:45:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:45:09.824034 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70180837-37a6-4cc0-aeb1-1b10a350c8ba None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:09.852172 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:09.931425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70180837-37a6-4cc0-aeb1-1b10a350c8ba None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:09.967530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed10f6-7939-481b-a103-daeb09a7516b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:09.968136 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed10f6-7939-481b-a103-daeb09a7516b None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:09.968438 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed10f6-7939-481b-a103-daeb09a7516b None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:09.968706 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed10f6-7939-481b-a103-daeb09a7516b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:09.969484 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed10f6-7939-481b-a103-daeb09a7516b None admin] RBAC: Adding query filter params (role.id=9da6e501237c405ca021a9d9f6173caf, scope.project.id=62eed8550ae3403f8a75894dbd19cf4a, user.id=b33f797a9af946a4b296d973388891be) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:45:09.969858 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed10f6-7939-481b-a103-daeb09a7516b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:09.971359 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed10f6-7939-481b-a103-daeb09a7516b None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:09.977222 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 631/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:45:09 2022] GET /identity/v3/role_assignments?user.id=b33f797a9af946a4b296d973388891be&scope.project.id=62eed8550ae3403f8a75894dbd19cf4a&role.id=9da6e501237c405ca021a9d9f6173caf => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:45:11.982541 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e049e8e-cbd2-409d-b1a5-d53bc74d5c98 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:11.983065 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e049e8e-cbd2-409d-b1a5-d53bc74d5c98 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:11.983065 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e049e8e-cbd2-409d-b1a5-d53bc74d5c98 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:11.984521 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 630/1261] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:45:11.989502 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b232e1-d267-4214-b610-c0c9d6e18815 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:11.989919 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b232e1-d267-4214-b610-c0c9d6e18815 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:11.990046 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b232e1-d267-4214-b610-c0c9d6e18815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:12.009447 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-e3b232e1-d267-4214-b610-c0c9d6e18815 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:45:12.010797 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-e3b232e1-d267-4214-b610-c0c9d6e18815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:45:12.080024 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 632/1262] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:45:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 10:45:12.102152 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e049e8e-cbd2-409d-b1a5-d53bc74d5c98 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:12.113455 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:12.206951 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e049e8e-cbd2-409d-b1a5-d53bc74d5c98 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:12.240459 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ea024-fd40-4e60-95d7-3ac048150747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:12.241017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ea024-fd40-4e60-95d7-3ac048150747 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:12.241294 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ea024-fd40-4e60-95d7-3ac048150747 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:12.241594 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ea024-fd40-4e60-95d7-3ac048150747 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:12.251983 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ea024-fd40-4e60-95d7-3ac048150747 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:45:12.258483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-b14ea024-fd40-4e60-95d7-3ac048150747 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:45:12.258483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:45:12.258483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:45:12.258483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:45:12.258483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:45:12.258483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:45:12.258483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:45:12.258483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:45:12.258483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:45:12.258483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:45:12.258483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:45:12.258483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:45:12.258483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:45:12.258483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:45:12.258483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:45:12.258483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:45:12.259572 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:45:12.259572 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:45:12.259572 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:45:12.259572 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:45:12.259572 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:45:12.259572 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:45:12.259572 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:45:12.259572 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:45:12.259572 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:45:12.259572 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:45:12.259572 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:45:12.259572 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:45:12.259572 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:45:12.259572 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:45:12.259572 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:45:12.259572 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:45:12.260479 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:45:12.260479 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:45:12.260479 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:45:12.260479 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:45:12.260479 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:45:12.260479 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:45:12.260479 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:45:12.260479 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:45:12.260479 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:45:12.260479 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:45:12.260479 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:45:12.260479 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:45:12.260479 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 631/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:45:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:45:12.266327 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b232e1-d267-4214-b610-c0c9d6e18815 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:12.284623 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:12.361692 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b232e1-d267-4214-b610-c0c9d6e18815 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:12.399299 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40219735-ea37-4ba7-a17a-0b057d5a06e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:12.399884 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40219735-ea37-4ba7-a17a-0b057d5a06e7 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:12.400157 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40219735-ea37-4ba7-a17a-0b057d5a06e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:12.400421 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40219735-ea37-4ba7-a17a-0b057d5a06e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:12.401070 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40219735-ea37-4ba7-a17a-0b057d5a06e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:45:12.401391 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40219735-ea37-4ba7-a17a-0b057d5a06e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:12.402728 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40219735-ea37-4ba7-a17a-0b057d5a06e7 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:12.411215 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 633/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:45:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:45:12.417075 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ea024-fd40-4e60-95d7-3ac048150747 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:12.480966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:12.513183 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ea024-fd40-4e60-95d7-3ac048150747 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:12.545633 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1869614-fb4c-4ec5-9534-f0dae31476e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:12.546257 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1869614-fb4c-4ec5-9534-f0dae31476e3 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:12.546543 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1869614-fb4c-4ec5-9534-f0dae31476e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:12.546810 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1869614-fb4c-4ec5-9534-f0dae31476e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:12.556794 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1869614-fb4c-4ec5-9534-f0dae31476e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:12.558237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1869614-fb4c-4ec5-9534-f0dae31476e3 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:12.572208 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-d1869614-fb4c-4ec5-9534-f0dae31476e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:45:12.572208 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:45:12.572208 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:45:12.572208 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:45:12.572208 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:45:12.572208 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:45:12.572208 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:45:12.572208 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:45:12.572208 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:45:12.572208 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:45:12.572208 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:45:12.572208 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:45:12.572208 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:45:12.572208 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:45:12.572208 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:45:12.572208 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:45:12.573473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:45:12.573473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:45:12.573473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:45:12.573473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:45:12.573473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:45:12.573473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:45:12.573473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:45:12.573473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:45:12.573473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:45:12.573473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:45:12.573473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:45:12.573473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:45:12.573473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:45:12.573473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:45:12.573473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:45:12.573473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:45:12.573473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:45:12.574720 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:45:12.574720 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:45:12.574720 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:45:12.574720 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 632/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:45:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:45:12.579018 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40219735-ea37-4ba7-a17a-0b057d5a06e7 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:12.656368 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:12.674795 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40219735-ea37-4ba7-a17a-0b057d5a06e7 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:12.707111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b5a03-a18a-4322-b8f0-077ce47449b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:12.707700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b5a03-a18a-4322-b8f0-077ce47449b4 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:12.707963 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b5a03-a18a-4322-b8f0-077ce47449b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:12.708229 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8b5a03-a18a-4322-b8f0-077ce47449b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:12.708856 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b5a03-a18a-4322-b8f0-077ce47449b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:45:12.709152 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b5a03-a18a-4322-b8f0-077ce47449b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:12.710514 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8b5a03-a18a-4322-b8f0-077ce47449b4 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:12.721590 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 634/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:45:12.727033 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1869614-fb4c-4ec5-9534-f0dae31476e3 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:12.822408 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1869614-fb4c-4ec5-9534-f0dae31476e3 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:12.841320 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:12.855161 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4d808-cc90-44cf-8aef-ae837cfd2ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:12.855771 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4d808-cc90-44cf-8aef-ae837cfd2ccf None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:12.856048 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4d808-cc90-44cf-8aef-ae837cfd2ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:12.856317 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4d808-cc90-44cf-8aef-ae837cfd2ccf None admin] PATH_INFO: `/v3/users/placement` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:12.863511 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a4d808-cc90-44cf-8aef-ae837cfd2ccf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:12.864932 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a4d808-cc90-44cf-8aef-ae837cfd2ccf None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:12.876156 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-92a4d808-cc90-44cf-8aef-ae837cfd2ccf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 10:45:12.876156 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:45:12.876156 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:45:12.876156 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:45:12.876156 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:45:12.876156 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:45:12.876156 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:45:12.876156 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:45:12.876156 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:45:12.876156 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:45:12.876156 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:45:12.876156 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:45:12.876156 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:45:12.876156 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:45:12.876156 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:45:12.876156 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:45:12.877221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:45:12.877221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:45:12.877221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:45:12.877221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:45:12.877221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:45:12.877221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:45:12.877221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:45:12.877221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:45:12.877221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:45:12.877221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:45:12.877221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:45:12.877221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:45:12.877221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:45:12.877221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:45:12.877221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:45:12.877221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:45:12.877221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:45:12.877221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:45:12.878374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:45:12.878374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:45:12.878374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:45:12.878374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:45:12.878374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:45:12.878374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:45:12.878374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:45:12.878374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:45:12.878374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 10:45:12.878374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:45:12.878374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 633/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:45:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:45:12.883154 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b5a03-a18a-4322-b8f0-077ce47449b4 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:12.977467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8b5a03-a18a-4322-b8f0-077ce47449b4 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:13.011361 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce84f8-b4c7-4709-83c5-f42d81388d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:13.011930 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce84f8-b4c7-4709-83c5-f42d81388d3a None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:13.012200 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce84f8-b4c7-4709-83c5-f42d81388d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:13.012467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce84f8-b4c7-4709-83c5-f42d81388d3a None admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:13.013192 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce84f8-b4c7-4709-83c5-f42d81388d3a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:45:13.013517 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce84f8-b4c7-4709-83c5-f42d81388d3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:13.014933 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce84f8-b4c7-4709-83c5-f42d81388d3a None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:13.023830 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:13.033627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 635/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Sun Aug 7 10:45:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:45:13.040125 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4d808-cc90-44cf-8aef-ae837cfd2ccf None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:13.136434 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4d808-cc90-44cf-8aef-ae837cfd2ccf None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:13.168118 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3483f6d-fc40-4575-a2fe-ae06dd00675a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:13.168712 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3483f6d-fc40-4575-a2fe-ae06dd00675a None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:13.168983 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3483f6d-fc40-4575-a2fe-ae06dd00675a None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:13.169246 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3483f6d-fc40-4575-a2fe-ae06dd00675a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:13.179800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3483f6d-fc40-4575-a2fe-ae06dd00675a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:13.181199 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3483f6d-fc40-4575-a2fe-ae06dd00675a None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:13.195097 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-d3483f6d-fc40-4575-a2fe-ae06dd00675a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:45:13.195097 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:45:13.195097 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:45:13.195097 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:45:13.195097 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:45:13.195097 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:45:13.195097 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:45:13.195097 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:45:13.195097 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:45:13.195097 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:45:13.195097 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:45:13.195097 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:45:13.195097 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:45:13.195097 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:45:13.195097 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:45:13.195097 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:45:13.196196 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:45:13.196196 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:45:13.196196 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:45:13.196196 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:45:13.196196 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:45:13.196196 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:45:13.196196 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:45:13.196196 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:45:13.196196 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:45:13.196196 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:45:13.196196 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:45:13.196196 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:45:13.196196 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:45:13.196196 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:45:13.196196 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:45:13.196196 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:45:13.196196 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:45:13.197111 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:45:13.197111 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:45:13.197111 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:45:13.197111 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 634/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:45:13.202069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce84f8-b4c7-4709-83c5-f42d81388d3a None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:13.298670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce84f8-b4c7-4709-83c5-f42d81388d3a None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:13.330984 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0af06-7b3d-4dc3-a16c-613e7f65226b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:13.331572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0af06-7b3d-4dc3-a16c-613e7f65226b None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:13.331847 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0af06-7b3d-4dc3-a16c-613e7f65226b None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:13.332114 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0af06-7b3d-4dc3-a16c-613e7f65226b None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:13.332751 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0af06-7b3d-4dc3-a16c-613e7f65226b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:45:13.333047 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0af06-7b3d-4dc3-a16c-613e7f65226b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:13.334434 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0af06-7b3d-4dc3-a16c-613e7f65226b None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:13.346061 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 636/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:45:13.351688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3483f6d-fc40-4575-a2fe-ae06dd00675a None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:13.383062 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:13.450614 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3483f6d-fc40-4575-a2fe-ae06dd00675a None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:13.482907 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577d920-2204-435a-b486-e2774a82608d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:13.483515 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577d920-2204-435a-b486-e2774a82608d None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:13.483788 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577d920-2204-435a-b486-e2774a82608d None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:13.484641 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577d920-2204-435a-b486-e2774a82608d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:13.491082 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577d920-2204-435a-b486-e2774a82608d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:13.492505 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577d920-2204-435a-b486-e2774a82608d None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:13.504105 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-e577d920-2204-435a-b486-e2774a82608d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:45:13.504105 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:45:13.504105 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:45:13.504105 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:45:13.504105 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:45:13.504105 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:45:13.504105 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:45:13.504105 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:45:13.504105 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:45:13.504105 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:45:13.504105 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:45:13.504105 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:45:13.504105 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:45:13.504105 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:45:13.504105 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:45:13.505130 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:45:13.505130 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:45:13.505130 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:45:13.505130 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:45:13.505130 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:45:13.505130 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:45:13.505130 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:45:13.505130 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:45:13.505130 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:45:13.505130 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:45:13.505130 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:45:13.505130 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:45:13.505130 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:45:13.505130 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:45:13.505130 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:45:13.505130 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:45:13.505130 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:45:13.509809 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:45:13.509809 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:45:13.509809 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:45:13.509809 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:45:13.509809 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:45:13.509809 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:45:13.509809 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:45:13.509809 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:45:13.509809 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 635/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:45:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:45:13.511123 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0af06-7b3d-4dc3-a16c-613e7f65226b None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:13.567483 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:13.607355 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0af06-7b3d-4dc3-a16c-613e7f65226b None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:13.639525 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c25fbf-d29d-40c1-8f32-d83df84460d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:13.640112 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c25fbf-d29d-40c1-8f32-d83df84460d1 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:13.640896 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c25fbf-d29d-40c1-8f32-d83df84460d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:13.641163 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c25fbf-d29d-40c1-8f32-d83df84460d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:13.641894 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c25fbf-d29d-40c1-8f32-d83df84460d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:45:13.642192 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c25fbf-d29d-40c1-8f32-d83df84460d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:13.643587 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c25fbf-d29d-40c1-8f32-d83df84460d1 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:13.654939 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 637/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:45:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:45:13.661411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577d920-2204-435a-b486-e2774a82608d None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:13.748492 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:13.757656 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577d920-2204-435a-b486-e2774a82608d None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:13.790437 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5dacd-9f69-490d-ba26-e1e392a727fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:13.791064 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5dacd-9f69-490d-ba26-e1e392a727fa None admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:13.791339 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5dacd-9f69-490d-ba26-e1e392a727fa None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:13.791608 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5dacd-9f69-490d-ba26-e1e392a727fa None admin] PATH_INFO: `/v3/projects/62eed8550ae3403f8a75894dbd19cf4a/users/b33f797a9af946a4b296d973388891be/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:13.793499 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f5dacd-9f69-490d-ba26-e1e392a727fa None admin] RBAC: Authorizing `identity:create_grant(project_id=62eed8550ae3403f8a75894dbd19cf4a, user_id=b33f797a9af946a4b296d973388891be, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:13.794892 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f5dacd-9f69-490d-ba26-e1e392a727fa None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:13.806881 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 636/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Sun Aug 7 10:45:13 2022] PUT /identity/v3/projects/62eed8550ae3403f8a75894dbd19cf4a/users/b33f797a9af946a4b296d973388891be/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:45:15.785501 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97e4e7-0903-4848-9a3b-49752130552c None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:15.786020 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97e4e7-0903-4848-9a3b-49752130552c None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:15.786020 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97e4e7-0903-4848-9a3b-49752130552c None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:15.787392 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 638/1274] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:45:15.792476 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5e2ea-cf58-46d0-802a-d1441e2ae176 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:15.792863 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5e2ea-cf58-46d0-802a-d1441e2ae176 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:15.793052 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5e2ea-cf58-46d0-802a-d1441e2ae176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:15.810666 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-08d5e2ea-cf58-46d0-802a-d1441e2ae176 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:45:15.811835 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-08d5e2ea-cf58-46d0-802a-d1441e2ae176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:45:15.876409 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 637/1275] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:45:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:45:15.899399 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97e4e7-0903-4848-9a3b-49752130552c None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:15.997489 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97e4e7-0903-4848-9a3b-49752130552c None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:16.018388 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:16.037203 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b732e-4a9a-4a44-97e3-64e3d00f6410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:16.037791 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b732e-4a9a-4a44-97e3-64e3d00f6410 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:16.038070 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b732e-4a9a-4a44-97e3-64e3d00f6410 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:16.038341 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b732e-4a9a-4a44-97e3-64e3d00f6410 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:16.048816 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b732e-4a9a-4a44-97e3-64e3d00f6410 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 10:45:16.053478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-a95b732e-4a9a-4a44-97e3-64e3d00f6410 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:45:16.053478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:45:16.053478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:45:16.053478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:45:16.053478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:45:16.053478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:45:16.053478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:45:16.053478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:45:16.053478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:45:16.053478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:45:16.053478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:45:16.053478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:45:16.053478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 10:45:16.053478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 10:45:16.053478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 10:45:16.053478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 10:45:16.054594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 10:45:16.054594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 10:45:16.054594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 10:45:16.054594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 10:45:16.054594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:45:16.054594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:45:16.054594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:45:16.054594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:45:16.054594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:45:16.054594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:45:16.054594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:45:16.054594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:45:16.054594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:45:16.054594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:45:16.054594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:45:16.054594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:45:16.055634 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:45:16.055634 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:45:16.055634 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:45:16.055634 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:45:16.055634 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 10:45:16.055634 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 10:45:16.055634 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 10:45:16.055634 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 10:45:16.055634 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 10:45:16.055634 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 10:45:16.055634 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 10:45:16.055634 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:45:16.055634 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 639/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Sun Aug 7 10:45:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 10:45:16.060567 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5e2ea-cf58-46d0-802a-d1441e2ae176 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:16.139155 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:16.157718 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5e2ea-cf58-46d0-802a-d1441e2ae176 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:16.190867 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2721f-d56d-47e1-82f5-eb7c1c5fee69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:16.191458 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2721f-d56d-47e1-82f5-eb7c1c5fee69 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:16.191748 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2721f-d56d-47e1-82f5-eb7c1c5fee69 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:16.192036 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a2721f-d56d-47e1-82f5-eb7c1c5fee69 None admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:16.192697 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2721f-d56d-47e1-82f5-eb7c1c5fee69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:45:16.192998 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2721f-d56d-47e1-82f5-eb7c1c5fee69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:16.194376 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a2721f-d56d-47e1-82f5-eb7c1c5fee69 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:16.202605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 638/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Sun Aug 7 10:45:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:45:16.208505 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b732e-4a9a-4a44-97e3-64e3d00f6410 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:16.307623 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b732e-4a9a-4a44-97e3-64e3d00f6410 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:16.340172 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72074163-765d-49c5-a7ee-a53251ba3670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:16.340787 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72074163-765d-49c5-a7ee-a53251ba3670 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:16.341061 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72074163-765d-49c5-a7ee-a53251ba3670 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:16.341352 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72074163-765d-49c5-a7ee-a53251ba3670 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:16.351607 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72074163-765d-49c5-a7ee-a53251ba3670 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:16.353037 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72074163-765d-49c5-a7ee-a53251ba3670 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:16.367530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-72074163-765d-49c5-a7ee-a53251ba3670 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:45:16.367530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:45:16.367530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:45:16.367530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:45:16.367530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:45:16.367530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:45:16.367530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:45:16.367530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:45:16.367530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:45:16.367530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:45:16.367530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:45:16.367530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:45:16.367530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:45:16.367530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:45:16.367530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:45:16.367530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:45:16.368627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:45:16.368627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:45:16.368627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:45:16.368627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:45:16.368627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:45:16.368627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:45:16.368627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:45:16.368627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:45:16.368627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:45:16.368627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:45:16.368627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:45:16.368627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:45:16.368627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:45:16.368627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:45:16.368627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:45:16.368627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:45:16.368627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:45:16.369840 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:45:16.369840 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:45:16.369840 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:45:16.369840 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 640/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:45:16.374436 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2721f-d56d-47e1-82f5-eb7c1c5fee69 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:16.469784 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a2721f-d56d-47e1-82f5-eb7c1c5fee69 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:16.502676 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c01c0-6536-49e4-8f14-983dca83d6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:16.503274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c01c0-6536-49e4-8f14-983dca83d6ec None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:16.503549 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c01c0-6536-49e4-8f14-983dca83d6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:16.503824 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c01c0-6536-49e4-8f14-983dca83d6ec None admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:16.504459 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c01c0-6536-49e4-8f14-983dca83d6ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:45:16.504755 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c01c0-6536-49e4-8f14-983dca83d6ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:16.506128 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c01c0-6536-49e4-8f14-983dca83d6ec None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:16.518375 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 639/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:45:16.524091 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72074163-765d-49c5-a7ee-a53251ba3670 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:16.556686 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:16.626964 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72074163-765d-49c5-a7ee-a53251ba3670 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:16.659203 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d499504-621a-44ea-a038-da7dec882ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:16.659818 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d499504-621a-44ea-a038-da7dec882ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:16.660096 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d499504-621a-44ea-a038-da7dec882ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:16.660364 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d499504-621a-44ea-a038-da7dec882ae6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:16.667451 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d499504-621a-44ea-a038-da7dec882ae6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:16.668882 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d499504-621a-44ea-a038-da7dec882ae6 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:16.680001 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-8d499504-621a-44ea-a038-da7dec882ae6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 10:45:16.680001 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:45:16.680001 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:45:16.680001 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:45:16.680001 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:45:16.680001 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:45:16.680001 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:45:16.680001 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:45:16.680001 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:45:16.680001 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:45:16.680001 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:45:16.680001 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:45:16.680001 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 10:45:16.680001 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 10:45:16.680001 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 10:45:16.680001 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 10:45:16.681112 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:45:16.681112 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:45:16.681112 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 10:45:16.681112 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:45:16.681112 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 10:45:16.681112 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 10:45:16.681112 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:45:16.681112 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:45:16.681112 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:45:16.681112 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:45:16.681112 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:45:16.681112 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:45:16.681112 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:45:16.681112 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:45:16.681112 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:45:16.681112 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:45:16.681112 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:45:16.681112 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:45:16.682305 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:45:16.682305 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:45:16.682305 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 10:45:16.682305 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 10:45:16.682305 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 10:45:16.682305 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 10:45:16.682305 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 10:45:16.682305 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 10:45:16.682305 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 10:45:16.682305 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:45:16.682305 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 641/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:45:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:45:16.686918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c01c0-6536-49e4-8f14-983dca83d6ec None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:16.690687 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:16.784206 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c01c0-6536-49e4-8f14-983dca83d6ec None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:16.816667 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654236ff-4f48-4a32-92c9-0233156254cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:16.817238 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654236ff-4f48-4a32-92c9-0233156254cd None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:16.817546 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654236ff-4f48-4a32-92c9-0233156254cd None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:16.817815 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654236ff-4f48-4a32-92c9-0233156254cd None admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:16.818535 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654236ff-4f48-4a32-92c9-0233156254cd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:45:16.818841 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654236ff-4f48-4a32-92c9-0233156254cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:16.820265 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654236ff-4f48-4a32-92c9-0233156254cd None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:16.839269 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 640/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Sun Aug 7 10:45:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:45:16.845779 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d499504-621a-44ea-a038-da7dec882ae6 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:16.932919 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:16.942611 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d499504-621a-44ea-a038-da7dec882ae6 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:16.975366 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d47130-e27b-44f6-ae0a-f4e33ee785e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:16.975952 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d47130-e27b-44f6-ae0a-f4e33ee785e6 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:16.976231 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d47130-e27b-44f6-ae0a-f4e33ee785e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:16.976502 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d47130-e27b-44f6-ae0a-f4e33ee785e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:17.047505 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d47130-e27b-44f6-ae0a-f4e33ee785e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:17.048936 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d47130-e27b-44f6-ae0a-f4e33ee785e6 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:17.133523 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:17.144405 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 642/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Sun Aug 7 10:45:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 10:45:17.150325 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654236ff-4f48-4a32-92c9-0233156254cd None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:17.209394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:17.246495 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654236ff-4f48-4a32-92c9-0233156254cd None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:17.279643 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7586da-e054-4e90-84cf-d6ec5b3fdcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:17.280247 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7586da-e054-4e90-84cf-d6ec5b3fdcca None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:17.280521 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7586da-e054-4e90-84cf-d6ec5b3fdcca None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:17.280814 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7586da-e054-4e90-84cf-d6ec5b3fdcca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:17.290495 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7586da-e054-4e90-84cf-d6ec5b3fdcca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:17.291910 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7586da-e054-4e90-84cf-d6ec5b3fdcca None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:17.305890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-8b7586da-e054-4e90-84cf-d6ec5b3fdcca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:45:17.305890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:45:17.305890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:45:17.305890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:45:17.305890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:45:17.305890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:45:17.305890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:45:17.305890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:45:17.305890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:45:17.305890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:45:17.305890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:45:17.305890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:45:17.305890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 10:45:17.305890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 10:45:17.305890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 10:45:17.305890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 10:45:17.307007 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:45:17.307007 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:45:17.307007 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:45:17.307007 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:45:17.307007 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:45:17.307007 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:45:17.307007 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:45:17.307007 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:45:17.307007 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:45:17.307007 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:45:17.307007 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:45:17.307007 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:45:17.307007 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:45:17.307007 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:45:17.307007 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:45:17.307007 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:45:17.307007 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 10:45:17.308029 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 10:45:17.308029 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 10:45:17.308029 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:45:17.308029 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 641/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:45:17.313079 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d47130-e27b-44f6-ae0a-f4e33ee785e6 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:17.408000 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d47130-e27b-44f6-ae0a-f4e33ee785e6 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:17.445661 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119efccf-c279-4bd0-80a7-dfa972859687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:17.446247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119efccf-c279-4bd0-80a7-dfa972859687 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:17.446519 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119efccf-c279-4bd0-80a7-dfa972859687 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:17.446782 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119efccf-c279-4bd0-80a7-dfa972859687 None admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:17.447410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119efccf-c279-4bd0-80a7-dfa972859687 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:45:17.447715 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119efccf-c279-4bd0-80a7-dfa972859687 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:17.449064 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119efccf-c279-4bd0-80a7-dfa972859687 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:17.460349 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 643/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Sun Aug 7 10:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:45:17.465993 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7586da-e054-4e90-84cf-d6ec5b3fdcca None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:17.569950 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7586da-e054-4e90-84cf-d6ec5b3fdcca None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:17.584039 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:17.604696 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e672fa0-7c79-45c9-8d51-3d53e72445e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:17.605327 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e672fa0-7c79-45c9-8d51-3d53e72445e6 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:17.605612 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e672fa0-7c79-45c9-8d51-3d53e72445e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:17.605876 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e672fa0-7c79-45c9-8d51-3d53e72445e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:17.612791 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e672fa0-7c79-45c9-8d51-3d53e72445e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:17.614234 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e672fa0-7c79-45c9-8d51-3d53e72445e6 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:17.625610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application [None req-3e672fa0-7c79-45c9-8d51-3d53e72445e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:45:17.625610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:45:17.625610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:45:17.625610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:45:17.625610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:45:17.625610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:45:17.625610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:45:17.625610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:45:17.625610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:45:17.625610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:45:17.625610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:45:17.625610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:45:17.625610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 10:45:17.625610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 10:45:17.625610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 10:45:17.626529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 10:45:17.626529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:45:17.626529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:45:17.626529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:45:17.626529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:45:17.626529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:45:17.626529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:45:17.626529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:45:17.626529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application with Lock( Aug 07 10:45:17.626529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:45:17.626529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:45:17.626529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:45:17.626529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:45:17.626529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:45:17.626529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:45:17.626529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:45:17.626529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:45:17.627449 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 10:45:17.627449 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 10:45:17.627449 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 10:45:17.627449 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 10:45:17.627449 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 10:45:17.627449 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 10:45:17.627449 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 10:45:17.627449 dv-cinder-850320-3-smb devstack@keystone.service[80144]: ERROR keystone.server.flask.application Aug 07 10:45:17.627449 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 642/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Sun Aug 7 10:45:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:45:17.632543 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119efccf-c279-4bd0-80a7-dfa972859687 None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:17.682778 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:17.734655 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119efccf-c279-4bd0-80a7-dfa972859687 None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:17.767168 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71bfbf-ef90-4d6d-9001-b8b854759b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:17.767752 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71bfbf-ef90-4d6d-9001-b8b854759b19 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:17.768026 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71bfbf-ef90-4d6d-9001-b8b854759b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:17.768293 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71bfbf-ef90-4d6d-9001-b8b854759b19 None admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:17.768985 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f71bfbf-ef90-4d6d-9001-b8b854759b19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:45:17.769283 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f71bfbf-ef90-4d6d-9001-b8b854759b19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:17.770743 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f71bfbf-ef90-4d6d-9001-b8b854759b19 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:17.783312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 644/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Sun Aug 7 10:45:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:45:17.789400 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e672fa0-7c79-45c9-8d51-3d53e72445e6 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:17.885582 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e672fa0-7c79-45c9-8d51-3d53e72445e6 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:17.917691 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b535e1-c696-4dd2-bfe8-7f47db115d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:17.918269 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b535e1-c696-4dd2-bfe8-7f47db115d52 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:17.918544 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b535e1-c696-4dd2-bfe8-7f47db115d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:17.918811 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b535e1-c696-4dd2-bfe8-7f47db115d52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:17.919524 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b535e1-c696-4dd2-bfe8-7f47db115d52 None admin] RBAC: Adding query filter params (role.id=9da6e501237c405ca021a9d9f6173caf, scope.project.id=62eed8550ae3403f8a75894dbd19cf4a, user.id=b33f797a9af946a4b296d973388891be) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:45:17.919825 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b535e1-c696-4dd2-bfe8-7f47db115d52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:17.921217 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b535e1-c696-4dd2-bfe8-7f47db115d52 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:17.927318 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 643/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Sun Aug 7 10:45:17 2022] GET /identity/v3/role_assignments?user.id=b33f797a9af946a4b296d973388891be&scope.project.id=62eed8550ae3403f8a75894dbd19cf4a&role.id=9da6e501237c405ca021a9d9f6173caf => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:45:19.926252 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed37df-6767-49c9-bcaa-7efd5eeeebb6 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:19.926774 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed37df-6767-49c9-bcaa-7efd5eeeebb6 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:19.926774 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed37df-6767-49c9-bcaa-7efd5eeeebb6 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:19.928124 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 645/1288] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:45:19.933046 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4caafa-d71a-4cdc-a514-8c48a14b9a28 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:19.933487 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4caafa-d71a-4cdc-a514-8c48a14b9a28 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:19.933710 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4caafa-d71a-4cdc-a514-8c48a14b9a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:19.951889 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-0c4caafa-d71a-4cdc-a514-8c48a14b9a28 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:45:19.953072 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-0c4caafa-d71a-4cdc-a514-8c48a14b9a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:45:19.980697 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:20.020399 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 644/1289] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:45:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:45:20.042487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed37df-6767-49c9-bcaa-7efd5eeeebb6 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:20.141142 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed37df-6767-49c9-bcaa-7efd5eeeebb6 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:20.151295 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:20.174812 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09562c38-dfee-475d-8cb4-e08631e321ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:20.175422 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09562c38-dfee-475d-8cb4-e08631e321ae None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:20.175696 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09562c38-dfee-475d-8cb4-e08631e321ae None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:20.175961 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09562c38-dfee-475d-8cb4-e08631e321ae None admin] PATH_INFO: `/v3/services/placement` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:20.176586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09562c38-dfee-475d-8cb4-e08631e321ae None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:20.177929 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09562c38-dfee-475d-8cb4-e08631e321ae None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:20.186257 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-09562c38-dfee-475d-8cb4-e08631e321ae None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 10:45:20.186257 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:45:20.186257 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 10:45:20.186257 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 10:45:20.186257 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 10:45:20.186257 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 10:45:20.186257 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 10:45:20.186257 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:45:20.186257 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 10:45:20.186257 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:45:20.186257 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 10:45:20.186257 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:45:20.186257 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:45:20.186257 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:45:20.186257 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:45:20.186257 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:45:20.186257 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:45:20.187525 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:45:20.187525 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:45:20.187525 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:45:20.187525 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:45:20.187525 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:45:20.187525 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:45:20.187525 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 10:45:20.187525 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 10:45:20.187525 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 10:45:20.187525 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 10:45:20.187525 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:45:20.187525 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:45:20.187525 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:45:20.187525 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:45:20.187525 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:45:20.187525 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:45:20.188547 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:45:20.188547 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:45:20.188547 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:45:20.188547 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:45:20.188547 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:45:20.188547 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:45:20.188547 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:45:20.188547 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:45:20.188547 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:45:20.188547 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:45:20.188547 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 10:45:20.188547 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:45:20.188547 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 10:45:20.188547 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:45:20.188547 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 646/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Aug 7 10:45:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:45:20.193389 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4caafa-d71a-4cdc-a514-8c48a14b9a28 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:20.288538 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4caafa-d71a-4cdc-a514-8c48a14b9a28 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:20.324595 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c28cf7-f382-4fe7-b748-d734d08f5f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:20.325188 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c28cf7-f382-4fe7-b748-d734d08f5f53 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:20.325489 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c28cf7-f382-4fe7-b748-d734d08f5f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:20.325765 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c28cf7-f382-4fe7-b748-d734d08f5f53 None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:20.326390 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c28cf7-f382-4fe7-b748-d734d08f5f53 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:45:20.326689 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c28cf7-f382-4fe7-b748-d734d08f5f53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:20.328272 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c28cf7-f382-4fe7-b748-d734d08f5f53 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:20.335867 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 645/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Sun Aug 7 10:45:20 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:45:20.341495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09562c38-dfee-475d-8cb4-e08631e321ae None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:20.438391 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09562c38-dfee-475d-8cb4-e08631e321ae None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:20.470747 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5659e37-66d1-4991-b5d8-74a71f33e564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:20.471333 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5659e37-66d1-4991-b5d8-74a71f33e564 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:20.471607 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5659e37-66d1-4991-b5d8-74a71f33e564 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:20.471872 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5659e37-66d1-4991-b5d8-74a71f33e564 None admin] PATH_INFO: `/v3/services` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:20.472494 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5659e37-66d1-4991-b5d8-74a71f33e564 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:45:20.472791 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5659e37-66d1-4991-b5d8-74a71f33e564 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:20.474160 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5659e37-66d1-4991-b5d8-74a71f33e564 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:20.478401 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 647/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Sun Aug 7 10:45:20 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:45:22.421019 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e3ec8-17b8-46e1-8a31-4227f4b58960 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:22.421546 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e3ec8-17b8-46e1-8a31-4227f4b58960 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:22.421637 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e3ec8-17b8-46e1-8a31-4227f4b58960 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:22.422938 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 646/1293] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:45:22.428097 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bb32e-ea7c-4197-8615-7ee46ebb2195 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:22.428509 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bb32e-ea7c-4197-8615-7ee46ebb2195 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:22.428617 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9bb32e-ea7c-4197-8615-7ee46ebb2195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:22.446669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-1a9bb32e-ea7c-4197-8615-7ee46ebb2195 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:45:22.447832 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-1a9bb32e-ea7c-4197-8615-7ee46ebb2195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:45:22.476928 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:22.513686 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 648/1294] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:45:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:45:22.535956 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e3ec8-17b8-46e1-8a31-4227f4b58960 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:22.566287 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:22.643281 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e3ec8-17b8-46e1-8a31-4227f4b58960 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:22.677296 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c64b7-b220-4bb5-bd8c-6d4f9fec6df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:22.677913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c64b7-b220-4bb5-bd8c-6d4f9fec6df2 None admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:22.678184 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c64b7-b220-4bb5-bd8c-6d4f9fec6df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:22.678445 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c64b7-b220-4bb5-bd8c-6d4f9fec6df2 None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:22.679081 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c64b7-b220-4bb5-bd8c-6d4f9fec6df2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:22.680407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c64b7-b220-4bb5-bd8c-6d4f9fec6df2 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:22.694816 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 647/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Sun Aug 7 10:45:22 2022] POST /identity/v3/services => generated 246 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:45:24.682734 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2a744-3e4c-47ef-908e-7444a7edd37d None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:24.683275 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2a744-3e4c-47ef-908e-7444a7edd37d None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:24.683275 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2a744-3e4c-47ef-908e-7444a7edd37d None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:24.684708 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 649/1296] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:45:24.690207 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e8583-1799-4249-8cd3-261d523772a5 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:24.690637 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e8583-1799-4249-8cd3-261d523772a5 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:24.690731 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e8583-1799-4249-8cd3-261d523772a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:24.708797 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-1b2e8583-1799-4249-8cd3-261d523772a5 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:45:24.710008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-1b2e8583-1799-4249-8cd3-261d523772a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:45:24.780014 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 648/1297] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:45:24 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:45:24.801798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2a744-3e4c-47ef-908e-7444a7edd37d None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:24.898656 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2a744-3e4c-47ef-908e-7444a7edd37d None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:24.931012 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87cc1a7-db09-4401-8da2-83b55817d98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:24.931617 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cc1a7-db09-4401-8da2-83b55817d98b None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:24.931893 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cc1a7-db09-4401-8da2-83b55817d98b None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:24.932157 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cc1a7-db09-4401-8da2-83b55817d98b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:24.932726 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87cc1a7-db09-4401-8da2-83b55817d98b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:24.934146 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87cc1a7-db09-4401-8da2-83b55817d98b None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:24.943002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-c87cc1a7-db09-4401-8da2-83b55817d98b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 10:45:24.943002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:45:24.943002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 10:45:24.943002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 10:45:24.943002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 10:45:24.943002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 10:45:24.943002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 10:45:24.943002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:45:24.943002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 10:45:24.943002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:45:24.943002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 10:45:24.943002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:45:24.943002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:45:24.943002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:45:24.943002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:45:24.943002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:45:24.943002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:45:24.944157 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:45:24.944157 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:45:24.944157 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:45:24.944157 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:45:24.944157 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:45:24.944157 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:45:24.944157 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 10:45:24.944157 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 10:45:24.944157 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 10:45:24.944157 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 10:45:24.944157 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:45:24.944157 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:45:24.944157 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:45:24.944157 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:45:24.944157 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:45:24.944157 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:45:24.945044 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:45:24.945044 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:45:24.945044 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:45:24.945044 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:45:24.945044 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:45:24.945044 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:45:24.945044 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:45:24.945044 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:45:24.945044 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:45:24.945044 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:45:24.945044 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 10:45:24.945044 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:45:24.945044 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 10:45:24.945044 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:45:24.945044 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 650/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Aug 7 10:45:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:45:24.950006 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e8583-1799-4249-8cd3-261d523772a5 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:24.967570 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:25.053233 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e8583-1799-4249-8cd3-261d523772a5 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:25.088544 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179161a-614b-49ab-be88-0de01e2eb434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:25.089139 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179161a-614b-49ab-be88-0de01e2eb434 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:25.089448 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179161a-614b-49ab-be88-0de01e2eb434 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:25.089713 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179161a-614b-49ab-be88-0de01e2eb434 None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:25.090331 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179161a-614b-49ab-be88-0de01e2eb434 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:45:25.090625 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179161a-614b-49ab-be88-0de01e2eb434 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:25.091958 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179161a-614b-49ab-be88-0de01e2eb434 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:25.096901 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 649/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Sun Aug 7 10:45:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:45:25.102861 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87cc1a7-db09-4401-8da2-83b55817d98b None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:25.134329 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:25.200628 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87cc1a7-db09-4401-8da2-83b55817d98b None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:25.232493 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dce52d-ad85-4bcf-8d11-b795694af679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:25.233084 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dce52d-ad85-4bcf-8d11-b795694af679 None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:25.233392 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dce52d-ad85-4bcf-8d11-b795694af679 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:25.233669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dce52d-ad85-4bcf-8d11-b795694af679 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:25.234900 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dce52d-ad85-4bcf-8d11-b795694af679 None admin] RBAC: Adding query filter params (interface=public, service_id=f67add946d0a40b78b34d0fdabc3c231, region_id=RegionOne) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:45:25.235206 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dce52d-ad85-4bcf-8d11-b795694af679 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:25.236557 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dce52d-ad85-4bcf-8d11-b795694af679 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:25.241618 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 651/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Sun Aug 7 10:45:25 2022] GET /identity/v3/endpoints?service_id=f67add946d0a40b78b34d0fdabc3c231&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:45:25.246943 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179161a-614b-49ab-be88-0de01e2eb434 None admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:25.326780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:25.345847 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179161a-614b-49ab-be88-0de01e2eb434 None admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:25.379650 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f08071-fac7-4595-8ac0-6fc85b2d9a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:25.380240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f08071-fac7-4595-8ac0-6fc85b2d9a88 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:25.380515 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f08071-fac7-4595-8ac0-6fc85b2d9a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:25.380781 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f08071-fac7-4595-8ac0-6fc85b2d9a88 None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:25.381411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f08071-fac7-4595-8ac0-6fc85b2d9a88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:25.382758 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f08071-fac7-4595-8ac0-6fc85b2d9a88 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:25.389419 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 650/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Sun Aug 7 10:45:25 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:45:27.346948 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68b1ce-e776-44ee-93f6-f6e92891049d None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:27.346948 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68b1ce-e776-44ee-93f6-f6e92891049d None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:27.347378 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68b1ce-e776-44ee-93f6-f6e92891049d None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:27.348522 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 652/1302] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:45:27.353520 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d437ad-383a-4be9-8a96-4df3e84969e5 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:27.353909 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d437ad-383a-4be9-8a96-4df3e84969e5 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:27.354065 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d437ad-383a-4be9-8a96-4df3e84969e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:27.371693 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-a5d437ad-383a-4be9-8a96-4df3e84969e5 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:45:27.372868 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-a5d437ad-383a-4be9-8a96-4df3e84969e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:45:27.437038 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 651/1303] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:45:27 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 10:45:27.459488 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68b1ce-e776-44ee-93f6-f6e92891049d None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:27.553219 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:27.560805 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68b1ce-e776-44ee-93f6-f6e92891049d None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:27.597294 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d985f2-52a0-4db4-a80c-4ab89e3cff4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:27.597921 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d985f2-52a0-4db4-a80c-4ab89e3cff4b None admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:27.598200 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d985f2-52a0-4db4-a80c-4ab89e3cff4b None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:27.598508 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d985f2-52a0-4db4-a80c-4ab89e3cff4b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:27.599164 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d985f2-52a0-4db4-a80c-4ab89e3cff4b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:27.600692 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d985f2-52a0-4db4-a80c-4ab89e3cff4b None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:27.610531 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application [None req-c4d985f2-52a0-4db4-a80c-4ab89e3cff4b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 10:45:27.610531 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:45:27.610531 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 10:45:27.610531 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 10:45:27.610531 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 10:45:27.610531 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 10:45:27.610531 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 10:45:27.610531 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:45:27.610531 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 10:45:27.610531 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:45:27.610531 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 10:45:27.610531 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:45:27.610531 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 10:45:27.610531 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 10:45:27.610531 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 10:45:27.610531 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 10:45:27.610531 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 10:45:27.611698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 10:45:27.611698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 10:45:27.611698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 10:45:27.611698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 10:45:27.611698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 10:45:27.611698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 10:45:27.611698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 10:45:27.611698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 10:45:27.611698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 10:45:27.611698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 10:45:27.611698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 10:45:27.611698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 10:45:27.611698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 10:45:27.611698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 10:45:27.611698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 10:45:27.611698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 10:45:27.612900 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 10:45:27.612900 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application with Lock( Aug 07 10:45:27.612900 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 10:45:27.612900 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self._enter() Aug 07 10:45:27.612900 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 10:45:27.612900 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 10:45:27.612900 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 10:45:27.612900 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application return self.creator() Aug 07 10:45:27.612900 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 10:45:27.612900 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application created_value = creator( Aug 07 10:45:27.612900 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 10:45:27.612900 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 10:45:27.612900 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 10:45:27.612900 dv-cinder-850320-3-smb devstack@keystone.service[80145]: ERROR keystone.server.flask.application Aug 07 10:45:27.612900 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 653/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Sun Aug 7 10:45:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 10:45:27.618174 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d437ad-383a-4be9-8a96-4df3e84969e5 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:27.692018 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:27.714194 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d437ad-383a-4be9-8a96-4df3e84969e5 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:27.747815 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab1f91-d676-4f8f-a0de-a8248dbf2041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:27.748408 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab1f91-d676-4f8f-a0de-a8248dbf2041 None admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:27.748683 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab1f91-d676-4f8f-a0de-a8248dbf2041 None admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:27.748951 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab1f91-d676-4f8f-a0de-a8248dbf2041 None admin] PATH_INFO: `/v3/services` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:27.749648 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab1f91-d676-4f8f-a0de-a8248dbf2041 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:45:27.749946 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab1f91-d676-4f8f-a0de-a8248dbf2041 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:27.751548 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab1f91-d676-4f8f-a0de-a8248dbf2041 None admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:27.756453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 652/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Sun Aug 7 10:45:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:45:27.762311 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d985f2-52a0-4db4-a80c-4ab89e3cff4b None admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:45:27.861260 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d985f2-52a0-4db4-a80c-4ab89e3cff4b None admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:45:27.893958 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27955c7-a31b-4114-9b66-13da6d2e4c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:45:27.894544 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27955c7-a31b-4114-9b66-13da6d2e4c56 None admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:45:27.894816 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27955c7-a31b-4114-9b66-13da6d2e4c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:45:27.895081 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27955c7-a31b-4114-9b66-13da6d2e4c56 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:45:27.895732 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27955c7-a31b-4114-9b66-13da6d2e4c56 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:45:27.897069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27955c7-a31b-4114-9b66-13da6d2e4c56 None admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:45:27.916306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 654/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:45:27 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:45:37.753599 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=30 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:45:37.912396 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:46:30.540953 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e072fc7-f281-4f39-a304-0ab4d82649ba None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:30.542035 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e072fc7-f281-4f39-a304-0ab4d82649ba None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:30.542520 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e072fc7-f281-4f39-a304-0ab4d82649ba None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:30.549732 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153449d3-c17c-40ee-9e3e-9bc6287b3b41 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:30.550566 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153449d3-c17c-40ee-9e3e-9bc6287b3b41 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:30.551057 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153449d3-c17c-40ee-9e3e-9bc6287b3b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:30.556009 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 653/1307] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:46:30 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 10:46:30.629050 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-153449d3-c17c-40ee-9e3e-9bc6287b3b41 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:46:30.630294 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-153449d3-c17c-40ee-9e3e-9bc6287b3b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:46:30.753350 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 655/1308] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:46:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:46:30.800572 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38948b6-31d2-4d0c-82d8-fbc18c0502d4 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:30.800851 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38948b6-31d2-4d0c-82d8-fbc18c0502d4 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:30.801658 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38948b6-31d2-4d0c-82d8-fbc18c0502d4 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:30.803157 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 654/1309] 10.222.0.27 () {54 vars in 965 bytes} [Sun Aug 7 10:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:46:30.811539 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e5f6c-02d8-45ac-ba6b-a3822dd18a0b None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:30.812021 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e5f6c-02d8-45ac-ba6b-a3822dd18a0b None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:30.812418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e5f6c-02d8-45ac-ba6b-a3822dd18a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:30.912796 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-4a2e5f6c-02d8-45ac-ba6b-a3822dd18a0b None None] MFA Rules not processed for user `9b03428b48264b9da9800283496de2e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:46:30.914687 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-4a2e5f6c-02d8-45ac-ba6b-a3822dd18a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:46:30.944128 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:46:31.025633 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 656/1310] 10.222.0.27 () {58 vars in 1062 bytes} [Sun Aug 7 10:46:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:46:31.035252 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38948b6-31d2-4d0c-82d8-fbc18c0502d4 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:46:31.037208 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-d38948b6-31d2-4d0c-82d8-fbc18c0502d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:46:31.161796 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38948b6-31d2-4d0c-82d8-fbc18c0502d4 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:46:31.238628 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9548e-4e66-40bf-ae4d-73ea4b724dac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:46:31.239227 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9548e-4e66-40bf-ae4d-73ea4b724dac service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:31.239499 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9548e-4e66-40bf-ae4d-73ea4b724dac service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:31.239765 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9548e-4e66-40bf-ae4d-73ea4b724dac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:31.241368 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-74f9548e-4e66-40bf-ae4d-73ea4b724dac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:46:31.297890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:46:31.364773 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f9548e-4e66-40bf-ae4d-73ea4b724dac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:46:31.366750 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f9548e-4e66-40bf-ae4d-73ea4b724dac service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:46:31.387249 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 655/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:46:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:46:33.668936 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a720f-a17a-4800-a55c-e8a7ce2a70c2 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:33.669502 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a720f-a17a-4800-a55c-e8a7ce2a70c2 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:33.669502 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a720f-a17a-4800-a55c-e8a7ce2a70c2 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:33.670870 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 657/1312] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:46:33.676078 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd71e6-b85a-4146-87aa-b5d21cf97fc6 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:33.676466 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd71e6-b85a-4146-87aa-b5d21cf97fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:33.676620 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd71e6-b85a-4146-87aa-b5d21cf97fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:33.763766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-f4dd71e6-b85a-4146-87aa-b5d21cf97fc6 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:46:33.765618 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-f4dd71e6-b85a-4146-87aa-b5d21cf97fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:46:33.881152 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 656/1313] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:46:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:46:33.919630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a720f-a17a-4800-a55c-e8a7ce2a70c2 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:46:33.921235 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a96a720f-a17a-4800-a55c-e8a7ce2a70c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:46:34.036160 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a720f-a17a-4800-a55c-e8a7ce2a70c2 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:46:34.112711 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:46:34.115341 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e3074-9c1d-4675-b40d-cd6afa949d60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:46:34.116549 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e3074-9c1d-4675-b40d-cd6afa949d60 service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:34.117293 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e3074-9c1d-4675-b40d-cd6afa949d60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:34.117958 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e3074-9c1d-4675-b40d-cd6afa949d60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:34.119570 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-c07e3074-9c1d-4675-b40d-cd6afa949d60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:46:34.239198 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e3074-9c1d-4675-b40d-cd6afa949d60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:46:34.240627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e3074-9c1d-4675-b40d-cd6afa949d60 service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:46:34.259318 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 658/1314] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:46:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:46:36.571899 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea3a6c-3618-4f51-b442-d62656d0189f None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:36.572454 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea3a6c-3618-4f51-b442-d62656d0189f None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:36.572454 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea3a6c-3618-4f51-b442-d62656d0189f None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:36.573820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 657/1315] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:46:36.578907 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b38671-d3ac-42d7-8bea-df8e66a7ca99 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:36.579325 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b38671-d3ac-42d7-8bea-df8e66a7ca99 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:36.579433 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b38671-d3ac-42d7-8bea-df8e66a7ca99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:36.643662 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-b6b38671-d3ac-42d7-8bea-df8e66a7ca99 None None] MFA Rules not processed for user `ccd3dc17c64b4e27b6022912d758a62d`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:46:36.644881 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-b6b38671-d3ac-42d7-8bea-df8e66a7ca99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:46:36.694677 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:46:36.738433 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 659/1316] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:46:36 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:46:36.795062 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8852a4-7fd3-43bd-84aa-140fb15426f1 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:36.795341 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8852a4-7fd3-43bd-84aa-140fb15426f1 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:36.795615 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8852a4-7fd3-43bd-84aa-140fb15426f1 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:36.797624 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 658/1317] 10.222.0.27 () {54 vars in 965 bytes} [Sun Aug 7 10:46:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:46:36.803469 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6f5a3-8f62-4739-97d1-7df42807b701 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:36.803759 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6f5a3-8f62-4739-97d1-7df42807b701 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:36.804029 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6f5a3-8f62-4739-97d1-7df42807b701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:36.878159 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-26e6f5a3-8f62-4739-97d1-7df42807b701 None None] MFA Rules not processed for user `9b03428b48264b9da9800283496de2e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:46:36.879351 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-26e6f5a3-8f62-4739-97d1-7df42807b701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:46:36.952123 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 660/1318] 10.222.0.27 () {58 vars in 1062 bytes} [Sun Aug 7 10:46:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:46:36.960854 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8852a4-7fd3-43bd-84aa-140fb15426f1 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:46:36.962416 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-6b8852a4-7fd3-43bd-84aa-140fb15426f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:46:36.972589 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:46:37.065407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8852a4-7fd3-43bd-84aa-140fb15426f1 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:46:37.135921 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e731fc2-45af-4b3a-88c7-7b8a0022d8fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:46:37.136508 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e731fc2-45af-4b3a-88c7-7b8a0022d8fa service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:37.136784 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e731fc2-45af-4b3a-88c7-7b8a0022d8fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:37.137050 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e731fc2-45af-4b3a-88c7-7b8a0022d8fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:37.138650 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-1e731fc2-45af-4b3a-88c7-7b8a0022d8fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:46:37.199358 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:46:37.244455 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e731fc2-45af-4b3a-88c7-7b8a0022d8fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:46:37.245842 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e731fc2-45af-4b3a-88c7-7b8a0022d8fa service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:46:37.265101 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 659/1319] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:46:36 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:46:40.170051 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273fc8a-f4c3-44ba-947a-8f4f7d9e7537 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:40.170511 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273fc8a-f4c3-44ba-947a-8f4f7d9e7537 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:40.170606 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273fc8a-f4c3-44ba-947a-8f4f7d9e7537 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:40.171947 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 661/1320] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:46:40.177172 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a872bf-56fa-4237-9dbe-d21fe61ccd94 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:40.177580 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a872bf-56fa-4237-9dbe-d21fe61ccd94 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:40.177742 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a872bf-56fa-4237-9dbe-d21fe61ccd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:40.241804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-87a872bf-56fa-4237-9dbe-d21fe61ccd94 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:46:40.242989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-87a872bf-56fa-4237-9dbe-d21fe61ccd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:46:40.349858 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 660/1321] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:46:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:46:40.388712 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273fc8a-f4c3-44ba-947a-8f4f7d9e7537 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:46:40.390912 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-d273fc8a-f4c3-44ba-947a-8f4f7d9e7537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:46:40.440230 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:46:40.492024 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273fc8a-f4c3-44ba-947a-8f4f7d9e7537 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:46:40.562709 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a38b8d-9615-4af8-b23e-b8e1fe0b77ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:46:40.563292 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a38b8d-9615-4af8-b23e-b8e1fe0b77ba service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:40.563564 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a38b8d-9615-4af8-b23e-b8e1fe0b77ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:40.563829 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a38b8d-9615-4af8-b23e-b8e1fe0b77ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:40.565427 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-96a38b8d-9615-4af8-b23e-b8e1fe0b77ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:46:40.679851 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:46:40.693251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a38b8d-9615-4af8-b23e-b8e1fe0b77ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:46:40.694662 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a38b8d-9615-4af8-b23e-b8e1fe0b77ba service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:46:40.712013 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 662/1322] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:46:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:46:43.416905 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0fe0d-ea83-44e3-bc14-91022b268956 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:43.417442 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0fe0d-ea83-44e3-bc14-91022b268956 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:43.417534 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0fe0d-ea83-44e3-bc14-91022b268956 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:43.418844 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 661/1323] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:46:43.424172 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7803e1-2c07-44ba-bb65-efaf57deeabc None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:43.424588 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7803e1-2c07-44ba-bb65-efaf57deeabc None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:43.424718 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7803e1-2c07-44ba-bb65-efaf57deeabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:43.490060 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-8a7803e1-2c07-44ba-bb65-efaf57deeabc None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:46:43.491262 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-8a7803e1-2c07-44ba-bb65-efaf57deeabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:46:43.593978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 663/1324] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:46:43.630942 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0fe0d-ea83-44e3-bc14-91022b268956 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:46:43.632498 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-54f0fe0d-ea83-44e3-bc14-91022b268956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:46:43.652910 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:46:43.742066 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0fe0d-ea83-44e3-bc14-91022b268956 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:46:43.815905 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c267d3f-4038-437d-8fa7-0208d1e689f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:46:43.816499 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c267d3f-4038-437d-8fa7-0208d1e689f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:43.816770 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c267d3f-4038-437d-8fa7-0208d1e689f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:43.817035 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c267d3f-4038-437d-8fa7-0208d1e689f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:43.818656 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-1c267d3f-4038-437d-8fa7-0208d1e689f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:46:43.893784 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:46:43.931161 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c267d3f-4038-437d-8fa7-0208d1e689f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:46:43.932573 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c267d3f-4038-437d-8fa7-0208d1e689f4 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:46:43.949953 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 662/1325] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:46:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:46:45.990467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3b532-db74-4f8d-b167-198a7d456932 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:45.990993 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3b532-db74-4f8d-b167-198a7d456932 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:45.990993 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3b532-db74-4f8d-b167-198a7d456932 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:45.992381 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 664/1326] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:46:45.997635 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b19db1-8be3-430f-97ce-8624eae5d044 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:45.998061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b19db1-8be3-430f-97ce-8624eae5d044 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:45.998183 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b19db1-8be3-430f-97ce-8624eae5d044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:46.066482 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-12b19db1-8be3-430f-97ce-8624eae5d044 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:46:46.067582 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-12b19db1-8be3-430f-97ce-8624eae5d044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:46:46.162573 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 663/1327] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:46:46.199145 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3b532-db74-4f8d-b167-198a7d456932 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:46:46.200672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-d0d3b532-db74-4f8d-b167-198a7d456932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:46:46.260525 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:46:46.304628 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3b532-db74-4f8d-b167-198a7d456932 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:46:46.382498 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604659f-ba18-4f55-8409-d3ff6a401893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:46:46.383100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604659f-ba18-4f55-8409-d3ff6a401893 service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:46.383372 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604659f-ba18-4f55-8409-d3ff6a401893 service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:46.383632 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604659f-ba18-4f55-8409-d3ff6a401893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:46.385222 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-1604659f-ba18-4f55-8409-d3ff6a401893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:46:46.494659 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:46:46.497181 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604659f-ba18-4f55-8409-d3ff6a401893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:46:46.498972 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604659f-ba18-4f55-8409-d3ff6a401893 service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:46:46.517548 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 665/1328] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:46:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:46:48.567177 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e9368-55bf-4193-9308-6a34713e9b36 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:48.567698 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e9368-55bf-4193-9308-6a34713e9b36 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:48.567813 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e9368-55bf-4193-9308-6a34713e9b36 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:48.569101 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 664/1329] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:46:48.574333 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7205620-9852-4138-a221-a4d1d20b7ee1 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:48.574773 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7205620-9852-4138-a221-a4d1d20b7ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:48.574868 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7205620-9852-4138-a221-a4d1d20b7ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:48.640660 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-b7205620-9852-4138-a221-a4d1d20b7ee1 None None] MFA Rules not processed for user `ccd3dc17c64b4e27b6022912d758a62d`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:46:48.641876 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-b7205620-9852-4138-a221-a4d1d20b7ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:46:48.737025 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 666/1330] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:46:48 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:46:48.774357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e9368-55bf-4193-9308-6a34713e9b36 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:46:48.775885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-d53e9368-55bf-4193-9308-6a34713e9b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:46:48.807815 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:46:48.887030 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e9368-55bf-4193-9308-6a34713e9b36 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:46:48.959408 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475df4f-2e03-44e9-88bf-16a2f27e4678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:46:48.960003 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475df4f-2e03-44e9-88bf-16a2f27e4678 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:48.960279 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475df4f-2e03-44e9-88bf-16a2f27e4678 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:48.960545 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475df4f-2e03-44e9-88bf-16a2f27e4678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:48.962151 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-5475df4f-2e03-44e9-88bf-16a2f27e4678 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:46:49.059175 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:46:49.092161 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475df4f-2e03-44e9-88bf-16a2f27e4678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:46:49.094213 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475df4f-2e03-44e9-88bf-16a2f27e4678 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:46:49.112283 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 665/1331] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:46:48 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:46:51.368482 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56810ab1-0f5b-46e2-8398-a41c7f5cbe49 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:51.368968 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56810ab1-0f5b-46e2-8398-a41c7f5cbe49 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:51.369085 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56810ab1-0f5b-46e2-8398-a41c7f5cbe49 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:51.370487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 667/1332] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:46:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:46:51.375874 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b08775-b91f-4a11-a539-bbf5db7a4da5 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:51.376311 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b08775-b91f-4a11-a539-bbf5db7a4da5 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:51.376397 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b08775-b91f-4a11-a539-bbf5db7a4da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:51.441765 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-23b08775-b91f-4a11-a539-bbf5db7a4da5 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:46:51.442960 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-23b08775-b91f-4a11-a539-bbf5db7a4da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:46:51.536968 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 666/1333] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:46:51.572338 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56810ab1-0f5b-46e2-8398-a41c7f5cbe49 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:46:51.573928 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-56810ab1-0f5b-46e2-8398-a41c7f5cbe49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:46:51.644258 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:46:51.677540 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56810ab1-0f5b-46e2-8398-a41c7f5cbe49 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:46:51.750826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf588e5-56d4-40ab-97e5-8d4bdf29ed70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:46:51.751421 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf588e5-56d4-40ab-97e5-8d4bdf29ed70 service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:51.751699 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf588e5-56d4-40ab-97e5-8d4bdf29ed70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:51.751965 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf588e5-56d4-40ab-97e5-8d4bdf29ed70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:51.753834 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-1cf588e5-56d4-40ab-97e5-8d4bdf29ed70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:46:51.858742 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf588e5-56d4-40ab-97e5-8d4bdf29ed70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:46:51.860155 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf588e5-56d4-40ab-97e5-8d4bdf29ed70 service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:46:51.869856 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:46:51.878980 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 668/1334] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:46:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:46:53.903397 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b1fd1-02f6-494a-bcbb-0ca7c2a227f9 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:53.903917 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b1fd1-02f6-494a-bcbb-0ca7c2a227f9 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:53.903917 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b1fd1-02f6-494a-bcbb-0ca7c2a227f9 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:53.905272 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 667/1335] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:46:53.910896 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cb0fa-1e95-40fc-9eb5-32e5a76d0b5e None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:53.911271 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cb0fa-1e95-40fc-9eb5-32e5a76d0b5e None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:53.911437 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cb0fa-1e95-40fc-9eb5-32e5a76d0b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:53.975441 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-b77cb0fa-1e95-40fc-9eb5-32e5a76d0b5e None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:46:53.976631 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-b77cb0fa-1e95-40fc-9eb5-32e5a76d0b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:46:54.080408 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 669/1336] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:46:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:46:54.120521 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b1fd1-02f6-494a-bcbb-0ca7c2a227f9 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:46:54.122100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-247b1fd1-02f6-494a-bcbb-0ca7c2a227f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:46:54.161607 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:46:54.224404 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b1fd1-02f6-494a-bcbb-0ca7c2a227f9 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:46:54.300835 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aff408-3d96-43e2-b4b5-fb03f66142e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:46:54.301460 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aff408-3d96-43e2-b4b5-fb03f66142e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:54.301738 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aff408-3d96-43e2-b4b5-fb03f66142e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:54.302007 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aff408-3d96-43e2-b4b5-fb03f66142e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:54.303605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-97aff408-3d96-43e2-b4b5-fb03f66142e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:46:54.387007 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:46:54.413457 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aff408-3d96-43e2-b4b5-fb03f66142e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:46:54.414829 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aff408-3d96-43e2-b4b5-fb03f66142e0 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:46:54.432475 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 668/1337] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:46:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:46:56.786224 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147482b-064b-4585-aa2e-2d20ae218c1a None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:56.786789 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147482b-064b-4585-aa2e-2d20ae218c1a None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:56.786789 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2147482b-064b-4585-aa2e-2d20ae218c1a None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:56.788149 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 670/1338] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:46:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:46:56.793463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f430a-17de-479a-b8b2-37998ff423ac None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:56.793872 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f430a-17de-479a-b8b2-37998ff423ac None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:56.794022 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f430a-17de-479a-b8b2-37998ff423ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:56.859763 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-ea0f430a-17de-479a-b8b2-37998ff423ac None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:46:56.860974 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-ea0f430a-17de-479a-b8b2-37998ff423ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:46:56.960836 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 669/1339] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:46:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:46:56.997816 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147482b-064b-4585-aa2e-2d20ae218c1a None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:46:56.999397 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-2147482b-064b-4585-aa2e-2d20ae218c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:46:57.079492 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:46:57.106679 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2147482b-064b-4585-aa2e-2d20ae218c1a None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:46:57.177819 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abd744-ad95-4d39-bd81-0aa616fdec1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:46:57.178411 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abd744-ad95-4d39-bd81-0aa616fdec1b service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:46:57.178682 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abd744-ad95-4d39-bd81-0aa616fdec1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:46:57.178946 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abd744-ad95-4d39-bd81-0aa616fdec1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:46:57.180517 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-c7abd744-ad95-4d39-bd81-0aa616fdec1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:46:57.287000 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abd744-ad95-4d39-bd81-0aa616fdec1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:46:57.288392 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abd744-ad95-4d39-bd81-0aa616fdec1b service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:46:57.305873 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 671/1340] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:46:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:47:01.297577 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd26b6-8994-40ba-b372-fc6ad3ef8798 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:01.298163 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd26b6-8994-40ba-b372-fc6ad3ef8798 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:01.298163 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd26b6-8994-40ba-b372-fc6ad3ef8798 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:01.299477 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 670/1341] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:47:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:47:01.304916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8c3a7-2953-41af-804a-929e5d9d3065 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:01.305371 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8c3a7-2953-41af-804a-929e5d9d3065 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:01.305501 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8c3a7-2953-41af-804a-929e5d9d3065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:01.311164 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:01.376174 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-c4c8c3a7-2953-41af-804a-929e5d9d3065 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:47:01.377305 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-c4c8c3a7-2953-41af-804a-929e5d9d3065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:01.471434 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 672/1342] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:47:01.510262 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd26b6-8994-40ba-b372-fc6ad3ef8798 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:47:01.511770 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-22dd26b6-8994-40ba-b372-fc6ad3ef8798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:01.559460 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:01.615279 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd26b6-8994-40ba-b372-fc6ad3ef8798 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:47:01.687512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c679f45-00b6-4a45-8c93-536bb0a97844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:47:01.688029 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c679f45-00b6-4a45-8c93-536bb0a97844 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:01.688306 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c679f45-00b6-4a45-8c93-536bb0a97844 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:01.688577 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c679f45-00b6-4a45-8c93-536bb0a97844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:01.690189 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-4c679f45-00b6-4a45-8c93-536bb0a97844 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:01.783563 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:01.800000 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c679f45-00b6-4a45-8c93-536bb0a97844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:47:01.801436 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c679f45-00b6-4a45-8c93-536bb0a97844 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:47:01.819574 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 671/1343] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:47:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:47:04.403969 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f7def-1f66-4e2e-b0d3-90ea8d00a703 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:04.404499 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f7def-1f66-4e2e-b0d3-90ea8d00a703 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:04.404499 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f7def-1f66-4e2e-b0d3-90ea8d00a703 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:04.406481 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 673/1344] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:47:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:47:04.412398 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e4262-239b-4d88-a6e2-601058199a96 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:04.412939 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e4262-239b-4d88-a6e2-601058199a96 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:04.412939 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e4262-239b-4d88-a6e2-601058199a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:04.503265 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-6e1e4262-239b-4d88-a6e2-601058199a96 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:47:04.504751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-6e1e4262-239b-4d88-a6e2-601058199a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:04.602677 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 672/1345] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:47:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:47:04.640016 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f7def-1f66-4e2e-b0d3-90ea8d00a703 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:47:04.641610 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a51f7def-1f66-4e2e-b0d3-90ea8d00a703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:04.728506 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:04.745833 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f7def-1f66-4e2e-b0d3-90ea8d00a703 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:47:04.824530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30338277-7469-49c8-beea-24343c7cae1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:47:04.825043 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30338277-7469-49c8-beea-24343c7cae1c service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:04.825334 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30338277-7469-49c8-beea-24343c7cae1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:04.825611 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30338277-7469-49c8-beea-24343c7cae1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:04.827183 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-30338277-7469-49c8-beea-24343c7cae1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:04.937610 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30338277-7469-49c8-beea-24343c7cae1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:47:04.939040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30338277-7469-49c8-beea-24343c7cae1c service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:47:04.957673 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 674/1346] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:47:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:47:09.029848 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef8986-ed6f-4882-8656-82e1785b49fc None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:09.030338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef8986-ed6f-4882-8656-82e1785b49fc None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:09.030448 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef8986-ed6f-4882-8656-82e1785b49fc None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:09.031782 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 673/1347] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:47:09.036883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf3141-8001-4de9-b053-f28e333a7c14 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:09.037357 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf3141-8001-4de9-b053-f28e333a7c14 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:09.037455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf3141-8001-4de9-b053-f28e333a7c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:09.054705 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:09.116121 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-3bdf3141-8001-4de9-b053-f28e333a7c14 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:47:09.116121 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-3bdf3141-8001-4de9-b053-f28e333a7c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:09.231014 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 675/1348] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:47:09.270494 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef8986-ed6f-4882-8656-82e1785b49fc None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:47:09.272563 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-6fef8986-ed6f-4882-8656-82e1785b49fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:09.347533 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:09.398523 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef8986-ed6f-4882-8656-82e1785b49fc None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:47:09.482436 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b2d2d-18c5-48bf-b124-08691659d27e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:47:09.483067 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b2d2d-18c5-48bf-b124-08691659d27e service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:09.483342 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b2d2d-18c5-48bf-b124-08691659d27e service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:09.484291 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b2d2d-18c5-48bf-b124-08691659d27e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:09.485984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-102b2d2d-18c5-48bf-b124-08691659d27e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:09.603376 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:09.607244 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b2d2d-18c5-48bf-b124-08691659d27e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:47:09.609719 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b2d2d-18c5-48bf-b124-08691659d27e service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:47:09.630871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 674/1349] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:47:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:47:14.610311 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b92403-ef8c-45de-b42f-15b52a45c361 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:14.610820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b92403-ef8c-45de-b42f-15b52a45c361 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:14.610899 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b92403-ef8c-45de-b42f-15b52a45c361 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:14.612214 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 676/1350] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 7 10:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:47:14.631991 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653694a3-3e5f-4d79-9490-fc3c5a7b0533 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:14.632517 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653694a3-3e5f-4d79-9490-fc3c5a7b0533 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:14.632517 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653694a3-3e5f-4d79-9490-fc3c5a7b0533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:14.725432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-653694a3-3e5f-4d79-9490-fc3c5a7b0533 None None] MFA Rules not processed for user `b33f797a9af946a4b296d973388891be`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:47:14.726546 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-653694a3-3e5f-4d79-9490-fc3c5a7b0533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:14.858590 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 675/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 7 10:47:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:47:18.846793 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800ee52-4549-4887-8f57-eb0536e559c0 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:18.847336 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800ee52-4549-4887-8f57-eb0536e559c0 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:18.847336 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800ee52-4549-4887-8f57-eb0536e559c0 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:18.848854 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 677/1352] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 7 10:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:47:18.853613 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ac2ad-e86b-41f2-adde-3d788427a272 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:18.854041 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ac2ad-e86b-41f2-adde-3d788427a272 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:18.854858 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ac2ad-e86b-41f2-adde-3d788427a272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:18.913962 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:18.939158 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-726ac2ad-e86b-41f2-adde-3d788427a272 None None] MFA Rules not processed for user `b33f797a9af946a4b296d973388891be`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:47:18.940342 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-726ac2ad-e86b-41f2-adde-3d788427a272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:19.059112 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 676/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 7 10:47:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:47:19.229089 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=59 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:20.586499 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b930f6-6baf-4535-8686-72b1058e20dc None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:20.587128 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b930f6-6baf-4535-8686-72b1058e20dc None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:20.587128 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b930f6-6baf-4535-8686-72b1058e20dc None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:20.588524 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 678/1354] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 7 10:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:47:20.593916 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b5177-0c4c-4b2c-a8b9-534ed3cf8f27 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:20.594315 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b5177-0c4c-4b2c-a8b9-534ed3cf8f27 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:20.594576 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b5177-0c4c-4b2c-a8b9-534ed3cf8f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:20.671649 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-a07b5177-0c4c-4b2c-a8b9-534ed3cf8f27 None None] MFA Rules not processed for user `b33f797a9af946a4b296d973388891be`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:47:20.672833 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-a07b5177-0c4c-4b2c-a8b9-534ed3cf8f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:20.714834 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:20.780884 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 677/1355] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 7 10:47:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:47:24.134010 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bddaaa-0511-452b-a36e-f6032c9d7d64 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:24.134521 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bddaaa-0511-452b-a36e-f6032c9d7d64 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:24.134521 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bddaaa-0511-452b-a36e-f6032c9d7d64 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:24.136018 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 679/1356] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:47:24.142003 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0646173-91b2-4574-992e-e5be0fb2f4ed None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:24.142862 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0646173-91b2-4574-992e-e5be0fb2f4ed None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:24.143332 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0646173-91b2-4574-992e-e5be0fb2f4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:24.231398 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-c0646173-91b2-4574-992e-e5be0fb2f4ed None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:47:24.233011 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-c0646173-91b2-4574-992e-e5be0fb2f4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:24.335409 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 678/1357] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:47:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:47:24.393681 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab886bb-b0c7-4036-8ebb-60aa4f3992d1 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:24.394593 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab886bb-b0c7-4036-8ebb-60aa4f3992d1 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:24.395077 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab886bb-b0c7-4036-8ebb-60aa4f3992d1 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:24.396884 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 680/1358] 10.222.0.27 () {54 vars in 962 bytes} [Sun Aug 7 10:47:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:47:24.406606 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a44d66-1ef0-4efa-a924-0c38e16979c8 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:24.407202 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a44d66-1ef0-4efa-a924-0c38e16979c8 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:24.407202 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a44d66-1ef0-4efa-a924-0c38e16979c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:24.425344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:24.494547 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-d5a44d66-1ef0-4efa-a924-0c38e16979c8 None None] MFA Rules not processed for user `f98cb7abbb8942cebb71aa98da80a05a`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:47:24.495744 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-d5a44d66-1ef0-4efa-a924-0c38e16979c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:24.626477 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab886bb-b0c7-4036-8ebb-60aa4f3992d1 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:47:24.627984 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-2ab886bb-b0c7-4036-8ebb-60aa4f3992d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:24.637951 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 679/1359] 10.222.0.27 () {58 vars in 1059 bytes} [Sun Aug 7 10:47:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:47:24.781234 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab886bb-b0c7-4036-8ebb-60aa4f3992d1 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:47:24.860444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:24.909689 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07aaa3-0bc8-48fe-a706-abbd1b7c7596 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:47:24.910201 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07aaa3-0bc8-48fe-a706-abbd1b7c7596 service nova] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:24.910473 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07aaa3-0bc8-48fe-a706-abbd1b7c7596 service nova] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:24.910737 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07aaa3-0bc8-48fe-a706-abbd1b7c7596 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:24.912308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-cf07aaa3-0bc8-48fe-a706-abbd1b7c7596 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:25.004994 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07aaa3-0bc8-48fe-a706-abbd1b7c7596 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:47:25.006592 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07aaa3-0bc8-48fe-a706-abbd1b7c7596 service nova] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:47:25.026111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 681/1360] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:47:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 10:47:27.263795 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab56862-5974-4760-b2ba-94c0ee92dea9 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:27.264876 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab56862-5974-4760-b2ba-94c0ee92dea9 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:27.264876 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab56862-5974-4760-b2ba-94c0ee92dea9 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:27.266412 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 680/1361] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:47:27.271390 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f628b6b-9ec6-43bf-8340-0b97697ec1fb None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:27.271849 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f628b6b-9ec6-43bf-8340-0b97697ec1fb None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:27.271934 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f628b6b-9ec6-43bf-8340-0b97697ec1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:27.343175 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-4f628b6b-9ec6-43bf-8340-0b97697ec1fb None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:47:27.344399 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-4f628b6b-9ec6-43bf-8340-0b97697ec1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:27.392220 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:27.473893 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 682/1362] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:47:27.508965 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab56862-5974-4760-b2ba-94c0ee92dea9 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:47:27.510622 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-6ab56862-5974-4760-b2ba-94c0ee92dea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:27.584427 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:27.700974 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab56862-5974-4760-b2ba-94c0ee92dea9 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:47:27.826175 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735053d-9b38-4779-b573-3ab7830e2d5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:47:27.826804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735053d-9b38-4779-b573-3ab7830e2d5b service nova] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:27.827082 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735053d-9b38-4779-b573-3ab7830e2d5b service nova] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:27.827352 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735053d-9b38-4779-b573-3ab7830e2d5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:27.828949 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-8735053d-9b38-4779-b573-3ab7830e2d5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:27.853303 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:27.924777 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735053d-9b38-4779-b573-3ab7830e2d5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:47:27.926379 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735053d-9b38-4779-b573-3ab7830e2d5b service nova] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:47:27.945721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 681/1363] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:47:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:47:30.301503 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f50ba6-3aa0-4609-8079-e786508be8e3 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:30.302053 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f50ba6-3aa0-4609-8079-e786508be8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:30.302053 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f50ba6-3aa0-4609-8079-e786508be8e3 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:30.303419 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 683/1364] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:47:30.308694 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba5a64-3a29-4e18-b9a4-8909969df597 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:30.309589 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba5a64-3a29-4e18-b9a4-8909969df597 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:30.310093 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba5a64-3a29-4e18-b9a4-8909969df597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:30.400465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-a4ba5a64-3a29-4e18-b9a4-8909969df597 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:47:30.401715 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-a4ba5a64-3a29-4e18-b9a4-8909969df597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:30.503391 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:30.506884 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 682/1365] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:47:30.555035 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565d4e1-d5b6-45a0-911c-12f7235e7571 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:30.555556 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565d4e1-d5b6-45a0-911c-12f7235e7571 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:30.555900 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565d4e1-d5b6-45a0-911c-12f7235e7571 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:30.557732 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 684/1366] 10.222.0.27 () {54 vars in 962 bytes} [Sun Aug 7 10:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:47:30.562757 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e73ef8-a27c-46fd-bdb8-a2b6202c59e1 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:30.563042 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e73ef8-a27c-46fd-bdb8-a2b6202c59e1 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:30.563316 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e73ef8-a27c-46fd-bdb8-a2b6202c59e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:30.642716 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-56e73ef8-a27c-46fd-bdb8-a2b6202c59e1 None None] MFA Rules not processed for user `f98cb7abbb8942cebb71aa98da80a05a`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:47:30.643924 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-56e73ef8-a27c-46fd-bdb8-a2b6202c59e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:30.792139 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 683/1367] 10.222.0.27 () {58 vars in 1059 bytes} [Sun Aug 7 10:47:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:47:30.800716 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565d4e1-d5b6-45a0-911c-12f7235e7571 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:47:30.802331 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-c565d4e1-d5b6-45a0-911c-12f7235e7571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:30.962741 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565d4e1-d5b6-45a0-911c-12f7235e7571 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:47:30.993652 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:31.094860 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218d728-38b6-4a67-ba8a-3486afb8b905 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:47:31.095464 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218d728-38b6-4a67-ba8a-3486afb8b905 service nova] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:31.095739 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218d728-38b6-4a67-ba8a-3486afb8b905 service nova] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:31.096004 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218d728-38b6-4a67-ba8a-3486afb8b905 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:31.097624 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-4218d728-38b6-4a67-ba8a-3486afb8b905 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:31.197497 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218d728-38b6-4a67-ba8a-3486afb8b905 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:47:31.198960 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218d728-38b6-4a67-ba8a-3486afb8b905 service nova] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:47:31.218265 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 685/1368] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:47:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:47:32.247549 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7ed2c-9b74-4912-9b88-d3a658f37f5f None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:32.248093 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7ed2c-9b74-4912-9b88-d3a658f37f5f None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:32.248093 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7ed2c-9b74-4912-9b88-d3a658f37f5f None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:32.250157 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 684/1369] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:47:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:47:32.255409 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3396a31-1de7-4eaa-9073-7e1309c54e77 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:32.255819 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3396a31-1de7-4eaa-9073-7e1309c54e77 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:32.256001 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3396a31-1de7-4eaa-9073-7e1309c54e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:32.289797 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:32.330982 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-c3396a31-1de7-4eaa-9073-7e1309c54e77 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:47:32.332376 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-c3396a31-1de7-4eaa-9073-7e1309c54e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:32.444418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 686/1370] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:47:32.790556 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758364b3-7963-406f-a88e-9bef4410e0c4 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:32.790845 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758364b3-7963-406f-a88e-9bef4410e0c4 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:32.791120 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758364b3-7963-406f-a88e-9bef4410e0c4 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:32.793019 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 685/1371] 10.222.0.27 () {54 vars in 964 bytes} [Sun Aug 7 10:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:47:32.797787 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae60f90-9f50-4894-ac11-f7c94c978431 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:32.798108 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae60f90-9f50-4894-ac11-f7c94c978431 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:32.798526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae60f90-9f50-4894-ac11-f7c94c978431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:32.879813 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-cae60f90-9f50-4894-ac11-f7c94c978431 None None] MFA Rules not processed for user `c5fca18c4ee74043a5acc9aeb297c9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:47:32.881025 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-cae60f90-9f50-4894-ac11-f7c94c978431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:32.929891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:32.961354 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 687/1372] 10.222.0.27 () {58 vars in 1061 bytes} [Sun Aug 7 10:47:32 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:47:32.969266 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758364b3-7963-406f-a88e-9bef4410e0c4 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:47:32.970886 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-758364b3-7963-406f-a88e-9bef4410e0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:33.028957 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:33.085466 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758364b3-7963-406f-a88e-9bef4410e0c4 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:47:33.163121 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b25011-fd24-4e75-868c-f132a6d3980c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:47:33.163727 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b25011-fd24-4e75-868c-f132a6d3980c service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:33.164006 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b25011-fd24-4e75-868c-f132a6d3980c service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:33.164276 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b25011-fd24-4e75-868c-f132a6d3980c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:33.165903 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-e0b25011-fd24-4e75-868c-f132a6d3980c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:33.276772 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:33.292039 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b25011-fd24-4e75-868c-f132a6d3980c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:47:33.293529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b25011-fd24-4e75-868c-f132a6d3980c service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:47:33.302885 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9474d-4e80-42b4-a74d-83e0f4973191 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:33.303421 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9474d-4e80-42b4-a74d-83e0f4973191 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:33.303421 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9474d-4e80-42b4-a74d-83e0f4973191 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:33.305628 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 688/1373] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:47:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 10:47:33.309800 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060c1fa-cf6e-484f-8fff-9e78ef5f396e None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:33.310083 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060c1fa-cf6e-484f-8fff-9e78ef5f396e None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:33.310354 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060c1fa-cf6e-484f-8fff-9e78ef5f396e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:33.314531 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 686/1374] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:47:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:47:33.379505 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-c060c1fa-cf6e-484f-8fff-9e78ef5f396e None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:47:33.380725 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-c060c1fa-cf6e-484f-8fff-9e78ef5f396e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:33.491043 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 689/1375] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:47:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:47:33.536738 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b25011-fd24-4e75-868c-f132a6d3980c service cinder] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:47:33.537914 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-e0b25011-fd24-4e75-868c-f132a6d3980c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:33.647468 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b25011-fd24-4e75-868c-f132a6d3980c service cinder] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:47:33.756734 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:33.770675 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca188d-0ea7-47a5-8b68-36974f29923e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:47:33.771281 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca188d-0ea7-47a5-8b68-36974f29923e service nova] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:33.771561 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca188d-0ea7-47a5-8b68-36974f29923e service nova] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:33.771834 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca188d-0ea7-47a5-8b68-36974f29923e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:33.773465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-7cca188d-0ea7-47a5-8b68-36974f29923e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:33.861723 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca188d-0ea7-47a5-8b68-36974f29923e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:47:33.863311 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca188d-0ea7-47a5-8b68-36974f29923e service nova] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:47:33.881710 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 687/1376] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:47:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:47:35.942184 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2b6ed-8973-419b-9812-3d47510d9ffd None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:35.942727 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2b6ed-8973-419b-9812-3d47510d9ffd None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:35.943113 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2b6ed-8973-419b-9812-3d47510d9ffd None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:35.945775 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 690/1377] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:47:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:47:35.953363 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a195b0-31f4-44c7-b807-1052efd21670 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:35.953837 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a195b0-31f4-44c7-b807-1052efd21670 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:35.953952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a195b0-31f4-44c7-b807-1052efd21670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:36.021880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-f2a195b0-31f4-44c7-b807-1052efd21670 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:47:36.022998 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-f2a195b0-31f4-44c7-b807-1052efd21670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:36.081560 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:36.145633 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 688/1378] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:47:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:47:36.181863 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2b6ed-8973-419b-9812-3d47510d9ffd None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:47:36.183377 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ecf2b6ed-8973-419b-9812-3d47510d9ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:36.237018 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:36.343031 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2b6ed-8973-419b-9812-3d47510d9ffd None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:47:36.476645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4758885-4421-42c2-90e0-4435294447c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:47:36.477165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4758885-4421-42c2-90e0-4435294447c1 service nova] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:36.477475 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4758885-4421-42c2-90e0-4435294447c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:36.477742 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4758885-4421-42c2-90e0-4435294447c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:36.479343 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-b4758885-4421-42c2-90e0-4435294447c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:36.490919 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:36.568445 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4758885-4421-42c2-90e0-4435294447c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:47:36.570189 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4758885-4421-42c2-90e0-4435294447c1 service nova] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:47:36.589399 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 691/1379] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:47:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:47:38.652433 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c68e0-3ce4-48c0-a1dd-4c124247e003 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:38.652986 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c68e0-3ce4-48c0-a1dd-4c124247e003 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:38.652986 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c68e0-3ce4-48c0-a1dd-4c124247e003 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:38.654568 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 689/1380] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:47:38.659688 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19f08a-72fe-42dc-8139-21080c35180b None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:38.660119 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19f08a-72fe-42dc-8139-21080c35180b None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:38.660213 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19f08a-72fe-42dc-8139-21080c35180b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:38.730546 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-ae19f08a-72fe-42dc-8139-21080c35180b None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:47:38.731744 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ae19f08a-72fe-42dc-8139-21080c35180b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:38.825405 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:38.845353 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 692/1381] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:47:38.887181 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c68e0-3ce4-48c0-a1dd-4c124247e003 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:47:38.888764 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-532c68e0-3ce4-48c0-a1dd-4c124247e003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:39.048799 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c68e0-3ce4-48c0-a1dd-4c124247e003 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:47:39.101551 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:39.183154 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab718e8-0835-4038-9469-9d75e7c8de1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:47:39.183960 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab718e8-0835-4038-9469-9d75e7c8de1d service nova] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:39.183960 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab718e8-0835-4038-9469-9d75e7c8de1d service nova] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:39.183960 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab718e8-0835-4038-9469-9d75e7c8de1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:39.186804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-7ab718e8-0835-4038-9469-9d75e7c8de1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:39.288521 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab718e8-0835-4038-9469-9d75e7c8de1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:47:39.290148 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab718e8-0835-4038-9469-9d75e7c8de1d service nova] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:47:39.309350 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 690/1382] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:47:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:47:41.356761 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037a5f8-ca73-4f84-a60a-f92463086117 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:41.357861 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037a5f8-ca73-4f84-a60a-f92463086117 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:41.357861 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037a5f8-ca73-4f84-a60a-f92463086117 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:41.359236 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 693/1383] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:47:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:47:41.367226 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dc7e5-c7ed-4690-873b-706fc3bb9ee5 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:41.367666 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dc7e5-c7ed-4690-873b-706fc3bb9ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:41.368030 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dc7e5-c7ed-4690-873b-706fc3bb9ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:41.457393 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-439dc7e5-c7ed-4690-873b-706fc3bb9ee5 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:47:41.458610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-439dc7e5-c7ed-4690-873b-706fc3bb9ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:41.460616 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:41.568317 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 691/1384] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:47:41.610965 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037a5f8-ca73-4f84-a60a-f92463086117 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:47:41.612900 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-2037a5f8-ca73-4f84-a60a-f92463086117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:41.796102 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037a5f8-ca73-4f84-a60a-f92463086117 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:47:41.869790 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:41.921859 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b028484-5a33-4945-ac27-2f4b707ed79c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:47:41.922462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b028484-5a33-4945-ac27-2f4b707ed79c service nova] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:41.922738 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b028484-5a33-4945-ac27-2f4b707ed79c service nova] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:41.923006 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b028484-5a33-4945-ac27-2f4b707ed79c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:41.924611 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-8b028484-5a33-4945-ac27-2f4b707ed79c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:42.014922 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b028484-5a33-4945-ac27-2f4b707ed79c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:47:42.016526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b028484-5a33-4945-ac27-2f4b707ed79c service nova] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:47:42.034988 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 694/1385] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:47:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:47:44.111712 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca84871-1869-4224-8f73-23b2325a38f7 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:44.112366 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca84871-1869-4224-8f73-23b2325a38f7 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:44.112366 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca84871-1869-4224-8f73-23b2325a38f7 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:44.113732 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 692/1386] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:47:44.118909 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b9b66-f354-49b8-b582-6e513322307c None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:44.119388 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b9b66-f354-49b8-b582-6e513322307c None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:44.119572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b9b66-f354-49b8-b582-6e513322307c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:44.186207 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-a90b9b66-f354-49b8-b582-6e513322307c None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:47:44.187417 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a90b9b66-f354-49b8-b582-6e513322307c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:44.213010 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:44.285833 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 695/1387] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:47:44.345435 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca84871-1869-4224-8f73-23b2325a38f7 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:47:44.347139 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-2ca84871-1869-4224-8f73-23b2325a38f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:44.487855 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:44.506263 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca84871-1869-4224-8f73-23b2325a38f7 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:47:44.635983 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386b2be-0b4c-41e6-b2d5-f2327ac42b52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:47:44.636609 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386b2be-0b4c-41e6-b2d5-f2327ac42b52 service nova] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:44.636895 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386b2be-0b4c-41e6-b2d5-f2327ac42b52 service nova] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:44.637174 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386b2be-0b4c-41e6-b2d5-f2327ac42b52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:44.639509 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-a386b2be-0b4c-41e6-b2d5-f2327ac42b52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:44.738200 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386b2be-0b4c-41e6-b2d5-f2327ac42b52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:47:44.739819 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386b2be-0b4c-41e6-b2d5-f2327ac42b52 service nova] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:47:44.744800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:44.760120 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 693/1388] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:47:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:47:46.832359 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbce053-fbe8-4ae0-969f-245e9cae18b3 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:46.832901 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbce053-fbe8-4ae0-969f-245e9cae18b3 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:46.832901 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbce053-fbe8-4ae0-969f-245e9cae18b3 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:46.834275 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 696/1389] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:47:46.839405 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542c5de-e153-4660-a511-abc53e520bff None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:46.839858 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542c5de-e153-4660-a511-abc53e520bff None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:46.839954 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542c5de-e153-4660-a511-abc53e520bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:46.906317 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-0542c5de-e153-4660-a511-abc53e520bff None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:47:46.907527 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-0542c5de-e153-4660-a511-abc53e520bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:47.006993 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 694/1390] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:47:47.051238 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbce053-fbe8-4ae0-969f-245e9cae18b3 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:47:47.052753 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-4dbce053-fbe8-4ae0-969f-245e9cae18b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:47.203090 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbce053-fbe8-4ae0-969f-245e9cae18b3 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:47:47.212108 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:47.313270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e6799-bd22-41ae-8b0f-c28edded203c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:47:47.313892 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e6799-bd22-41ae-8b0f-c28edded203c service nova] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:47.314166 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e6799-bd22-41ae-8b0f-c28edded203c service nova] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:47.314432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e6799-bd22-41ae-8b0f-c28edded203c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:47.316018 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-172e6799-bd22-41ae-8b0f-c28edded203c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:47.408380 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e6799-bd22-41ae-8b0f-c28edded203c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:47:47.410005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e6799-bd22-41ae-8b0f-c28edded203c service nova] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:47:47.427690 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 697/1391] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:47:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:47:48.382780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb2edb-6d5e-4983-bb10-332208a7be27 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:48.383310 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb2edb-6d5e-4983-bb10-332208a7be27 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:48.383310 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb2edb-6d5e-4983-bb10-332208a7be27 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:48.384871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 695/1392] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:47:48.390294 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e093bf-6b0d-48c4-b99c-9facf92fe327 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:48.390698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e093bf-6b0d-48c4-b99c-9facf92fe327 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:48.390833 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e093bf-6b0d-48c4-b99c-9facf92fe327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:48.406720 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:48.458202 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-c1e093bf-6b0d-48c4-b99c-9facf92fe327 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:47:48.459309 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-c1e093bf-6b0d-48c4-b99c-9facf92fe327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:48.555906 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 698/1393] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:47:48.611697 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deee430-1d39-4804-980a-b155294bec24 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:48.611978 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deee430-1d39-4804-980a-b155294bec24 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:48.612246 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deee430-1d39-4804-980a-b155294bec24 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:48.613618 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 696/1394] 10.222.0.27 () {54 vars in 966 bytes} [Sun Aug 7 10:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:47:48.618631 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b577bff-197f-4b1d-83e0-b883f9ab1b06 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:48.619104 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b577bff-197f-4b1d-83e0-b883f9ab1b06 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:48.619494 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b577bff-197f-4b1d-83e0-b883f9ab1b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:48.696996 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-8b577bff-197f-4b1d-83e0-b883f9ab1b06 None None] MFA Rules not processed for user `a462a891b30847c0aeadbd697652011a`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:47:48.698222 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-8b577bff-197f-4b1d-83e0-b883f9ab1b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:48.732960 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:48.773967 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 699/1395] 10.222.0.27 () {58 vars in 1063 bytes} [Sun Aug 7 10:47:48 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:47:48.782021 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deee430-1d39-4804-980a-b155294bec24 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:47:48.783508 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-9deee430-1d39-4804-980a-b155294bec24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:48.855724 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:48.887185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deee430-1d39-4804-980a-b155294bec24 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:47:48.959869 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fd216-00fb-4feb-b747-9e9fad7fa266 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a462a891b30847c0aeadbd697652011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:47:48.960467 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fd216-00fb-4feb-b747-9e9fad7fa266 service glance] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:48.960742 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fd216-00fb-4feb-b747-9e9fad7fa266 service glance] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:48.961011 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fd216-00fb-4feb-b747-9e9fad7fa266 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:48.962633 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-a31fd216-00fb-4feb-b747-9e9fad7fa266 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:49.072321 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31fd216-00fb-4feb-b747-9e9fad7fa266 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:47:49.073712 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31fd216-00fb-4feb-b747-9e9fad7fa266 service glance] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:47:49.089282 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:49.093139 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 697/1396] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:47:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:47:49.470551 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7381195-628b-4d7f-9ef8-991457950d07 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:49.471084 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7381195-628b-4d7f-9ef8-991457950d07 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:49.471084 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7381195-628b-4d7f-9ef8-991457950d07 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:49.472601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 700/1397] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:47:49.478084 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6222a9-742e-468a-bcf5-3e8d5c7982f9 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:49.478501 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6222a9-742e-468a-bcf5-3e8d5c7982f9 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:49.478615 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6222a9-742e-468a-bcf5-3e8d5c7982f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:49.548463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-bb6222a9-742e-468a-bcf5-3e8d5c7982f9 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:47:49.549685 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-bb6222a9-742e-468a-bcf5-3e8d5c7982f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:49.650564 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 698/1398] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:47:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:47:49.696697 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7381195-628b-4d7f-9ef8-991457950d07 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:47:49.698275 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-d7381195-628b-4d7f-9ef8-991457950d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:49.823779 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09905c93-4d1a-43ec-a2d2-02f7fbe5f341 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:49.824064 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09905c93-4d1a-43ec-a2d2-02f7fbe5f341 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:49.824334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09905c93-4d1a-43ec-a2d2-02f7fbe5f341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:49.854149 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7381195-628b-4d7f-9ef8-991457950d07 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:47:49.890989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-09905c93-4d1a-43ec-a2d2-02f7fbe5f341 None None] MFA Rules not processed for user `e7eebb4bd7e04ff8bc4304a40cf6ba35`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:47:49.892186 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-09905c93-4d1a-43ec-a2d2-02f7fbe5f341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:49.894451 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:49.922432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:49.969436 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f66d4-b31c-4971-a55c-a4f163eff3f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:47:49.970036 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f66d4-b31c-4971-a55c-a4f163eff3f6 service nova] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:49.970424 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f66d4-b31c-4971-a55c-a4f163eff3f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:49.970696 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f66d4-b31c-4971-a55c-a4f163eff3f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:49.972280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-f44f66d4-b31c-4971-a55c-a4f163eff3f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:49.983697 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 699/1399] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 7 10:47:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:47:50.027961 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92458baf-0fc5-40e3-b62a-7dd4fb024b36 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:50.028285 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92458baf-0fc5-40e3-b62a-7dd4fb024b36 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:50.028566 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92458baf-0fc5-40e3-b62a-7dd4fb024b36 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:50.029944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 700/1400] 10.222.0.27 () {54 vars in 943 bytes} [Sun Aug 7 10:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 10:47:50.036400 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a2c7d-e3a1-417a-b339-e16ec97f50e0 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:50.036780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a2c7d-e3a1-417a-b339-e16ec97f50e0 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:50.037137 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a2c7d-e3a1-417a-b339-e16ec97f50e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:50.068589 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f66d4-b31c-4971-a55c-a4f163eff3f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:47:50.070256 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f66d4-b31c-4971-a55c-a4f163eff3f6 service nova] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:47:50.088526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 701/1401] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:47:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 10:47:50.113981 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-d00a2c7d-e3a1-417a-b339-e16ec97f50e0 None None] MFA Rules not processed for user `a7181e5118c547a3a31d2e080c25ff01`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:47:50.115286 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-d00a2c7d-e3a1-417a-b339-e16ec97f50e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:50.233076 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 701/1402] 10.222.0.27 () {58 vars in 1040 bytes} [Sun Aug 7 10:47:50 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:47:50.243011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f66d4-b31c-4971-a55c-a4f163eff3f6 service nova] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:47:50.244237 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-f44f66d4-b31c-4971-a55c-a4f163eff3f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:50.292517 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:50.345100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f66d4-b31c-4971-a55c-a4f163eff3f6 service nova] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:47:50.451102 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d762a8a-7abf-44b1-a14b-3c9ad46ad748 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7181e5118c547a3a31d2e080c25ff01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:47:50.451629 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d762a8a-7abf-44b1-a14b-3c9ad46ad748 service swift] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:50.451907 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d762a8a-7abf-44b1-a14b-3c9ad46ad748 service swift] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:50.452177 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d762a8a-7abf-44b1-a14b-3c9ad46ad748 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:50.453855 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-0d762a8a-7abf-44b1-a14b-3c9ad46ad748 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:50.535153 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:50.540304 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d762a8a-7abf-44b1-a14b-3c9ad46ad748 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:47:50.541944 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d762a8a-7abf-44b1-a14b-3c9ad46ad748 service swift] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:47:50.550087 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 702/1403] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 7 10:47:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 10:47:52.154307 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e76075-69e1-4d88-85e2-3af9ad91e138 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:52.154918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e76075-69e1-4d88-85e2-3af9ad91e138 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:52.155155 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e76075-69e1-4d88-85e2-3af9ad91e138 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:52.156772 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 702/1404] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:47:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:47:52.162180 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c419fe-2c56-4723-827e-71b80003f024 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:52.162719 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c419fe-2c56-4723-827e-71b80003f024 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:52.162877 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c419fe-2c56-4723-827e-71b80003f024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:52.230389 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-84c419fe-2c56-4723-827e-71b80003f024 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:47:52.232129 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-84c419fe-2c56-4723-827e-71b80003f024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:52.339324 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 703/1405] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:47:52.387300 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e76075-69e1-4d88-85e2-3af9ad91e138 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:47:52.388871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-f4e76075-69e1-4d88-85e2-3af9ad91e138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:52.391781 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:52.546705 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e76075-69e1-4d88-85e2-3af9ad91e138 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:47:52.634200 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:52.672846 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f973f-db1a-432e-bb2c-9c739709a084 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:47:52.673602 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f973f-db1a-432e-bb2c-9c739709a084 service nova] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:52.673878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f973f-db1a-432e-bb2c-9c739709a084 service nova] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:52.674147 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f973f-db1a-432e-bb2c-9c739709a084 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:52.675755 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-c51f973f-db1a-432e-bb2c-9c739709a084 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:52.776976 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f973f-db1a-432e-bb2c-9c739709a084 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:47:52.778972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f973f-db1a-432e-bb2c-9c739709a084 service nova] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:47:52.809639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 703/1406] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:47:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:47:54.877057 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f532cf-f83c-45e2-986a-e444893da6d8 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:54.877651 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f532cf-f83c-45e2-986a-e444893da6d8 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:54.878195 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f532cf-f83c-45e2-986a-e444893da6d8 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:54.879578 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 704/1407] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:47:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:47:54.884988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eaf269-4610-4c33-b4ae-8785c063729c None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:54.885478 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eaf269-4610-4c33-b4ae-8785c063729c None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:54.885812 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eaf269-4610-4c33-b4ae-8785c063729c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:54.959417 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-e8eaf269-4610-4c33-b4ae-8785c063729c None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:47:54.960730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-e8eaf269-4610-4c33-b4ae-8785c063729c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:55.003645 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:55.069535 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 704/1408] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:47:55.113189 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f532cf-f83c-45e2-986a-e444893da6d8 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:47:55.114904 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-49f532cf-f83c-45e2-986a-e444893da6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:55.202616 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:55.280041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f532cf-f83c-45e2-986a-e444893da6d8 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:47:55.414453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efbd572-a374-4817-8550-4d535e284525 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:47:55.414941 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efbd572-a374-4817-8550-4d535e284525 service nova] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:47:55.415223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efbd572-a374-4817-8550-4d535e284525 service nova] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:47:55.415495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efbd572-a374-4817-8550-4d535e284525 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:47:55.417115 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-1efbd572-a374-4817-8550-4d535e284525 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:47:55.458323 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:47:55.523718 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efbd572-a374-4817-8550-4d535e284525 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:47:55.525361 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efbd572-a374-4817-8550-4d535e284525 service nova] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:47:55.544915 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 705/1409] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:47:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:48:05.067538 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=26 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:05.541774 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=30 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:12.681896 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e7d85-e135-4f65-a093-a0a96ab78f8e None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:12.682428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e7d85-e135-4f65-a093-a0a96ab78f8e None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:12.682428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e7d85-e135-4f65-a093-a0a96ab78f8e None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:12.684310 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 705/1410] 10.222.0.27 () {54 vars in 918 bytes} [Sun Aug 7 10:48:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:48:12.689305 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e509a-2aee-4ccc-bb00-1b233be0198b None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:12.689765 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e509a-2aee-4ccc-bb00-1b233be0198b None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:12.689862 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e509a-2aee-4ccc-bb00-1b233be0198b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:12.764888 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-956e509a-2aee-4ccc-bb00-1b233be0198b None None] MFA Rules not processed for user `b33f797a9af946a4b296d973388891be`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:48:12.766174 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-956e509a-2aee-4ccc-bb00-1b233be0198b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:12.870324 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 706/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Sun Aug 7 10:48:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:48:12.885413 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087af395-3a65-49c5-a2a3-ae6c9740e3bf None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:12.885695 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087af395-3a65-49c5-a2a3-ae6c9740e3bf None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:12.885968 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087af395-3a65-49c5-a2a3-ae6c9740e3bf None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:12.887918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 706/1412] 10.222.0.27 () {54 vars in 918 bytes} [Sun Aug 7 10:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:48:12.892423 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d095a7-3537-42d1-97e5-ce827909ad20 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:12.892706 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d095a7-3537-42d1-97e5-ce827909ad20 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:12.892970 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d095a7-3537-42d1-97e5-ce827909ad20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:12.975798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:12.979356 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-38d095a7-3537-42d1-97e5-ce827909ad20 None None] MFA Rules not processed for user `f98cb7abbb8942cebb71aa98da80a05a`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:48:12.981223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-38d095a7-3537-42d1-97e5-ce827909ad20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:13.099051 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 707/1413] 10.222.0.27 () {58 vars in 1015 bytes} [Sun Aug 7 10:48:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:48:15.541076 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9968c6b-7fbf-432f-bc3e-b1b44dc7bc60 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:15.541625 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9968c6b-7fbf-432f-bc3e-b1b44dc7bc60 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:15.541625 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9968c6b-7fbf-432f-bc3e-b1b44dc7bc60 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:15.543045 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 10:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:48:15.548825 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8104a-d8d3-4403-8005-dd4addb2476c None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:15.549428 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8104a-d8d3-4403-8005-dd4addb2476c None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:15.549548 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8104a-d8d3-4403-8005-dd4addb2476c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:15.618123 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-8ef8104a-d8d3-4403-8005-dd4addb2476c None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:48:15.619335 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-8ef8104a-d8d3-4403-8005-dd4addb2476c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:15.673757 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:15.715381 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 10:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:48:15.757835 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9968c6b-7fbf-432f-bc3e-b1b44dc7bc60 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:48:15.759429 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-f9968c6b-7fbf-432f-bc3e-b1b44dc7bc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:15.901988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9968c6b-7fbf-432f-bc3e-b1b44dc7bc60 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:48:15.972482 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:16.012994 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908d5a9-ec14-4b71-9d34-479629b4e42d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:48:16.013619 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908d5a9-ec14-4b71-9d34-479629b4e42d service nova] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:16.013894 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908d5a9-ec14-4b71-9d34-479629b4e42d service nova] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:16.014163 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908d5a9-ec14-4b71-9d34-479629b4e42d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:16.015801 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-9908d5a9-ec14-4b71-9d34-479629b4e42d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:16.103073 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9908d5a9-ec14-4b71-9d34-479629b4e42d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:48:16.104651 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9908d5a9-ec14-4b71-9d34-479629b4e42d service nova] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:48:16.123251 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 708/1416] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:48:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:48:17.026845 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc32d08-c025-402d-8783-d10d9b9bc50e None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:17.027492 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc32d08-c025-402d-8783-d10d9b9bc50e None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:17.027492 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc32d08-c025-402d-8783-d10d9b9bc50e None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:17.028748 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 10:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:48:17.033876 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c9f23-01c3-4c85-952f-4baf140d31fc None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:17.034318 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c9f23-01c3-4c85-952f-4baf140d31fc None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:17.034416 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c9f23-01c3-4c85-952f-4baf140d31fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:17.109255 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-958c9f23-01c3-4c85-952f-4baf140d31fc None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:48:17.110477 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-958c9f23-01c3-4c85-952f-4baf140d31fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:17.137560 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:17.205899 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 10:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:48:17.357974 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc32d08-c025-402d-8783-d10d9b9bc50e None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:48:17.359512 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ffc32d08-c025-402d-8783-d10d9b9bc50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:17.501459 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc32d08-c025-402d-8783-d10d9b9bc50e None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:48:17.541178 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:17.613463 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac52bae-225c-482e-9ad7-6db99875dbe8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:48:17.614066 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac52bae-225c-482e-9ad7-6db99875dbe8 service nova] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:17.614342 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac52bae-225c-482e-9ad7-6db99875dbe8 service nova] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:17.614609 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac52bae-225c-482e-9ad7-6db99875dbe8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:17.616212 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-5ac52bae-225c-482e-9ad7-6db99875dbe8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:17.704896 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac52bae-225c-482e-9ad7-6db99875dbe8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:48:17.706520 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac52bae-225c-482e-9ad7-6db99875dbe8 service nova] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:48:17.725049 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 710/1419] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:48:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:48:18.601816 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a28611-03c8-4620-89f9-cc5082e4660f None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:18.602314 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a28611-03c8-4620-89f9-cc5082e4660f None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:18.602314 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a28611-03c8-4620-89f9-cc5082e4660f None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:18.603639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 10:48:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:48:18.608662 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ba363-25ca-4e1d-a712-6386ba86a30c None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:18.609101 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ba363-25ca-4e1d-a712-6386ba86a30c None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:18.609210 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ba363-25ca-4e1d-a712-6386ba86a30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:18.683639 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:18.708476 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-920ba363-25ca-4e1d-a712-6386ba86a30c None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:48:18.709707 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-920ba363-25ca-4e1d-a712-6386ba86a30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:18.806832 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 10:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:48:18.959748 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a28611-03c8-4620-89f9-cc5082e4660f None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:48:18.961307 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-c9a28611-03c8-4620-89f9-cc5082e4660f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:19.225709 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a28611-03c8-4620-89f9-cc5082e4660f None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:48:19.238199 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:19.338472 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c65717-29d6-4354-8197-d7b43c46c821 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:48:19.339695 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c65717-29d6-4354-8197-d7b43c46c821 service nova] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:19.339967 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c65717-29d6-4354-8197-d7b43c46c821 service nova] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:19.340226 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c65717-29d6-4354-8197-d7b43c46c821 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:19.341855 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-64c65717-29d6-4354-8197-d7b43c46c821 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:19.429722 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c65717-29d6-4354-8197-d7b43c46c821 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:48:19.431529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c65717-29d6-4354-8197-d7b43c46c821 service nova] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:48:19.450277 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 711/1422] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:48:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:48:20.301012 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc48567-2389-4bd8-b153-71dab987c5df None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:20.301536 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc48567-2389-4bd8-b153-71dab987c5df None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:20.301646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc48567-2389-4bd8-b153-71dab987c5df None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:20.302940 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 10:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:48:20.308665 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79767f-0aba-4f98-bd24-f34a867b4409 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:20.309081 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79767f-0aba-4f98-bd24-f34a867b4409 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:20.309231 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79767f-0aba-4f98-bd24-f34a867b4409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:20.330291 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:20.386445 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-bc79767f-0aba-4f98-bd24-f34a867b4409 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:48:20.387656 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-bc79767f-0aba-4f98-bd24-f34a867b4409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:20.481402 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 10:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:48:20.633677 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc48567-2389-4bd8-b153-71dab987c5df None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:48:20.635191 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-1dc48567-2389-4bd8-b153-71dab987c5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:20.742221 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:20.778592 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc48567-2389-4bd8-b153-71dab987c5df None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:48:20.888731 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f8b02-77f6-4fbf-aaeb-35b95c675891 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:48:20.889405 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f8b02-77f6-4fbf-aaeb-35b95c675891 service nova] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:20.889684 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f8b02-77f6-4fbf-aaeb-35b95c675891 service nova] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:20.889960 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f8b02-77f6-4fbf-aaeb-35b95c675891 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:20.891602 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-5b7f8b02-77f6-4fbf-aaeb-35b95c675891 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:20.967225 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:20.981605 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f8b02-77f6-4fbf-aaeb-35b95c675891 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:48:20.983192 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f8b02-77f6-4fbf-aaeb-35b95c675891 service nova] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:48:21.000847 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 713/1425] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:48:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:48:21.863425 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310413e1-fc85-426c-b927-248253618ec8 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:21.863982 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310413e1-fc85-426c-b927-248253618ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:21.863982 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310413e1-fc85-426c-b927-248253618ec8 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:21.865371 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 10:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:48:21.870210 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf42d88-7019-42f4-ab93-0a7e4f82d396 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:21.870642 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf42d88-7019-42f4-ab93-0a7e4f82d396 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:21.870746 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf42d88-7019-42f4-ab93-0a7e4f82d396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:21.945931 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-daf42d88-7019-42f4-ab93-0a7e4f82d396 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:48:21.947135 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-daf42d88-7019-42f4-ab93-0a7e4f82d396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:22.045345 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 10:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:48:22.193905 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310413e1-fc85-426c-b927-248253618ec8 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:48:22.195317 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-310413e1-fc85-426c-b927-248253618ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:22.280970 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:22.345482 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310413e1-fc85-426c-b927-248253618ec8 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:48:22.456874 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87ddf8-eff9-49a7-9a42-9781eb082a19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:48:22.457420 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87ddf8-eff9-49a7-9a42-9781eb082a19 service nova] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:22.457698 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87ddf8-eff9-49a7-9a42-9781eb082a19 service nova] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:22.457961 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87ddf8-eff9-49a7-9a42-9781eb082a19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:22.459544 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-ef87ddf8-eff9-49a7-9a42-9781eb082a19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:22.507081 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:22.548130 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87ddf8-eff9-49a7-9a42-9781eb082a19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:48:22.549742 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87ddf8-eff9-49a7-9a42-9781eb082a19 service nova] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:48:22.567225 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 714/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:48:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:48:23.362472 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4fba1-716a-4aba-b6a7-95d2696cfd0b None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:23.362913 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4fba1-716a-4aba-b6a7-95d2696cfd0b None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:23.363026 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4fba1-716a-4aba-b6a7-95d2696cfd0b None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:23.364346 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 10:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:48:23.369364 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691aa8d1-a4c2-442b-b469-93a4de5be666 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:23.369799 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691aa8d1-a4c2-442b-b469-93a4de5be666 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:23.369891 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691aa8d1-a4c2-442b-b469-93a4de5be666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:23.444280 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-691aa8d1-a4c2-442b-b469-93a4de5be666 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:48:23.445497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-691aa8d1-a4c2-442b-b469-93a4de5be666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:23.540051 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 10:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:48:23.690905 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4fba1-716a-4aba-b6a7-95d2696cfd0b None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:48:23.692422 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-d6d4fba1-716a-4aba-b6a7-95d2696cfd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:23.740083 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:23.833948 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4fba1-716a-4aba-b6a7-95d2696cfd0b None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:48:23.942660 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33856513-6b71-4d50-a259-32e8c10c88df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:48:23.943174 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33856513-6b71-4d50-a259-32e8c10c88df service nova] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:23.943445 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33856513-6b71-4d50-a259-32e8c10c88df service nova] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:23.943711 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33856513-6b71-4d50-a259-32e8c10c88df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:23.945279 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-33856513-6b71-4d50-a259-32e8c10c88df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:23.952780 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:24.050510 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33856513-6b71-4d50-a259-32e8c10c88df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:48:24.053169 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33856513-6b71-4d50-a259-32e8c10c88df service nova] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:48:24.071609 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 716/1431] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:48:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:48:24.869030 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96267f09-0d39-496f-b5f9-f5fe5ce383c2 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:24.869625 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96267f09-0d39-496f-b5f9-f5fe5ce383c2 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:24.869625 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96267f09-0d39-496f-b5f9-f5fe5ce383c2 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:24.870933 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 10:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:48:24.875764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597e71f-3e93-47a3-b40d-42e9afb55482 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:24.876209 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597e71f-3e93-47a3-b40d-42e9afb55482 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:24.876316 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597e71f-3e93-47a3-b40d-42e9afb55482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:25.072833 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-1597e71f-3e93-47a3-b40d-42e9afb55482 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:48:25.074640 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-1597e71f-3e93-47a3-b40d-42e9afb55482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:25.141905 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:25.170594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 10:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:48:25.319110 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96267f09-0d39-496f-b5f9-f5fe5ce383c2 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:48:25.320597 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-96267f09-0d39-496f-b5f9-f5fe5ce383c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:25.339396 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:25.469107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96267f09-0d39-496f-b5f9-f5fe5ce383c2 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:48:25.554191 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:25.581448 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554eb3d-9a30-4716-9481-41e8b53a0e0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:48:25.582042 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554eb3d-9a30-4716-9481-41e8b53a0e0a service nova] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:25.582314 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554eb3d-9a30-4716-9481-41e8b53a0e0a service nova] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:25.582581 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554eb3d-9a30-4716-9481-41e8b53a0e0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:25.584164 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-6554eb3d-9a30-4716-9481-41e8b53a0e0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:25.673206 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554eb3d-9a30-4716-9481-41e8b53a0e0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:48:25.674804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554eb3d-9a30-4716-9481-41e8b53a0e0a service nova] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:48:25.692882 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 717/1434] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:48:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:48:26.497113 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005a70b-4cde-4b8e-9b08-1c1e81e2121f None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:26.497650 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005a70b-4cde-4b8e-9b08-1c1e81e2121f None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:26.497650 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005a70b-4cde-4b8e-9b08-1c1e81e2121f None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:26.498937 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 10:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:48:26.504282 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82043ee3-1afc-4dfe-9ac5-90d4c3ebdb79 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:26.504718 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82043ee3-1afc-4dfe-9ac5-90d4c3ebdb79 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:26.504834 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82043ee3-1afc-4dfe-9ac5-90d4c3ebdb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:26.579138 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-82043ee3-1afc-4dfe-9ac5-90d4c3ebdb79 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:48:26.580322 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-82043ee3-1afc-4dfe-9ac5-90d4c3ebdb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:26.620512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:26.676316 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 10:48:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:48:26.829077 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005a70b-4cde-4b8e-9b08-1c1e81e2121f None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:48:26.830530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-0005a70b-4cde-4b8e-9b08-1c1e81e2121f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:26.976151 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005a70b-4cde-4b8e-9b08-1c1e81e2121f None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:48:27.033650 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:27.091865 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867df61-0090-46c6-8b48-2d32db0a9ebc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:48:27.092389 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867df61-0090-46c6-8b48-2d32db0a9ebc service nova] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:27.092661 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867df61-0090-46c6-8b48-2d32db0a9ebc service nova] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:27.092924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867df61-0090-46c6-8b48-2d32db0a9ebc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:27.094534 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-e867df61-0090-46c6-8b48-2d32db0a9ebc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:27.180004 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867df61-0090-46c6-8b48-2d32db0a9ebc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:48:27.181628 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867df61-0090-46c6-8b48-2d32db0a9ebc service nova] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:48:27.199869 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 719/1437] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:48:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:48:27.995882 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac67622-cfce-47ba-923d-d8edc216d221 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:27.996470 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac67622-cfce-47ba-923d-d8edc216d221 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:27.996470 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac67622-cfce-47ba-923d-d8edc216d221 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:27.997782 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 10:48:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:48:28.002988 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f8db0-530d-41a5-bf73-9f159a2fd698 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:28.003423 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f8db0-530d-41a5-bf73-9f159a2fd698 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:28.003543 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f8db0-530d-41a5-bf73-9f159a2fd698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:28.083897 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-293f8db0-530d-41a5-bf73-9f159a2fd698 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:48:28.085089 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-293f8db0-530d-41a5-bf73-9f159a2fd698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:28.087194 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:28.181687 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 10:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:48:28.332764 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac67622-cfce-47ba-923d-d8edc216d221 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:48:28.334243 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-aac67622-cfce-47ba-923d-d8edc216d221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:28.482546 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac67622-cfce-47ba-923d-d8edc216d221 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:48:28.508908 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:28.593081 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba78b51-4e73-499e-b28e-dc33bde13ce4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:48:28.593649 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba78b51-4e73-499e-b28e-dc33bde13ce4 service nova] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:28.593919 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba78b51-4e73-499e-b28e-dc33bde13ce4 service nova] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:28.594183 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba78b51-4e73-499e-b28e-dc33bde13ce4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:28.595747 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-1ba78b51-4e73-499e-b28e-dc33bde13ce4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:28.684650 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba78b51-4e73-499e-b28e-dc33bde13ce4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:48:28.686401 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba78b51-4e73-499e-b28e-dc33bde13ce4 service nova] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:48:28.705655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 720/1440] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:48:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:48:30.583464 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fc138-009e-4d1e-a1cb-756856f72a8a None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:30.583984 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fc138-009e-4d1e-a1cb-756856f72a8a None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:30.583984 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fc138-009e-4d1e-a1cb-756856f72a8a None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:30.585235 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 10:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:48:30.590456 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af2718-c5d8-4eb6-af6f-57a39feb50bf None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:30.590862 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af2718-c5d8-4eb6-af6f-57a39feb50bf None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:30.590991 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af2718-c5d8-4eb6-af6f-57a39feb50bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:30.631725 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:30.656618 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-23af2718-c5d8-4eb6-af6f-57a39feb50bf None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:48:30.657843 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-23af2718-c5d8-4eb6-af6f-57a39feb50bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:30.750891 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 10:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:48:30.789104 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fc138-009e-4d1e-a1cb-756856f72a8a None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:48:30.790660 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-fe9fc138-009e-4d1e-a1cb-756856f72a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:30.891341 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fc138-009e-4d1e-a1cb-756856f72a8a None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:48:30.923174 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:30.962870 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d8abd-b4d5-4235-baea-d59197ce60b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:48:30.963977 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d8abd-b4d5-4235-baea-d59197ce60b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:30.964250 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d8abd-b4d5-4235-baea-d59197ce60b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:30.964514 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d8abd-b4d5-4235-baea-d59197ce60b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:30.966110 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-585d8abd-b4d5-4235-baea-d59197ce60b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:31.077264 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d8abd-b4d5-4235-baea-d59197ce60b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:48:31.078720 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d8abd-b4d5-4235-baea-d59197ce60b3 service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:48:31.097166 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 722/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:48:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:48:33.215460 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9787b-36cf-4476-8b30-91cf78c5c431 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:33.215999 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9787b-36cf-4476-8b30-91cf78c5c431 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:33.215999 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa9787b-36cf-4476-8b30-91cf78c5c431 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:33.217336 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 10:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:48:33.222523 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec4d80-1ff6-453e-b8eb-5d8f9ccb7bdb None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:33.222915 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec4d80-1ff6-453e-b8eb-5d8f9ccb7bdb None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:33.223065 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec4d80-1ff6-453e-b8eb-5d8f9ccb7bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:33.288565 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-9cec4d80-1ff6-453e-b8eb-5d8f9ccb7bdb None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:48:33.289787 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-9cec4d80-1ff6-453e-b8eb-5d8f9ccb7bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:33.302727 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:33.386597 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 10:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:48:33.424055 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9787b-36cf-4476-8b30-91cf78c5c431 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:48:33.425659 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-7aa9787b-36cf-4476-8b30-91cf78c5c431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:33.528472 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa9787b-36cf-4476-8b30-91cf78c5c431 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:48:33.540293 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:33.600564 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f101abd-3898-4539-9d68-7f2c22dc5e0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:48:33.601156 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f101abd-3898-4539-9d68-7f2c22dc5e0c service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:33.601453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f101abd-3898-4539-9d68-7f2c22dc5e0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:33.601720 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f101abd-3898-4539-9d68-7f2c22dc5e0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:33.603288 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-4f101abd-3898-4539-9d68-7f2c22dc5e0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:33.710567 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f101abd-3898-4539-9d68-7f2c22dc5e0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:48:33.711973 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f101abd-3898-4539-9d68-7f2c22dc5e0c service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:48:33.733515 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 723/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:48:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:48:36.006633 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048900ac-e907-4f62-8fc1-c95614ecd978 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:36.007171 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048900ac-e907-4f62-8fc1-c95614ecd978 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:36.007171 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048900ac-e907-4f62-8fc1-c95614ecd978 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:36.008693 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 10:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:48:36.014191 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32190b03-53f7-4fb4-909c-2014db43180a None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:36.014573 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32190b03-53f7-4fb4-909c-2014db43180a None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:36.014729 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32190b03-53f7-4fb4-909c-2014db43180a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:36.062295 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:36.081339 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-32190b03-53f7-4fb4-909c-2014db43180a None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:48:36.082546 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-32190b03-53f7-4fb4-909c-2014db43180a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:36.179847 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 10:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:48:36.219500 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048900ac-e907-4f62-8fc1-c95614ecd978 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:48:36.221062 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-048900ac-e907-4f62-8fc1-c95614ecd978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:36.323435 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048900ac-e907-4f62-8fc1-c95614ecd978 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:48:36.364019 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:36.399101 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae43594-8488-4610-a5a1-5a50fcf0e243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:48:36.399697 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae43594-8488-4610-a5a1-5a50fcf0e243 service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:36.399975 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae43594-8488-4610-a5a1-5a50fcf0e243 service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:36.400243 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae43594-8488-4610-a5a1-5a50fcf0e243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:36.401891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-bae43594-8488-4610-a5a1-5a50fcf0e243 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:36.508854 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae43594-8488-4610-a5a1-5a50fcf0e243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:48:36.510330 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae43594-8488-4610-a5a1-5a50fcf0e243 service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:48:36.528025 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 725/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:48:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:48:38.650632 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b6273-eefd-4a8d-9fd5-37c4d912f2f7 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:38.651177 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b6273-eefd-4a8d-9fd5-37c4d912f2f7 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:38.651177 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b6273-eefd-4a8d-9fd5-37c4d912f2f7 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:38.652541 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 10:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:48:38.657632 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be92a11-3b72-46c4-95ba-d9b5898cf601 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:38.658033 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be92a11-3b72-46c4-95ba-d9b5898cf601 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:38.658174 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be92a11-3b72-46c4-95ba-d9b5898cf601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:38.721866 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-0be92a11-3b72-46c4-95ba-d9b5898cf601 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:48:38.723050 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-0be92a11-3b72-46c4-95ba-d9b5898cf601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:38.743376 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:38.818157 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 10:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:48:38.857148 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b6273-eefd-4a8d-9fd5-37c4d912f2f7 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:48:38.858699 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-371b6273-eefd-4a8d-9fd5-37c4d912f2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:38.960086 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b6273-eefd-4a8d-9fd5-37c4d912f2f7 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:48:38.980241 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:39.033088 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659ff37-73de-49e7-8db0-bf88a8708194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:48:39.033725 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659ff37-73de-49e7-8db0-bf88a8708194 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:39.034000 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659ff37-73de-49e7-8db0-bf88a8708194 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:39.034264 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659ff37-73de-49e7-8db0-bf88a8708194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:39.035828 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-f659ff37-73de-49e7-8db0-bf88a8708194 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:39.143295 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659ff37-73de-49e7-8db0-bf88a8708194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:48:39.144713 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659ff37-73de-49e7-8db0-bf88a8708194 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:48:39.162817 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 726/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:48:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:48:41.222418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff55dd-60e1-4e24-9e52-6ad7cb2e2740 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:41.222990 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff55dd-60e1-4e24-9e52-6ad7cb2e2740 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:41.222990 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff55dd-60e1-4e24-9e52-6ad7cb2e2740 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:41.224327 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 10:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:48:41.230250 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63030e4-791b-425c-a3cc-94f350624099 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:41.230648 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63030e4-791b-425c-a3cc-94f350624099 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:41.230788 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63030e4-791b-425c-a3cc-94f350624099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:41.293804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:41.296603 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-b63030e4-791b-425c-a3cc-94f350624099 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:48:41.298346 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-b63030e4-791b-425c-a3cc-94f350624099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:41.395133 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 10:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:48:41.433795 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff55dd-60e1-4e24-9e52-6ad7cb2e2740 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:48:41.435287 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-9aff55dd-60e1-4e24-9e52-6ad7cb2e2740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:41.535067 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff55dd-60e1-4e24-9e52-6ad7cb2e2740 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:48:41.582534 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:41.607726 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849981b-61b5-4e57-b2d8-fbba748ad8b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:48:41.608324 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849981b-61b5-4e57-b2d8-fbba748ad8b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:41.608597 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849981b-61b5-4e57-b2d8-fbba748ad8b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:41.608862 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849981b-61b5-4e57-b2d8-fbba748ad8b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:41.610493 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-4849981b-61b5-4e57-b2d8-fbba748ad8b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:41.716017 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849981b-61b5-4e57-b2d8-fbba748ad8b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:48:41.717470 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849981b-61b5-4e57-b2d8-fbba748ad8b1 service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:48:41.735401 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 728/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:48:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:48:43.783216 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1574474-bbdd-4fec-899f-58911829315f None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:43.783752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1574474-bbdd-4fec-899f-58911829315f None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:43.783752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1574474-bbdd-4fec-899f-58911829315f None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:43.785535 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 10:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:48:43.791614 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97021e5-1a19-4759-a69c-c365920671b6 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:43.792081 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97021e5-1a19-4759-a69c-c365920671b6 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:43.792184 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97021e5-1a19-4759-a69c-c365920671b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:43.856257 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-c97021e5-1a19-4759-a69c-c365920671b6 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:48:43.857467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-c97021e5-1a19-4759-a69c-c365920671b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:43.886447 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:43.954143 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 10:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:48:43.995460 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1574474-bbdd-4fec-899f-58911829315f None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:48:43.996982 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-f1574474-bbdd-4fec-899f-58911829315f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:44.105576 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1574474-bbdd-4fec-899f-58911829315f None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:48:44.133935 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:44.178951 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf00adc-b312-4bb3-bc6b-120adad1c6b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:48:44.179538 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf00adc-b312-4bb3-bc6b-120adad1c6b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:44.179810 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf00adc-b312-4bb3-bc6b-120adad1c6b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:44.180072 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf00adc-b312-4bb3-bc6b-120adad1c6b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:44.181711 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-ccf00adc-b312-4bb3-bc6b-120adad1c6b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:44.288066 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf00adc-b312-4bb3-bc6b-120adad1c6b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:48:44.289507 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf00adc-b312-4bb3-bc6b-120adad1c6b8 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:48:44.308483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 729/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:48:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:48:46.345927 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feae3c0-b56a-4996-a699-d969d33b7920 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:46.346480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feae3c0-b56a-4996-a699-d969d33b7920 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:46.346480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feae3c0-b56a-4996-a699-d969d33b7920 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:46.347817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 10:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:48:46.353190 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02959ed8-6e96-4aa2-9710-39bacb2bea82 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:46.353629 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02959ed8-6e96-4aa2-9710-39bacb2bea82 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:46.353788 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02959ed8-6e96-4aa2-9710-39bacb2bea82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:46.418963 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-02959ed8-6e96-4aa2-9710-39bacb2bea82 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:48:46.420083 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-02959ed8-6e96-4aa2-9710-39bacb2bea82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:46.428290 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:46.516689 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 10:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:48:46.553638 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feae3c0-b56a-4996-a699-d969d33b7920 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:48:46.555165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-5feae3c0-b56a-4996-a699-d969d33b7920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:46.656916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feae3c0-b56a-4996-a699-d969d33b7920 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:48:46.709992 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:46.729420 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd883c-4a97-43eb-8388-663355b7d49a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:48:46.730024 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd883c-4a97-43eb-8388-663355b7d49a service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:46.730298 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd883c-4a97-43eb-8388-663355b7d49a service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:46.730564 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd883c-4a97-43eb-8388-663355b7d49a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:46.732161 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-bdbd883c-4a97-43eb-8388-663355b7d49a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:46.839137 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd883c-4a97-43eb-8388-663355b7d49a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:48:46.840551 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd883c-4a97-43eb-8388-663355b7d49a service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:48:46.858088 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 731/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:48:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:48:48.886426 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23dd403-9de9-4bfe-acf3-7d225173bcac None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:48.886996 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23dd403-9de9-4bfe-acf3-7d225173bcac None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:48.886996 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23dd403-9de9-4bfe-acf3-7d225173bcac None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:48.888297 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 10:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 10:48:48.893582 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5a17c-9365-41fe-83ca-1036e84e5526 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:48.894034 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5a17c-9365-41fe-83ca-1036e84e5526 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:48.894140 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5a17c-9365-41fe-83ca-1036e84e5526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:48.958304 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-74c5a17c-9365-41fe-83ca-1036e84e5526 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:48:48.959495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-74c5a17c-9365-41fe-83ca-1036e84e5526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:48.996607 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:49.054024 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 10:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:48:49.091410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23dd403-9de9-4bfe-acf3-7d225173bcac None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:48:49.092915 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-f23dd403-9de9-4bfe-acf3-7d225173bcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:49.194112 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23dd403-9de9-4bfe-acf3-7d225173bcac None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:48:49.230642 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:49.266419 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf521f-29f0-447b-a390-aa6bed9c7595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:48:49.267016 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf521f-29f0-447b-a390-aa6bed9c7595 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:49.267291 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf521f-29f0-447b-a390-aa6bed9c7595 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:49.267557 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf521f-29f0-447b-a390-aa6bed9c7595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:49.269138 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-6cbf521f-29f0-447b-a390-aa6bed9c7595 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:49.376228 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf521f-29f0-447b-a390-aa6bed9c7595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:48:49.377935 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf521f-29f0-447b-a390-aa6bed9c7595 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:48:49.395654 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 732/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:48:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:48:51.383680 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25257f-3b90-4cc5-baa1-5c57b52507f7 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:51.384678 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25257f-3b90-4cc5-baa1-5c57b52507f7 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:51.384809 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25257f-3b90-4cc5-baa1-5c57b52507f7 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:51.386156 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 10:48:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:48:51.391465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067acf18-f7c4-49dc-b36d-079b0bff733f None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:51.391864 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067acf18-f7c4-49dc-b36d-079b0bff733f None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:51.392006 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067acf18-f7c4-49dc-b36d-079b0bff733f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:51.457675 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-067acf18-f7c4-49dc-b36d-079b0bff733f None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:48:51.458872 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-067acf18-f7c4-49dc-b36d-079b0bff733f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:51.477025 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:51.554025 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 10:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:48:51.591518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25257f-3b90-4cc5-baa1-5c57b52507f7 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:48:51.593102 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-cc25257f-3b90-4cc5-baa1-5c57b52507f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:51.693912 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25257f-3b90-4cc5-baa1-5c57b52507f7 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:48:51.760247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:51.767480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db6c62-8067-4a3b-b87b-5e7721d1fc32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:48:51.768102 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db6c62-8067-4a3b-b87b-5e7721d1fc32 service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:51.768375 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db6c62-8067-4a3b-b87b-5e7721d1fc32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:51.768637 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db6c62-8067-4a3b-b87b-5e7721d1fc32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:51.770245 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a6db6c62-8067-4a3b-b87b-5e7721d1fc32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:51.878258 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db6c62-8067-4a3b-b87b-5e7721d1fc32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:48:51.879681 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db6c62-8067-4a3b-b87b-5e7721d1fc32 service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:48:51.898245 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 734/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:48:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:48:53.902023 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2bc35-1e7b-47e0-b5b0-c86f2d388052 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:53.902566 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2bc35-1e7b-47e0-b5b0-c86f2d388052 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:53.902566 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2bc35-1e7b-47e0-b5b0-c86f2d388052 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:53.903909 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 10:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:48:53.909224 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e8b2e-6681-4f8d-bfa8-84a9f20329dd None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:53.909635 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e8b2e-6681-4f8d-bfa8-84a9f20329dd None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:53.909797 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e8b2e-6681-4f8d-bfa8-84a9f20329dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:53.975176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-e84e8b2e-6681-4f8d-bfa8-84a9f20329dd None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:48:53.976356 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-e84e8b2e-6681-4f8d-bfa8-84a9f20329dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:54.026513 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:54.075627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 10:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:48:54.115276 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2bc35-1e7b-47e0-b5b0-c86f2d388052 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:48:54.116852 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-a1c2bc35-1e7b-47e0-b5b0-c86f2d388052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:54.219115 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2bc35-1e7b-47e0-b5b0-c86f2d388052 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:48:54.266056 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:48:54.292025 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e631c-be3f-4b2a-8a01-8c34fd682d72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:48:54.292607 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e631c-be3f-4b2a-8a01-8c34fd682d72 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:48:54.292885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e631c-be3f-4b2a-8a01-8c34fd682d72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:48:54.293146 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e631c-be3f-4b2a-8a01-8c34fd682d72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:48:54.294738 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-270e631c-be3f-4b2a-8a01-8c34fd682d72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:48:54.401212 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e631c-be3f-4b2a-8a01-8c34fd682d72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:48:54.403139 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e631c-be3f-4b2a-8a01-8c34fd682d72 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:48:54.421142 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 735/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:48:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:49:04.073768 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=22 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:49:04.418913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=66 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:49:13.793881 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56e439-7f25-49c6-8ddf-3df97352fd34 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:49:13.794396 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56e439-7f25-49c6-8ddf-3df97352fd34 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:49:13.794504 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56e439-7f25-49c6-8ddf-3df97352fd34 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:49:13.795779 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 736/1471] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:49:13.800921 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ce5f0-e750-4a3d-a583-307837596d43 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:49:13.801410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ce5f0-e750-4a3d-a583-307837596d43 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:49:13.801546 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ce5f0-e750-4a3d-a583-307837596d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:49:13.866533 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-2d5ce5f0-e750-4a3d-a583-307837596d43 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:49:13.868536 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-2d5ce5f0-e750-4a3d-a583-307837596d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:49:13.965801 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 736/1472] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:49:14.050941 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae9478-4961-466d-9ec1-786502d23834 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:49:14.051220 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae9478-4961-466d-9ec1-786502d23834 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:49:14.051488 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae9478-4961-466d-9ec1-786502d23834 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:49:14.052871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 737/1473] 10.222.0.27 () {54 vars in 966 bytes} [Sun Aug 7 10:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:49:14.058199 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae35aa4-8d00-4516-b6d0-f941e47502e0 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:49:14.058481 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae35aa4-8d00-4516-b6d0-f941e47502e0 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:49:14.058749 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae35aa4-8d00-4516-b6d0-f941e47502e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:49:14.133607 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-3ae35aa4-8d00-4516-b6d0-f941e47502e0 None None] MFA Rules not processed for user `a462a891b30847c0aeadbd697652011a`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:49:14.134807 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-3ae35aa4-8d00-4516-b6d0-f941e47502e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:49:14.156313 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:49:14.210805 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 737/1474] 10.222.0.27 () {58 vars in 1063 bytes} [Sun Aug 7 10:49:14 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:49:14.218842 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae9478-4961-466d-9ec1-786502d23834 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:49:14.220332 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a7ae9478-4961-466d-9ec1-786502d23834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:49:14.321229 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae9478-4961-466d-9ec1-786502d23834 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:49:14.394512 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4eeabb-cc9a-4792-829f-41458b07d95e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a462a891b30847c0aeadbd697652011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:49:14.395119 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4eeabb-cc9a-4792-829f-41458b07d95e service glance] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:49:14.395408 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4eeabb-cc9a-4792-829f-41458b07d95e service glance] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:49:14.395667 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4eeabb-cc9a-4792-829f-41458b07d95e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:49:14.397320 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-7c4eeabb-cc9a-4792-829f-41458b07d95e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:49:14.451729 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:49:14.506080 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4eeabb-cc9a-4792-829f-41458b07d95e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:49:14.507507 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4eeabb-cc9a-4792-829f-41458b07d95e service glance] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:49:14.526141 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 738/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:49:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:49:16.629697 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567fff3-7ded-42c1-98dd-4bba11176c85 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:49:16.630232 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567fff3-7ded-42c1-98dd-4bba11176c85 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:49:16.630232 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567fff3-7ded-42c1-98dd-4bba11176c85 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:49:16.631583 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 738/1476] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:49:16.637504 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65d931-b216-4853-a43a-69295bddaa62 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:49:16.637918 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65d931-b216-4853-a43a-69295bddaa62 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:49:16.638021 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65d931-b216-4853-a43a-69295bddaa62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:49:16.701883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-fe65d931-b216-4853-a43a-69295bddaa62 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:49:16.703082 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-fe65d931-b216-4853-a43a-69295bddaa62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:49:16.795971 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 739/1477] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:49:16.818790 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567fff3-7ded-42c1-98dd-4bba11176c85 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:49:16.820292 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-7567fff3-7ded-42c1-98dd-4bba11176c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:49:16.942625 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567fff3-7ded-42c1-98dd-4bba11176c85 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:49:16.990050 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:49:17.036323 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b92319-314e-404e-a924-3fceed993d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:49:17.036944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b92319-314e-404e-a924-3fceed993d99 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:49:17.037220 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b92319-314e-404e-a924-3fceed993d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:49:17.037528 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b92319-314e-404e-a924-3fceed993d99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:49:17.038170 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b92319-314e-404e-a924-3fceed993d99 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:49:17.039911 dv-cinder-850320-3-smb devstack@keystone.service[80144]: WARNING py.warnings [None req-a5b92319-314e-404e-a924-3fceed993d99 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 10:49:17.039911 dv-cinder-850320-3-smb devstack@keystone.service[80144]: warnings.warn(msg) Aug 07 10:49:17.039911 dv-cinder-850320-3-smb devstack@keystone.service[80144]: Aug 07 10:49:17.041039 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b92319-314e-404e-a924-3fceed993d99 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:49:17.059970 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 739/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Sun Aug 7 10:49:16 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:49:19.069957 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca67ef-e57b-4adb-9945-30daffd1e473 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:49:19.070513 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca67ef-e57b-4adb-9945-30daffd1e473 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:49:19.070513 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca67ef-e57b-4adb-9945-30daffd1e473 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:49:19.071880 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 740/1479] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:49:19.077172 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95637223-4541-4dcd-b0c2-69eeb64af130 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:49:19.077617 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95637223-4541-4dcd-b0c2-69eeb64af130 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:49:19.077757 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95637223-4541-4dcd-b0c2-69eeb64af130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:49:19.145091 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-95637223-4541-4dcd-b0c2-69eeb64af130 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:49:19.146330 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-95637223-4541-4dcd-b0c2-69eeb64af130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:49:19.242136 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 740/1480] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:49:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:49:19.284284 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca67ef-e57b-4adb-9945-30daffd1e473 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:49:19.285936 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-21ca67ef-e57b-4adb-9945-30daffd1e473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:49:19.296233 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:49:19.432485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca67ef-e57b-4adb-9945-30daffd1e473 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:49:19.510717 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:49:19.543486 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c04c0e-46d3-42ed-a519-13f50343cedf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:49:19.544091 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c04c0e-46d3-42ed-a519-13f50343cedf service nova] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:49:19.544364 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c04c0e-46d3-42ed-a519-13f50343cedf service nova] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:49:19.544630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c04c0e-46d3-42ed-a519-13f50343cedf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:49:19.546258 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-70c04c0e-46d3-42ed-a519-13f50343cedf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:49:19.633088 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c04c0e-46d3-42ed-a519-13f50343cedf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:49:19.634690 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c04c0e-46d3-42ed-a519-13f50343cedf service nova] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:49:19.652474 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 741/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:49:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:49:21.791114 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f841bf-a4f2-4220-9e3e-dc604299a8f0 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:49:21.791650 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f841bf-a4f2-4220-9e3e-dc604299a8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:49:21.791650 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f841bf-a4f2-4220-9e3e-dc604299a8f0 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:49:21.793006 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 741/1482] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:49:21.798056 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19520e75-b117-48ad-98a0-f13aca4813fa None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:49:21.798463 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19520e75-b117-48ad-98a0-f13aca4813fa None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:49:21.798580 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19520e75-b117-48ad-98a0-f13aca4813fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:49:21.861786 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-19520e75-b117-48ad-98a0-f13aca4813fa None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:49:21.862958 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-19520e75-b117-48ad-98a0-f13aca4813fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:49:21.908720 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:49:21.959363 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 742/1483] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:49:21.995420 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f841bf-a4f2-4220-9e3e-dc604299a8f0 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:49:21.996976 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-27f841bf-a4f2-4220-9e3e-dc604299a8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:49:22.021010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:49:22.099985 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f841bf-a4f2-4220-9e3e-dc604299a8f0 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:49:22.173225 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a030e9-ada6-44c1-a199-a65f58314c1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:49:22.173851 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a030e9-ada6-44c1-a199-a65f58314c1b service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:49:22.174128 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a030e9-ada6-44c1-a199-a65f58314c1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:49:22.174394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a030e9-ada6-44c1-a199-a65f58314c1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:49:22.175990 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-c1a030e9-ada6-44c1-a199-a65f58314c1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:49:22.249127 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:49:22.284157 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a030e9-ada6-44c1-a199-a65f58314c1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:49:22.285640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a030e9-ada6-44c1-a199-a65f58314c1b service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:49:22.304339 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 742/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:49:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:49:24.356635 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630eae4-0372-4e3f-9063-581f9d23cfea None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:49:24.357124 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630eae4-0372-4e3f-9063-581f9d23cfea None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:49:24.357221 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630eae4-0372-4e3f-9063-581f9d23cfea None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:49:24.358531 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 743/1485] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:49:24.363859 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63873582-2202-455f-8b06-93aa112089b8 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:49:24.364287 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63873582-2202-455f-8b06-93aa112089b8 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:49:24.364427 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63873582-2202-455f-8b06-93aa112089b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:49:24.435238 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-63873582-2202-455f-8b06-93aa112089b8 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:49:24.436425 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-63873582-2202-455f-8b06-93aa112089b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:49:24.530913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 743/1486] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:49:24.567632 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630eae4-0372-4e3f-9063-581f9d23cfea None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:49:24.569141 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-0630eae4-0372-4e3f-9063-581f9d23cfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:49:24.670377 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630eae4-0372-4e3f-9063-581f9d23cfea None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:49:24.738823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:49:24.740588 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b11ae6-8cfc-4bfa-be82-1a3c6a92aebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:49:24.741186 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b11ae6-8cfc-4bfa-be82-1a3c6a92aebd service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:49:24.741677 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b11ae6-8cfc-4bfa-be82-1a3c6a92aebd service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:49:24.742641 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b11ae6-8cfc-4bfa-be82-1a3c6a92aebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:49:24.744487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a1b11ae6-8cfc-4bfa-be82-1a3c6a92aebd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:49:24.850180 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b11ae6-8cfc-4bfa-be82-1a3c6a92aebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:49:24.851536 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b11ae6-8cfc-4bfa-be82-1a3c6a92aebd service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:49:24.869449 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 744/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:49:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:49:26.948145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d16cb-c8a1-4eee-98fa-c45add7873a1 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:49:26.948797 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d16cb-c8a1-4eee-98fa-c45add7873a1 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:49:26.948797 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d16cb-c8a1-4eee-98fa-c45add7873a1 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:49:26.950122 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 744/1488] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:49:26.955167 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f29e61-f1eb-46cf-b14b-3fe457448285 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:49:26.955569 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f29e61-f1eb-46cf-b14b-3fe457448285 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:49:26.955708 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f29e61-f1eb-46cf-b14b-3fe457448285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:49:27.021366 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-43f29e61-f1eb-46cf-b14b-3fe457448285 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:49:27.022579 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-43f29e61-f1eb-46cf-b14b-3fe457448285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:49:27.074912 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:49:27.119239 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 745/1489] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:49:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:49:27.159480 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d16cb-c8a1-4eee-98fa-c45add7873a1 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:49:27.161015 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-c20d16cb-c8a1-4eee-98fa-c45add7873a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:49:27.196845 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:49:27.264350 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d16cb-c8a1-4eee-98fa-c45add7873a1 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:49:27.336814 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd46ff6-1aed-498f-b6ee-c8d49cf52f16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:49:27.337445 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd46ff6-1aed-498f-b6ee-c8d49cf52f16 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:49:27.337724 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd46ff6-1aed-498f-b6ee-c8d49cf52f16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:49:27.337992 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd46ff6-1aed-498f-b6ee-c8d49cf52f16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:49:27.339580 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-fbd46ff6-1aed-498f-b6ee-c8d49cf52f16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:49:27.419782 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:49:27.448662 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd46ff6-1aed-498f-b6ee-c8d49cf52f16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:49:27.450144 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd46ff6-1aed-498f-b6ee-c8d49cf52f16 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:49:27.474094 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 745/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:49:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:49:29.748795 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0bb9b-05cd-431e-9afd-6f390fb21a5b None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:49:29.749418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0bb9b-05cd-431e-9afd-6f390fb21a5b None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:49:29.749418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0bb9b-05cd-431e-9afd-6f390fb21a5b None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:49:29.750716 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 746/1491] 10.222.0.27 () {54 vars in 927 bytes} [Sun Aug 7 10:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 10:49:29.756381 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8c611-6962-4306-bb4b-21c2c24451e8 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:49:29.756826 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8c611-6962-4306-bb4b-21c2c24451e8 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:49:29.756933 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8c611-6962-4306-bb4b-21c2c24451e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:49:29.826137 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-b5a8c611-6962-4306-bb4b-21c2c24451e8 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:49:29.827335 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-b5a8c611-6962-4306-bb4b-21c2c24451e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:49:29.928186 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 746/1492] 10.222.0.27 () {58 vars in 1024 bytes} [Sun Aug 7 10:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:49:29.967043 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0bb9b-05cd-431e-9afd-6f390fb21a5b None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:49:29.968574 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-7ef0bb9b-05cd-431e-9afd-6f390fb21a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:49:30.073640 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0bb9b-05cd-431e-9afd-6f390fb21a5b None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:49:30.144741 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ca3fb-5f4a-44c0-b305-e038ac195eef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:49:30.145353 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ca3fb-5f4a-44c0-b305-e038ac195eef service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:49:30.145630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ca3fb-5f4a-44c0-b305-e038ac195eef service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:49:30.145896 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ca3fb-5f4a-44c0-b305-e038ac195eef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:49:30.147462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-1b2ca3fb-5f4a-44c0-b305-e038ac195eef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:49:30.156702 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:49:30.253176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ca3fb-5f4a-44c0-b305-e038ac195eef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:49:30.254624 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ca3fb-5f4a-44c0-b305-e038ac195eef service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:49:30.272522 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 747/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:49:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:49:39.926421 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=82 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:49:40.270289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=50 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:50:42.045880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca9572-f980-4bbc-94e4-13591ca1b953 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:50:42.046476 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca9572-f980-4bbc-94e4-13591ca1b953 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:50:42.046476 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca9572-f980-4bbc-94e4-13591ca1b953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:50:42.120572 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-38ca9572-f980-4bbc-94e4-13591ca1b953 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:50:42.121804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-38ca9572-f980-4bbc-94e4-13591ca1b953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:50:42.216469 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 747/1494] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:50:42.226582 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651e98c-3d36-476e-bd7c-2ee28aeecff9 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:50:42.227104 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651e98c-3d36-476e-bd7c-2ee28aeecff9 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:50:42.227206 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651e98c-3d36-476e-bd7c-2ee28aeecff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:50:42.302958 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-e651e98c-3d36-476e-bd7c-2ee28aeecff9 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:50:42.304122 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-e651e98c-3d36-476e-bd7c-2ee28aeecff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:50:42.399862 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 748/1495] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:50:42.404610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca9572-f980-4bbc-94e4-13591ca1b953 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:50:42.405844 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-38ca9572-f980-4bbc-94e4-13591ca1b953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:50:42.417184 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca9572-f980-4bbc-94e4-13591ca1b953 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:50:42.482165 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:50:42.516390 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83b57d-05fd-4564-8b58-1e17ec4de6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:50:42.516988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83b57d-05fd-4564-8b58-1e17ec4de6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:50:42.517263 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83b57d-05fd-4564-8b58-1e17ec4de6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:50:42.517560 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83b57d-05fd-4564-8b58-1e17ec4de6a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:50:42.518197 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83b57d-05fd-4564-8b58-1e17ec4de6a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:50:42.518502 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83b57d-05fd-4564-8b58-1e17ec4de6a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:50:42.519501 dv-cinder-850320-3-smb devstack@keystone.service[80144]: WARNING py.warnings [None req-8c83b57d-05fd-4564-8b58-1e17ec4de6a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 10:50:42.519501 dv-cinder-850320-3-smb devstack@keystone.service[80144]: warnings.warn(msg) Aug 07 10:50:42.519501 dv-cinder-850320-3-smb devstack@keystone.service[80144]: Aug 07 10:50:42.520950 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83b57d-05fd-4564-8b58-1e17ec4de6a0 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:50:42.532037 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 748/1496] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:50:42.540194 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651e98c-3d36-476e-bd7c-2ee28aeecff9 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:50:42.549095 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651e98c-3d36-476e-bd7c-2ee28aeecff9 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:50:42.609174 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:50:42.642841 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce1918-970a-473d-923b-00e83dd4e708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:50:42.643430 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce1918-970a-473d-923b-00e83dd4e708 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:50:42.643704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce1918-970a-473d-923b-00e83dd4e708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:50:42.643964 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce1918-970a-473d-923b-00e83dd4e708 admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:50:42.644573 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce1918-970a-473d-923b-00e83dd4e708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:50:42.646355 dv-cinder-850320-3-smb devstack@keystone.service[80145]: WARNING py.warnings [None req-58ce1918-970a-473d-923b-00e83dd4e708 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 10:50:42.646355 dv-cinder-850320-3-smb devstack@keystone.service[80145]: warnings.warn(msg) Aug 07 10:50:42.646355 dv-cinder-850320-3-smb devstack@keystone.service[80145]: Aug 07 10:50:42.647513 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce1918-970a-473d-923b-00e83dd4e708 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:50:42.703069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 749/1497] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:50:42 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:50:42.707404 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83b57d-05fd-4564-8b58-1e17ec4de6a0 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:50:42.708927 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-8c83b57d-05fd-4564-8b58-1e17ec4de6a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:50:42.741716 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83b57d-05fd-4564-8b58-1e17ec4de6a0 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:50:42.835969 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7006a-00b6-42cf-b504-f376c99f7845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:50:42.836567 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7006a-00b6-42cf-b504-f376c99f7845 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:50:42.836844 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7006a-00b6-42cf-b504-f376c99f7845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:50:42.837114 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7006a-00b6-42cf-b504-f376c99f7845 admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:50:42.837782 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7006a-00b6-42cf-b504-f376c99f7845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:50:42.838782 dv-cinder-850320-3-smb devstack@keystone.service[80144]: WARNING py.warnings [None req-3cf7006a-00b6-42cf-b504-f376c99f7845 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 10:50:42.838782 dv-cinder-850320-3-smb devstack@keystone.service[80144]: warnings.warn(msg) Aug 07 10:50:42.838782 dv-cinder-850320-3-smb devstack@keystone.service[80144]: Aug 07 10:50:42.840006 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7006a-00b6-42cf-b504-f376c99f7845 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:50:42.882381 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 749/1498] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:50:42 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:50:42.886544 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce1918-970a-473d-923b-00e83dd4e708 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:50:42.888045 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-58ce1918-970a-473d-923b-00e83dd4e708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:50:42.948484 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce1918-970a-473d-923b-00e83dd4e708 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:50:43.029941 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:50:43.042649 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08495348-e63e-4b19-92a8-aa49884486ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:50:43.043249 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08495348-e63e-4b19-92a8-aa49884486ec admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:50:43.043553 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08495348-e63e-4b19-92a8-aa49884486ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:50:43.043851 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08495348-e63e-4b19-92a8-aa49884486ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:50:43.044492 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08495348-e63e-4b19-92a8-aa49884486ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:50:43.045543 dv-cinder-850320-3-smb devstack@keystone.service[80145]: WARNING py.warnings [None req-08495348-e63e-4b19-92a8-aa49884486ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 10:50:43.045543 dv-cinder-850320-3-smb devstack@keystone.service[80145]: warnings.warn(msg) Aug 07 10:50:43.045543 dv-cinder-850320-3-smb devstack@keystone.service[80145]: Aug 07 10:50:43.046421 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08495348-e63e-4b19-92a8-aa49884486ec admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:50:43.059107 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 750/1499] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:50:43.063135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7006a-00b6-42cf-b504-f376c99f7845 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:50:43.064686 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-3cf7006a-00b6-42cf-b504-f376c99f7845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:50:43.076214 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7006a-00b6-42cf-b504-f376c99f7845 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:50:43.101330 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:50:43.173536 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba93e5-bf41-422e-9e3b-9c63be36a10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:50:43.174070 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba93e5-bf41-422e-9e3b-9c63be36a10b admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:50:43.174345 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba93e5-bf41-422e-9e3b-9c63be36a10b admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:50:43.174609 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba93e5-bf41-422e-9e3b-9c63be36a10b admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:50:43.175244 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba93e5-bf41-422e-9e3b-9c63be36a10b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:50:43.176825 dv-cinder-850320-3-smb devstack@keystone.service[80144]: WARNING py.warnings [None req-fcba93e5-bf41-422e-9e3b-9c63be36a10b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 10:50:43.176825 dv-cinder-850320-3-smb devstack@keystone.service[80144]: warnings.warn(msg) Aug 07 10:50:43.176825 dv-cinder-850320-3-smb devstack@keystone.service[80144]: Aug 07 10:50:43.177730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba93e5-bf41-422e-9e3b-9c63be36a10b admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:50:43.189781 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 750/1500] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 10:50:43.193935 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08495348-e63e-4b19-92a8-aa49884486ec admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:50:43.195445 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-08495348-e63e-4b19-92a8-aa49884486ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:50:43.228357 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08495348-e63e-4b19-92a8-aa49884486ec admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:50:43.319133 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b7f6c-dadd-4a4a-83f1-ee6ccf96c36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:50:43.319770 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b7f6c-dadd-4a4a-83f1-ee6ccf96c36d admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:50:43.320043 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b7f6c-dadd-4a4a-83f1-ee6ccf96c36d admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:50:43.320306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b7f6c-dadd-4a4a-83f1-ee6ccf96c36d admin admin] PATH_INFO: `/v3/projects/315babedaa8d449ba692db50d76be173/users/87a9e602ba14426dbf938952eb0ffde3/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:50:43.342119 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b7f6c-dadd-4a4a-83f1-ee6ccf96c36d admin admin] RBAC: Authorizing `identity:create_grant(project_id=315babedaa8d449ba692db50d76be173, user_id=87a9e602ba14426dbf938952eb0ffde3, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:50:43.343153 dv-cinder-850320-3-smb devstack@keystone.service[80145]: WARNING py.warnings [None req-633b7f6c-dadd-4a4a-83f1-ee6ccf96c36d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 10:50:43.343153 dv-cinder-850320-3-smb devstack@keystone.service[80145]: warnings.warn(msg) Aug 07 10:50:43.343153 dv-cinder-850320-3-smb devstack@keystone.service[80145]: Aug 07 10:50:43.345108 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b7f6c-dadd-4a4a-83f1-ee6ccf96c36d admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:50:43.370639 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 751/1501] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:50:43 2022] PUT /identity/v3/projects/315babedaa8d449ba692db50d76be173/users/87a9e602ba14426dbf938952eb0ffde3/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:50:43.383481 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf5b87-0ec8-4582-8462-346536cc454a None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:50:43.383757 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf5b87-0ec8-4582-8462-346536cc454a None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:50:43.384023 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf5b87-0ec8-4582-8462-346536cc454a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:50:43.439822 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-58cf5b87-0ec8-4582-8462-346536cc454a None None] MFA Rules not processed for user `87a9e602ba14426dbf938952eb0ffde3`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:50:43.440929 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-58cf5b87-0ec8-4582-8462-346536cc454a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:50:43.516703 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 751/1502] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:50:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:50:43.529859 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039c72d-1809-47bc-bafe-27a7efe155c1 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:50:43.530141 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039c72d-1809-47bc-bafe-27a7efe155c1 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:50:43.530411 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039c72d-1809-47bc-bafe-27a7efe155c1 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:50:43.531782 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 752/1503] 10.222.0.27 () {54 vars in 964 bytes} [Sun Aug 7 10:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:50:43.536388 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ef451-a74a-45f6-872f-27cbdc9b32fd None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:50:43.536672 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ef451-a74a-45f6-872f-27cbdc9b32fd None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:50:43.536944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ef451-a74a-45f6-872f-27cbdc9b32fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:50:43.568318 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:50:43.611405 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-a73ef451-a74a-45f6-872f-27cbdc9b32fd None None] MFA Rules not processed for user `c5fca18c4ee74043a5acc9aeb297c9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:50:43.612603 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-a73ef451-a74a-45f6-872f-27cbdc9b32fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:50:43.686580 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 752/1504] 10.222.0.27 () {58 vars in 1061 bytes} [Sun Aug 7 10:50:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:50:43.694849 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039c72d-1809-47bc-bafe-27a7efe155c1 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:50:43.696275 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-4039c72d-1809-47bc-bafe-27a7efe155c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:50:43.744285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:50:43.797690 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039c72d-1809-47bc-bafe-27a7efe155c1 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:50:43.878234 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55973157-23ed-423c-9f49-dd5019502929 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:50:43.878874 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55973157-23ed-423c-9f49-dd5019502929 service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:50:43.879155 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55973157-23ed-423c-9f49-dd5019502929 service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:50:43.880115 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55973157-23ed-423c-9f49-dd5019502929 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:50:43.881854 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-55973157-23ed-423c-9f49-dd5019502929 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:50:43.981806 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55973157-23ed-423c-9f49-dd5019502929 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:50:43.983151 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55973157-23ed-423c-9f49-dd5019502929 service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:50:43.986558 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:50:44.001586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 753/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:50:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:50:44.046398 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eba38c-5e77-4f36-a8cc-a668735cdb8c None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:50:44.046687 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eba38c-5e77-4f36-a8cc-a668735cdb8c None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:50:44.046961 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eba38c-5e77-4f36-a8cc-a668735cdb8c None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:50:44.048288 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 753/1506] 10.222.0.27 () {52 vars in 830 bytes} [Sun Aug 7 10:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:50:44.052104 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55973157-23ed-423c-9f49-dd5019502929 service cinder] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:50:44.053295 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-55973157-23ed-423c-9f49-dd5019502929 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:50:44.150957 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55973157-23ed-423c-9f49-dd5019502929 service cinder] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:50:44.240780 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48c289-1142-48e0-b086-7e299e73b4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:50:44.241406 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48c289-1142-48e0-b086-7e299e73b4c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:50:44.241601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48c289-1142-48e0-b086-7e299e73b4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:50:44.241865 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48c289-1142-48e0-b086-7e299e73b4c1 admin admin] PATH_INFO: `/v3/users/87a9e602ba14426dbf938952eb0ffde3` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:50:44.253899 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48c289-1142-48e0-b086-7e299e73b4c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87a9e602ba14426dbf938952eb0ffde3)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:50:44.255462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: WARNING py.warnings [None req-aa48c289-1142-48e0-b086-7e299e73b4c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 10:50:44.255462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: warnings.warn(msg) Aug 07 10:50:44.255462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: Aug 07 10:50:44.256645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48c289-1142-48e0-b086-7e299e73b4c1 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:50:44.265924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:50:44.323422 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-aa48c289-1142-48e0-b086-7e299e73b4c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87a9e602ba14426dbf938952eb0ffde3'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:50:44.346147 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-aa48c289-1142-48e0-b086-7e299e73b4c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87a9e602ba14426dbf938952eb0ffde3'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:50:44.347234 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-aa48c289-1142-48e0-b086-7e299e73b4c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87a9e602ba14426dbf938952eb0ffde3'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:50:44.360362 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-aa48c289-1142-48e0-b086-7e299e73b4c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87a9e602ba14426dbf938952eb0ffde3'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:50:44.371028 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-aa48c289-1142-48e0-b086-7e299e73b4c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87a9e602ba14426dbf938952eb0ffde3'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:50:44.376881 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 754/1507] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:50:44 2022] DELETE /identity/v3/users/87a9e602ba14426dbf938952eb0ffde3 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:50:44.381979 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013460b5-0635-41d6-bf2c-87cf708676e6 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:50:44.382649 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013460b5-0635-41d6-bf2c-87cf708676e6 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:50:44.382649 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013460b5-0635-41d6-bf2c-87cf708676e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:50:44.438756 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-013460b5-0635-41d6-bf2c-87cf708676e6 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:50:44.439953 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-013460b5-0635-41d6-bf2c-87cf708676e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:50:44.514666 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:50:44.531939 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 754/1508] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:50:44.542429 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48c289-1142-48e0-b086-7e299e73b4c1 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:50:44.543770 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-aa48c289-1142-48e0-b086-7e299e73b4c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:50:44.648345 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48c289-1142-48e0-b086-7e299e73b4c1 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:50:44.701865 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:50:44.721943 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c135a18-3782-4919-ba55-baf3abbe89eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:50:44.722543 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c135a18-3782-4919-ba55-baf3abbe89eb service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:50:44.722815 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c135a18-3782-4919-ba55-baf3abbe89eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:50:44.723564 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c135a18-3782-4919-ba55-baf3abbe89eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:50:44.725137 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-6c135a18-3782-4919-ba55-baf3abbe89eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:50:44.830831 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c135a18-3782-4919-ba55-baf3abbe89eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:50:44.832184 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c135a18-3782-4919-ba55-baf3abbe89eb service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:50:44.850737 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 755/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:50:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 10:50:45.219276 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013460b5-0635-41d6-bf2c-87cf708676e6 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:50:45.220514 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-013460b5-0635-41d6-bf2c-87cf708676e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:50:45.241785 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013460b5-0635-41d6-bf2c-87cf708676e6 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:50:45.347531 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdec2eb-c44b-4764-b124-be52a775760c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:50:45.348187 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdec2eb-c44b-4764-b124-be52a775760c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:50:45.348463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdec2eb-c44b-4764-b124-be52a775760c admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:50:45.348731 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdec2eb-c44b-4764-b124-be52a775760c admin admin] PATH_INFO: `/v3/projects/315babedaa8d449ba692db50d76be173` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:50:45.358808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdec2eb-c44b-4764-b124-be52a775760c admin admin] RBAC: Authorizing `identity:delete_project(project_id=315babedaa8d449ba692db50d76be173)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:50:45.359879 dv-cinder-850320-3-smb devstack@keystone.service[80144]: WARNING py.warnings [None req-7cdec2eb-c44b-4764-b124-be52a775760c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 10:50:45.359879 dv-cinder-850320-3-smb devstack@keystone.service[80144]: warnings.warn(msg) Aug 07 10:50:45.359879 dv-cinder-850320-3-smb devstack@keystone.service[80144]: Aug 07 10:50:45.362005 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdec2eb-c44b-4764-b124-be52a775760c admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:50:45.419690 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-7cdec2eb-c44b-4764-b124-be52a775760c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '315babedaa8d449ba692db50d76be173', 'request_id': 'req-7cdec2eb-c44b-4764-b124-be52a775760c'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:50:45.425840 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-7cdec2eb-c44b-4764-b124-be52a775760c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '315babedaa8d449ba692db50d76be173', 'request_id': 'req-7cdec2eb-c44b-4764-b124-be52a775760c'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:50:45.435101 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-7cdec2eb-c44b-4764-b124-be52a775760c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '315babedaa8d449ba692db50d76be173', 'request_id': 'req-7cdec2eb-c44b-4764-b124-be52a775760c'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:50:45.464945 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-7cdec2eb-c44b-4764-b124-be52a775760c admin admin] The token cache is being invalidate because project 315babedaa8d449ba692db50d76be173 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:50:45.465231 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-7cdec2eb-c44b-4764-b124-be52a775760c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:50:45.465778 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-7cdec2eb-c44b-4764-b124-be52a775760c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:50:45.467068 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 755/1510] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:50:45 2022] DELETE /identity/v3/projects/315babedaa8d449ba692db50d76be173 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:50:54.847878 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=62 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:50:55.462894 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:52:14.230778 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d322ce9-2622-42a4-a686-441c60d02c60 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:52:14.231393 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d322ce9-2622-42a4-a686-441c60d02c60 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:52:14.231393 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d322ce9-2622-42a4-a686-441c60d02c60 None None] PATH_INFO: `/v3` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:52:14.232684 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 756/1511] 10.222.0.30 () {54 vars in 925 bytes} [Sun Aug 7 10:52:14 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:52:14.241104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012bd13-a382-420f-8928-f846fd3a46a5 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:52:14.241685 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012bd13-a382-420f-8928-f846fd3a46a5 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:52:14.242038 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012bd13-a382-420f-8928-f846fd3a46a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:52:14.325874 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-1012bd13-a382-420f-8928-f846fd3a46a5 None None] MFA Rules not processed for user `b33f797a9af946a4b296d973388891be`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:52:14.327126 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-1012bd13-a382-420f-8928-f846fd3a46a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:52:14.441478 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 756/1512] 10.222.0.30 () {58 vars in 1015 bytes} [Sun Aug 7 10:52:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:52:15.822693 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec531d2-bcdc-487e-bc45-d49f76304438 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:52:15.823244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec531d2-bcdc-487e-bc45-d49f76304438 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:52:15.823244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec531d2-bcdc-487e-bc45-d49f76304438 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:52:15.824589 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 757/1513] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 10:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:52:15.829541 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fa052-8828-425c-a110-67f738167c1d None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:52:15.829989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fa052-8828-425c-a110-67f738167c1d None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:52:15.830091 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fa052-8828-425c-a110-67f738167c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:52:15.887983 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-047fa052-8828-425c-a110-67f738167c1d None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:52:15.889173 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-047fa052-8828-425c-a110-67f738167c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:52:15.907837 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:52:15.965934 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 757/1514] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 10:52:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:52:16.117334 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec531d2-bcdc-487e-bc45-d49f76304438 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:52:16.119504 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-5ec531d2-bcdc-487e-bc45-d49f76304438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:52:16.224836 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec531d2-bcdc-487e-bc45-d49f76304438 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:52:16.230319 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45326b-608b-4423-a014-fbc61c2a5b05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:52:16.230916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45326b-608b-4423-a014-fbc61c2a5b05 service nova] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:52:16.231193 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45326b-608b-4423-a014-fbc61c2a5b05 service nova] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:52:16.231465 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45326b-608b-4423-a014-fbc61c2a5b05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:52:16.239471 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45326b-608b-4423-a014-fbc61c2a5b05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:52:16.241042 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45326b-608b-4423-a014-fbc61c2a5b05 service nova] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:52:16.250550 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 758/1515] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:52:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:52:17.111501 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb82bab-03f9-447e-a051-2b24a3e752e4 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:52:17.112070 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb82bab-03f9-447e-a051-2b24a3e752e4 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:52:17.112070 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb82bab-03f9-447e-a051-2b24a3e752e4 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:52:17.113401 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 758/1516] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 10:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:52:17.118301 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127d398-6520-48a8-bd7e-69c22e5907f0 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:52:17.118703 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127d398-6520-48a8-bd7e-69c22e5907f0 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:52:17.118836 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127d398-6520-48a8-bd7e-69c22e5907f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:52:17.138146 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-5127d398-6520-48a8-bd7e-69c22e5907f0 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:52:17.139309 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-5127d398-6520-48a8-bd7e-69c22e5907f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:52:17.147457 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 759/1517] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 10:52:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:52:17.309799 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb82bab-03f9-447e-a051-2b24a3e752e4 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:52:17.324270 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb82bab-03f9-447e-a051-2b24a3e752e4 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:52:17.329751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330e101-408b-49eb-adcf-bd51c94232da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:52:17.330365 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330e101-408b-49eb-adcf-bd51c94232da service nova] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:52:17.330637 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330e101-408b-49eb-adcf-bd51c94232da service nova] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:52:17.330905 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330e101-408b-49eb-adcf-bd51c94232da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:52:17.340616 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f330e101-408b-49eb-adcf-bd51c94232da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:52:17.342337 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f330e101-408b-49eb-adcf-bd51c94232da service nova] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:52:17.352715 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 759/1518] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:52:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:52:21.407595 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379603c9-67dd-4996-9ce6-93b03bfbf8d9 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:52:21.408074 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379603c9-67dd-4996-9ce6-93b03bfbf8d9 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:52:21.408074 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379603c9-67dd-4996-9ce6-93b03bfbf8d9 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:52:21.409456 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 760/1519] 10.222.0.27 () {54 vars in 961 bytes} [Sun Aug 7 10:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:52:21.414481 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270b13b-5217-4bee-ba46-74eeb6a6aaf0 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:52:21.414892 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270b13b-5217-4bee-ba46-74eeb6a6aaf0 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:52:21.414996 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270b13b-5217-4bee-ba46-74eeb6a6aaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:52:21.433845 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-5270b13b-5217-4bee-ba46-74eeb6a6aaf0 None None] MFA Rules not processed for user `b33f797a9af946a4b296d973388891be`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:52:21.435008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-5270b13b-5217-4bee-ba46-74eeb6a6aaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:52:21.443977 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 760/1520] 10.222.0.27 () {58 vars in 1058 bytes} [Sun Aug 7 10:52:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:52:21.451197 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379603c9-67dd-4996-9ce6-93b03bfbf8d9 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:52:21.465069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379603c9-67dd-4996-9ce6-93b03bfbf8d9 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:52:21.470034 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810885f-36f5-490a-89fc-87665fa8fe0b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b33f797a9af946a4b296d973388891be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:52:21.470604 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810885f-36f5-490a-89fc-87665fa8fe0b service placement] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:52:21.470879 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810885f-36f5-490a-89fc-87665fa8fe0b service placement] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:52:21.471145 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810885f-36f5-490a-89fc-87665fa8fe0b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:52:21.479164 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810885f-36f5-490a-89fc-87665fa8fe0b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:52:21.480715 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810885f-36f5-490a-89fc-87665fa8fe0b service placement] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:52:21.490081 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 761/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:52:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:52:28.572393 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ad7d5-a5ab-4415-b8ac-b2f6f886140b None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:52:28.572945 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ad7d5-a5ab-4415-b8ac-b2f6f886140b None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:52:28.572945 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ad7d5-a5ab-4415-b8ac-b2f6f886140b None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:52:28.574342 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 10:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:52:28.579230 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da719f5c-4378-4ff0-a2eb-ec40e87a73b2 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:52:28.579666 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da719f5c-4378-4ff0-a2eb-ec40e87a73b2 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:52:28.579775 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da719f5c-4378-4ff0-a2eb-ec40e87a73b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:52:28.599306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-da719f5c-4378-4ff0-a2eb-ec40e87a73b2 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:52:28.600472 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-da719f5c-4378-4ff0-a2eb-ec40e87a73b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:52:28.608417 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 10:52:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:52:28.765013 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ad7d5-a5ab-4415-b8ac-b2f6f886140b None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:52:28.779949 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ad7d5-a5ab-4415-b8ac-b2f6f886140b None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:52:28.785243 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471bb44-1434-49b1-953b-b137c7c903cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:52:28.785872 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471bb44-1434-49b1-953b-b137c7c903cf service nova] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:52:28.786146 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471bb44-1434-49b1-953b-b137c7c903cf service nova] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:52:28.786408 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471bb44-1434-49b1-953b-b137c7c903cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:52:28.794199 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471bb44-1434-49b1-953b-b137c7c903cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:52:28.795745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471bb44-1434-49b1-953b-b137c7c903cf service nova] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:52:28.805029 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 762/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:52:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:52:29.624201 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf15f51-c204-40aa-b59a-651c5eb1486f None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:52:29.624742 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf15f51-c204-40aa-b59a-651c5eb1486f None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:52:29.624742 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf15f51-c204-40aa-b59a-651c5eb1486f None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:52:29.626225 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 10:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:52:29.635555 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5df5ab-27b2-4856-8978-4d58d32c619d None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:52:29.636451 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5df5ab-27b2-4856-8978-4d58d32c619d None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:52:29.636956 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5df5ab-27b2-4856-8978-4d58d32c619d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:52:29.660331 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-ad5df5ab-27b2-4856-8978-4d58d32c619d None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:52:29.661632 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-ad5df5ab-27b2-4856-8978-4d58d32c619d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:52:29.670866 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 10:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:52:29.821673 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf15f51-c204-40aa-b59a-651c5eb1486f None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:52:29.836509 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf15f51-c204-40aa-b59a-651c5eb1486f None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:52:29.841889 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455b67f-4799-49c2-bb7c-78504697847d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:52:29.842467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455b67f-4799-49c2-bb7c-78504697847d service nova] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:52:29.842738 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455b67f-4799-49c2-bb7c-78504697847d service nova] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:52:29.843003 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455b67f-4799-49c2-bb7c-78504697847d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:52:29.850937 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455b67f-4799-49c2-bb7c-78504697847d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:52:29.852507 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455b67f-4799-49c2-bb7c-78504697847d service nova] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:52:29.861635 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 764/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:52:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:52:33.694875 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ed3a1-0493-484b-b39f-9fde124af898 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:52:33.695403 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ed3a1-0493-484b-b39f-9fde124af898 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:52:33.695403 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ed3a1-0493-484b-b39f-9fde124af898 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:52:33.696766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 10:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:52:33.701754 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceddd10-2230-4ce3-ac7f-450cd76caf0d None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:52:33.702152 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceddd10-2230-4ce3-ac7f-450cd76caf0d None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:52:33.702284 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceddd10-2230-4ce3-ac7f-450cd76caf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:52:33.720932 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-6ceddd10-2230-4ce3-ac7f-450cd76caf0d None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:52:33.722199 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-6ceddd10-2230-4ce3-ac7f-450cd76caf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:52:33.729833 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 10:52:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:52:33.803642 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ed3a1-0493-484b-b39f-9fde124af898 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:52:33.804940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-d45ed3a1-0493-484b-b39f-9fde124af898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:52:33.883538 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ed3a1-0493-484b-b39f-9fde124af898 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:52:33.887143 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ac5e5-1bee-4d96-abd9-ffca06a095ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:52:33.887736 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ac5e5-1bee-4d96-abd9-ffca06a095ea service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:52:33.888009 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ac5e5-1bee-4d96-abd9-ffca06a095ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:52:33.888275 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ac5e5-1bee-4d96-abd9-ffca06a095ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:52:33.897652 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ac5e5-1bee-4d96-abd9-ffca06a095ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:52:33.899158 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ac5e5-1bee-4d96-abd9-ffca06a095ea service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:52:33.908955 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 765/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:52:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:52:35.895526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1d482-d9c8-4f75-82c2-fccc41b89880 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:52:35.896102 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1d482-d9c8-4f75-82c2-fccc41b89880 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:52:35.896102 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1d482-d9c8-4f75-82c2-fccc41b89880 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:52:35.897440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 10:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:52:35.902519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00ef03-5c4f-42e7-a132-858be5401276 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:52:35.902945 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00ef03-5c4f-42e7-a132-858be5401276 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:52:35.903045 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00ef03-5c4f-42e7-a132-858be5401276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:52:35.922659 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-0a00ef03-5c4f-42e7-a132-858be5401276 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:52:35.923851 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-0a00ef03-5c4f-42e7-a132-858be5401276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:52:35.931605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 10:52:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:52:35.966646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1d482-d9c8-4f75-82c2-fccc41b89880 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:52:35.977817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1d482-d9c8-4f75-82c2-fccc41b89880 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:52:35.981263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe970e-e592-49ad-8ed3-f2051c988742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:52:35.981862 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe970e-e592-49ad-8ed3-f2051c988742 service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:52:35.982137 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe970e-e592-49ad-8ed3-f2051c988742 service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:52:35.982407 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe970e-e592-49ad-8ed3-f2051c988742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:52:35.991177 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe970e-e592-49ad-8ed3-f2051c988742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:52:35.992606 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe970e-e592-49ad-8ed3-f2051c988742 service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:52:36.004793 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 767/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:52:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:52:39.441704 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3aa14c-8ac6-430a-86bd-d5817ef024c0 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:52:39.442251 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3aa14c-8ac6-430a-86bd-d5817ef024c0 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:52:39.442251 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3aa14c-8ac6-430a-86bd-d5817ef024c0 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:52:39.443684 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 10:52:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:52:39.448795 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363fa18-f3d5-4f93-86d9-c8ef9d320a8a None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:52:39.449198 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363fa18-f3d5-4f93-86d9-c8ef9d320a8a None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:52:39.449354 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363fa18-f3d5-4f93-86d9-c8ef9d320a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:52:39.468725 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-4363fa18-f3d5-4f93-86d9-c8ef9d320a8a None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:52:39.469941 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-4363fa18-f3d5-4f93-86d9-c8ef9d320a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:52:39.477847 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 10:52:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:52:39.778366 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3aa14c-8ac6-430a-86bd-d5817ef024c0 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:52:39.780045 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-9a3aa14c-8ac6-430a-86bd-d5817ef024c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:52:39.826525 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:52:39.856284 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3aa14c-8ac6-430a-86bd-d5817ef024c0 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:52:39.859842 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54284b-e13c-4de4-9b93-7fe03ad26d6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:52:39.860431 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54284b-e13c-4de4-9b93-7fe03ad26d6c service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:52:39.860704 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54284b-e13c-4de4-9b93-7fe03ad26d6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:52:39.860972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54284b-e13c-4de4-9b93-7fe03ad26d6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:52:39.870158 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54284b-e13c-4de4-9b93-7fe03ad26d6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:52:39.871573 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54284b-e13c-4de4-9b93-7fe03ad26d6c service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:52:39.881761 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 768/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:52:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 10:52:41.880868 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d53952-16cd-4522-92f2-25d9c6a682d7 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:52:41.881446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d53952-16cd-4522-92f2-25d9c6a682d7 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:52:41.881446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d53952-16cd-4522-92f2-25d9c6a682d7 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:52:41.882782 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 10:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:52:41.887792 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611c434-4b28-40be-b0a1-724d7943a79f None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:52:41.888227 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611c434-4b28-40be-b0a1-724d7943a79f None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:52:41.888372 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611c434-4b28-40be-b0a1-724d7943a79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:52:41.907250 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-1611c434-4b28-40be-b0a1-724d7943a79f None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:52:41.908436 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-1611c434-4b28-40be-b0a1-724d7943a79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:52:41.916266 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 10:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:52:42.215029 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d53952-16cd-4522-92f2-25d9c6a682d7 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:52:42.216684 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a8d53952-16cd-4522-92f2-25d9c6a682d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:52:42.230042 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d53952-16cd-4522-92f2-25d9c6a682d7 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:52:42.233571 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a10910-8fd0-4117-a7d0-fea68e217066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:52:42.234145 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a10910-8fd0-4117-a7d0-fea68e217066 service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:52:42.234427 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a10910-8fd0-4117-a7d0-fea68e217066 service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:52:42.234695 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a10910-8fd0-4117-a7d0-fea68e217066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:52:42.243957 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a10910-8fd0-4117-a7d0-fea68e217066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:52:42.245415 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a10910-8fd0-4117-a7d0-fea68e217066 service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:52:42.254877 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 770/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:52:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:52:51.902571 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=18 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:52:52.250550 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=82 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:14.061638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f245f-04e3-442e-8942-ba4341815094 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:14.062291 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f245f-04e3-442e-8942-ba4341815094 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:14.062291 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f245f-04e3-442e-8942-ba4341815094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:14.090421 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-e09f245f-04e3-442e-8942-ba4341815094 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:14.091628 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-e09f245f-04e3-442e-8942-ba4341815094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:14.103062 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 770/1540] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:14.112442 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943de116-41b9-4ed3-9abc-5749d3d749fe None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:14.113010 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943de116-41b9-4ed3-9abc-5749d3d749fe None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:14.113010 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943de116-41b9-4ed3-9abc-5749d3d749fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:14.137038 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-943de116-41b9-4ed3-9abc-5749d3d749fe None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:14.138254 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-943de116-41b9-4ed3-9abc-5749d3d749fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:14.149086 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 771/1541] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:14.154299 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f245f-04e3-442e-8942-ba4341815094 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:14.167597 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f245f-04e3-442e-8942-ba4341815094 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:14.174245 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f31803-04eb-43b0-811d-0868839ffadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:14.174869 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f31803-04eb-43b0-811d-0868839ffadc admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:14.175144 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f31803-04eb-43b0-811d-0868839ffadc admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:14.175412 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f31803-04eb-43b0-811d-0868839ffadc admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:14.176076 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f31803-04eb-43b0-811d-0868839ffadc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:54:14.176372 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f31803-04eb-43b0-811d-0868839ffadc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:14.178073 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f31803-04eb-43b0-811d-0868839ffadc admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:14.199391 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 771/1542] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:54:14.208642 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943de116-41b9-4ed3-9abc-5749d3d749fe None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:14.218696 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943de116-41b9-4ed3-9abc-5749d3d749fe None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:14.230095 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132b02f-8199-4f89-bb7c-57ad3678c852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:14.231101 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132b02f-8199-4f89-bb7c-57ad3678c852 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:14.231743 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132b02f-8199-4f89-bb7c-57ad3678c852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:14.232235 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132b02f-8199-4f89-bb7c-57ad3678c852 admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:14.233203 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132b02f-8199-4f89-bb7c-57ad3678c852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:14.235425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132b02f-8199-4f89-bb7c-57ad3678c852 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:14.295578 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 772/1543] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:54:14 2022] POST /identity/v3/projects => generated 367 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:14.301071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f31803-04eb-43b0-811d-0868839ffadc admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:14.314848 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f31803-04eb-43b0-811d-0868839ffadc admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:14.337250 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65805718-2f81-4580-ae8f-b1f9844d62bd None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:14.337943 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65805718-2f81-4580-ae8f-b1f9844d62bd None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:14.338432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65805718-2f81-4580-ae8f-b1f9844d62bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:14.387493 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-65805718-2f81-4580-ae8f-b1f9844d62bd None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:14.388739 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-65805718-2f81-4580-ae8f-b1f9844d62bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:14.438668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7889443-da68-4f91-a2c5-b0414ef5edee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:14.439326 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7889443-da68-4f91-a2c5-b0414ef5edee admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:14.439610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7889443-da68-4f91-a2c5-b0414ef5edee admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:14.439885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7889443-da68-4f91-a2c5-b0414ef5edee admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:14.440617 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7889443-da68-4f91-a2c5-b0414ef5edee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:14.443572 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7889443-da68-4f91-a2c5-b0414ef5edee admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:14.494107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 772/1544] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:54:14 2022] POST /identity/v3/users => generated 284 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:14.501141 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7889443-da68-4f91-a2c5-b0414ef5edee admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:14.512435 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 773/1545] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:54:14.518653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7889443-da68-4f91-a2c5-b0414ef5edee admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:14.519752 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6781f-c5f0-4f93-8983-d00316f4764e None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:14.520042 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6781f-c5f0-4f93-8983-d00316f4764e None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:14.520315 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6781f-c5f0-4f93-8983-d00316f4764e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:14.532410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ceeadc-eac9-42e0-b84a-02857f1cf7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:14.533047 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ceeadc-eac9-42e0-b84a-02857f1cf7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:14.533342 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ceeadc-eac9-42e0-b84a-02857f1cf7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:14.533631 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ceeadc-eac9-42e0-b84a-02857f1cf7d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:14.534347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ceeadc-eac9-42e0-b84a-02857f1cf7d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:14.536002 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ceeadc-eac9-42e0-b84a-02857f1cf7d1 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:14.554730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 773/1546] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 10:54:14.556228 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5b695-5fe4-4b3f-89c0-007329ee650c None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:14.556518 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5b695-5fe4-4b3f-89c0-007329ee650c None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:14.556789 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5b695-5fe4-4b3f-89c0-007329ee650c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:14.559319 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-49e6781f-c5f0-4f93-8983-d00316f4764e None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:14.560675 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-49e6781f-c5f0-4f93-8983-d00316f4764e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:14.583698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 774/1547] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:54:14.586236 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6781f-c5f0-4f93-8983-d00316f4764e None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:14.595302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-05d5b695-5fe4-4b3f-89c0-007329ee650c None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:14.596542 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-05d5b695-5fe4-4b3f-89c0-007329ee650c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:14.607462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6781f-c5f0-4f93-8983-d00316f4764e None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:14.611277 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 774/1548] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:14.613705 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688506ed-77c1-4c71-95b7-a0f1a610d55f None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:14.613995 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688506ed-77c1-4c71-95b7-a0f1a610d55f None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:14.614267 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688506ed-77c1-4c71-95b7-a0f1a610d55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:14.621201 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f74d17-9669-4391-9dbf-d8f0c1290f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:14.622436 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f74d17-9669-4391-9dbf-d8f0c1290f4e admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:14.622723 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f74d17-9669-4391-9dbf-d8f0c1290f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:14.623002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f74d17-9669-4391-9dbf-d8f0c1290f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:14.623807 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f74d17-9669-4391-9dbf-d8f0c1290f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:14.625509 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f74d17-9669-4391-9dbf-d8f0c1290f4e admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:14.660121 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 775/1549] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:14.661804 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f74d17-9669-4391-9dbf-d8f0c1290f4e admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:14.669363 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-688506ed-77c1-4c71-95b7-a0f1a610d55f None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:14.673171 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-688506ed-77c1-4c71-95b7-a0f1a610d55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:14.678735 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f74d17-9669-4391-9dbf-d8f0c1290f4e admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:14.690214 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a5827-e0c1-41f7-9a9b-1561ff956a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:14.691270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a5827-e0c1-41f7-9a9b-1561ff956a9d admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:14.691936 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 775/1550] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:14.692450 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a5827-e0c1-41f7-9a9b-1561ff956a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:14.693472 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a5827-e0c1-41f7-9a9b-1561ff956a9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:14.694591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a5827-e0c1-41f7-9a9b-1561ff956a9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:54:14.695525 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa57da1-d0ce-4184-8263-2b89f1b7e414 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:14.695994 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a5827-e0c1-41f7-9a9b-1561ff956a9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:14.696425 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa57da1-d0ce-4184-8263-2b89f1b7e414 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:14.697646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: WARNING py.warnings [None req-1b2a5827-e0c1-41f7-9a9b-1561ff956a9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 10:54:14.697646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: warnings.warn(msg) Aug 07 10:54:14.697646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: Aug 07 10:54:14.698309 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa57da1-d0ce-4184-8263-2b89f1b7e414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:14.701889 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a5827-e0c1-41f7-9a9b-1561ff956a9d admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:14.727911 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 776/1551] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:54:14.729598 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09714a5-c65e-4f13-82f4-2c8e23254345 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:14.730046 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09714a5-c65e-4f13-82f4-2c8e23254345 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:14.730546 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09714a5-c65e-4f13-82f4-2c8e23254345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:14.730906 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-cfa57da1-d0ce-4184-8263-2b89f1b7e414 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:14.732133 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-cfa57da1-d0ce-4184-8263-2b89f1b7e414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:14.741294 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 776/1552] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:14.742159 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa57da1-d0ce-4184-8263-2b89f1b7e414 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:14.754921 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa57da1-d0ce-4184-8263-2b89f1b7e414 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:14.756905 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-a09714a5-c65e-4f13-82f4-2c8e23254345 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:14.758130 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a09714a5-c65e-4f13-82f4-2c8e23254345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:14.760400 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63a523-abae-4827-bf28-207e740132a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:14.761071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63a523-abae-4827-bf28-207e740132a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:14.761402 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63a523-abae-4827-bf28-207e740132a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:14.761683 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63a523-abae-4827-bf28-207e740132a6 admin admin] PATH_INFO: `/v3/projects/538a7990320f43408a5c073ec08cf228/users/b4a6bab9e8d54454a50ee76b03a24cde/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:14.767042 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 777/1553] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:14.768243 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824598e-0288-4431-a6f4-488ca2338465 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:14.768533 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824598e-0288-4431-a6f4-488ca2338465 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:14.768803 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824598e-0288-4431-a6f4-488ca2338465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:14.779840 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63a523-abae-4827-bf28-207e740132a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=538a7990320f43408a5c073ec08cf228, user_id=b4a6bab9e8d54454a50ee76b03a24cde, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:14.780880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: WARNING py.warnings [None req-2d63a523-abae-4827-bf28-207e740132a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 10:54:14.780880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: warnings.warn(msg) Aug 07 10:54:14.780880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: Aug 07 10:54:14.783389 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63a523-abae-4827-bf28-207e740132a6 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:14.792974 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-e824598e-0288-4431-a6f4-488ca2338465 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:14.794269 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-e824598e-0288-4431-a6f4-488ca2338465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:14.805353 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 777/1554] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:54:14 2022] PUT /identity/v3/projects/538a7990320f43408a5c073ec08cf228/users/b4a6bab9e8d54454a50ee76b03a24cde/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:14.805353 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa689bc-9bff-4c3d-94f7-6d64ce14b91c None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:14.805353 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa689bc-9bff-4c3d-94f7-6d64ce14b91c None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:14.805353 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa689bc-9bff-4c3d-94f7-6d64ce14b91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:14.831896 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-7fa689bc-9bff-4c3d-94f7-6d64ce14b91c None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:14.833104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-7fa689bc-9bff-4c3d-94f7-6d64ce14b91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:14.867925 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 778/1555] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:14.869025 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824598e-0288-4431-a6f4-488ca2338465 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:14.878707 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824598e-0288-4431-a6f4-488ca2338465 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:14.884062 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70af72-b4c3-47a7-8983-22b280285659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:14.884648 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70af72-b4c3-47a7-8983-22b280285659 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:14.884929 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70af72-b4c3-47a7-8983-22b280285659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:14.885203 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70af72-b4c3-47a7-8983-22b280285659 admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:14.885859 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e70af72-b4c3-47a7-8983-22b280285659 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:14.888003 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e70af72-b4c3-47a7-8983-22b280285659 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:14.892452 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 778/1556] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:14.893746 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1f9e9-1ea8-4a0a-b028-f8d71a5b56dd None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:14.894032 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1f9e9-1ea8-4a0a-b028-f8d71a5b56dd None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:14.894526 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1f9e9-1ea8-4a0a-b028-f8d71a5b56dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:14.917247 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-fda1f9e9-1ea8-4a0a-b028-f8d71a5b56dd None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:14.918503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-fda1f9e9-1ea8-4a0a-b028-f8d71a5b56dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:14.919084 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 779/1557] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:54:14 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:14.920403 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f69863-a376-4aeb-8643-dd7e17d1bfb4 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:14.920691 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f69863-a376-4aeb-8643-dd7e17d1bfb4 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:14.920962 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f69863-a376-4aeb-8643-dd7e17d1bfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:14.928872 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:14.929466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:14.943187 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-94f69863-a376-4aeb-8643-dd7e17d1bfb4 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:14.945239 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-94f69863-a376-4aeb-8643-dd7e17d1bfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:14.987880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 779/1558] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:14.989111 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1f9e9-1ea8-4a0a-b028-f8d71a5b56dd None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:14.999287 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1f9e9-1ea8-4a0a-b028-f8d71a5b56dd None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:15.004766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17fe399-de84-42ca-8207-da1eb6932965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:15.005404 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fe399-de84-42ca-8207-da1eb6932965 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:15.005704 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fe399-de84-42ca-8207-da1eb6932965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:15.005983 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fe399-de84-42ca-8207-da1eb6932965 admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:15.006665 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17fe399-de84-42ca-8207-da1eb6932965 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:54:15.006992 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17fe399-de84-42ca-8207-da1eb6932965 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:15.008640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17fe399-de84-42ca-8207-da1eb6932965 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:15.017347 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 780/1559] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:15.021217 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f59996-767b-44d9-90f2-74b3a47b96ab None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:15.021217 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f59996-767b-44d9-90f2-74b3a47b96ab None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:15.021217 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f59996-767b-44d9-90f2-74b3a47b96ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:15.025146 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 780/1560] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:54:15.026544 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c850b-4c82-429a-9ac3-8919329119a5 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:15.026851 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c850b-4c82-429a-9ac3-8919329119a5 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:15.027150 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c850b-4c82-429a-9ac3-8919329119a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:15.047042 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-8f9c850b-4c82-429a-9ac3-8919329119a5 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:15.048368 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-8f9c850b-4c82-429a-9ac3-8919329119a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:15.054072 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-51f59996-767b-44d9-90f2-74b3a47b96ab None None] MFA Rules not processed for user `b4a6bab9e8d54454a50ee76b03a24cde`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:15.055226 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-51f59996-767b-44d9-90f2-74b3a47b96ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:15.056666 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 781/1561] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:15.061619 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c850b-4c82-429a-9ac3-8919329119a5 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:15.068348 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9c850b-4c82-429a-9ac3-8919329119a5 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:15.074068 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88626218-3fba-4f9c-9ff5-d32f4668aa0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:15.074736 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88626218-3fba-4f9c-9ff5-d32f4668aa0d admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:15.075088 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88626218-3fba-4f9c-9ff5-d32f4668aa0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:15.075440 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88626218-3fba-4f9c-9ff5-d32f4668aa0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:15.076161 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88626218-3fba-4f9c-9ff5-d32f4668aa0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:54:15.076467 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88626218-3fba-4f9c-9ff5-d32f4668aa0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:15.078092 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88626218-3fba-4f9c-9ff5-d32f4668aa0d admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:15.095719 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 782/1562] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:54:15.095719 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90948f90-18a0-4f7e-b0c2-4e5b9dad7286 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:15.095719 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90948f90-18a0-4f7e-b0c2-4e5b9dad7286 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:15.095719 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90948f90-18a0-4f7e-b0c2-4e5b9dad7286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:15.113519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-90948f90-18a0-4f7e-b0c2-4e5b9dad7286 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:15.114763 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-90948f90-18a0-4f7e-b0c2-4e5b9dad7286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:15.123069 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 783/1563] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:15.123740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90948f90-18a0-4f7e-b0c2-4e5b9dad7286 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:15.132143 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 781/1564] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:15.133375 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90948f90-18a0-4f7e-b0c2-4e5b9dad7286 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:15.133507 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf3397-c1e3-483d-8e57-086a57ceef45 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:15.133763 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf3397-c1e3-483d-8e57-086a57ceef45 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:15.134033 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf3397-c1e3-483d-8e57-086a57ceef45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:15.140283 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3561634-188a-4ac9-8780-537cea7824ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:15.140869 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3561634-188a-4ac9-8780-537cea7824ec admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:15.141146 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3561634-188a-4ac9-8780-537cea7824ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:15.141451 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3561634-188a-4ac9-8780-537cea7824ec admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:15.142070 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3561634-188a-4ac9-8780-537cea7824ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:15.143957 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3561634-188a-4ac9-8780-537cea7824ec admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:15.153880 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-ecbf3397-c1e3-483d-8e57-086a57ceef45 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:15.155255 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ecbf3397-c1e3-483d-8e57-086a57ceef45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:15.164940 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 782/1565] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:15.165824 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf3397-c1e3-483d-8e57-086a57ceef45 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:15.167683 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 784/1566] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:54:15 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:15.170225 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3561634-188a-4ac9-8780-537cea7824ec admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:15.175977 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf3397-c1e3-483d-8e57-086a57ceef45 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:15.181027 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3561634-188a-4ac9-8780-537cea7824ec admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:15.181160 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782546e7-62ea-4c99-a582-b5c24fdaa203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:15.181765 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782546e7-62ea-4c99-a582-b5c24fdaa203 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:15.182043 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782546e7-62ea-4c99-a582-b5c24fdaa203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:15.182321 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782546e7-62ea-4c99-a582-b5c24fdaa203 admin admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:15.182970 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782546e7-62ea-4c99-a582-b5c24fdaa203 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:54:15.183276 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782546e7-62ea-4c99-a582-b5c24fdaa203 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:15.184856 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782546e7-62ea-4c99-a582-b5c24fdaa203 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:15.186043 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c75a5-cda8-4949-907f-12f05ff1361e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:15.186630 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c75a5-cda8-4949-907f-12f05ff1361e admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:15.186904 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c75a5-cda8-4949-907f-12f05ff1361e admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:15.187178 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c75a5-cda8-4949-907f-12f05ff1361e admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:15.187791 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c75a5-cda8-4949-907f-12f05ff1361e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:15.188820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: WARNING py.warnings [None req-2e8c75a5-cda8-4949-907f-12f05ff1361e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 10:54:15.188820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: warnings.warn(msg) Aug 07 10:54:15.188820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: Aug 07 10:54:15.190078 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c75a5-cda8-4949-907f-12f05ff1361e admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:15.197398 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 783/1567] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:54:15.198757 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f2d8d-e6c9-4961-a321-111952b84ded None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:15.199042 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f2d8d-e6c9-4961-a321-111952b84ded None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:15.199314 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f2d8d-e6c9-4961-a321-111952b84ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:15.218054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-924f2d8d-e6c9-4961-a321-111952b84ded None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:15.219238 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-924f2d8d-e6c9-4961-a321-111952b84ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:15.224473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 785/1568] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:54:15 2022] POST /identity/v3/projects => generated 389 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:15.225276 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c75a5-cda8-4949-907f-12f05ff1361e admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:15.227070 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 784/1569] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:15.227838 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f2d8d-e6c9-4961-a321-111952b84ded None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:15.236884 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f2d8d-e6c9-4961-a321-111952b84ded None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:15.299161 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c75a5-cda8-4949-907f-12f05ff1361e admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:15.302408 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5b410-471d-480b-9b84-984c59ea11c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:15.303048 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5b410-471d-480b-9b84-984c59ea11c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:15.303331 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5b410-471d-480b-9b84-984c59ea11c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:15.303627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5b410-471d-480b-9b84-984c59ea11c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:15.304401 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5b410-471d-480b-9b84-984c59ea11c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:54:15.304703 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771db75d-b964-4298-9a57-241adfa24c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:15.304854 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5b410-471d-480b-9b84-984c59ea11c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:15.305299 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771db75d-b964-4298-9a57-241adfa24c44 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:15.305606 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771db75d-b964-4298-9a57-241adfa24c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:15.305873 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771db75d-b964-4298-9a57-241adfa24c44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:15.306529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771db75d-b964-4298-9a57-241adfa24c44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:15.307102 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5b410-471d-480b-9b84-984c59ea11c0 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:15.308414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771db75d-b964-4298-9a57-241adfa24c44 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:15.321945 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 785/1570] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:54:15.323153 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5b410-471d-480b-9b84-984c59ea11c0 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:15.327523 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:15.346740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 786/1571] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:54:15 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:15.347664 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771db75d-b964-4298-9a57-241adfa24c44 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:15.373997 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:15.388085 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5b410-471d-480b-9b84-984c59ea11c0 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:15.413821 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771db75d-b964-4298-9a57-241adfa24c44 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:15.418593 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc766eeb-c69b-4b15-b0d2-252e854664a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:15.419193 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc766eeb-c69b-4b15-b0d2-252e854664a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:15.419470 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc766eeb-c69b-4b15-b0d2-252e854664a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:15.419736 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc766eeb-c69b-4b15-b0d2-252e854664a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:15.420372 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc766eeb-c69b-4b15-b0d2-252e854664a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:54:15.420807 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc766eeb-c69b-4b15-b0d2-252e854664a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:15.422468 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc766eeb-c69b-4b15-b0d2-252e854664a9 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:15.434780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 787/1572] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:54:15.435691 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc766eeb-c69b-4b15-b0d2-252e854664a9 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:15.436782 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e034d3b-c275-4964-8082-d86c3aeb855d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:15.437410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e034d3b-c275-4964-8082-d86c3aeb855d service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:15.437687 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e034d3b-c275-4964-8082-d86c3aeb855d service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:15.437953 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e034d3b-c275-4964-8082-d86c3aeb855d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:15.445645 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc766eeb-c69b-4b15-b0d2-252e854664a9 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:15.450300 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac674e-c17c-4300-8cb2-59f6c0820f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:15.450869 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac674e-c17c-4300-8cb2-59f6c0820f8c admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:15.451147 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac674e-c17c-4300-8cb2-59f6c0820f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:15.451418 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac674e-c17c-4300-8cb2-59f6c0820f8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:15.452074 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac674e-c17c-4300-8cb2-59f6c0820f8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:15.453671 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac674e-c17c-4300-8cb2-59f6c0820f8c admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:15.463366 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 788/1573] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:15.464824 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac674e-c17c-4300-8cb2-59f6c0820f8c admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:15.476028 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac674e-c17c-4300-8cb2-59f6c0820f8c admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:15.480787 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d435a67-51ec-4b54-80a1-534fe633ac63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:15.481873 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d435a67-51ec-4b54-80a1-534fe633ac63 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:15.482158 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d435a67-51ec-4b54-80a1-534fe633ac63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:15.482767 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d435a67-51ec-4b54-80a1-534fe633ac63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:15.483457 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d435a67-51ec-4b54-80a1-534fe633ac63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:15.485502 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d435a67-51ec-4b54-80a1-534fe633ac63 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:15.496753 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e034d3b-c275-4964-8082-d86c3aeb855d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:15.498322 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e034d3b-c275-4964-8082-d86c3aeb855d service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:15.508190 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 786/1574] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:15.508977 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e034d3b-c275-4964-8082-d86c3aeb855d service cinder] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:15.515668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 789/1575] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:54:15 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:15.516498 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d435a67-51ec-4b54-80a1-534fe633ac63 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:15.521684 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e034d3b-c275-4964-8082-d86c3aeb855d service cinder] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:15.584254 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d435a67-51ec-4b54-80a1-534fe633ac63 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:15.586084 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7c6f0-e173-48d9-82f5-196cf876ab3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:15.587086 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7c6f0-e173-48d9-82f5-196cf876ab3a admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:15.587518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7c6f0-e173-48d9-82f5-196cf876ab3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:15.587961 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7c6f0-e173-48d9-82f5-196cf876ab3a admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:15.588655 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7c6f0-e173-48d9-82f5-196cf876ab3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:15.589819 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f3fd0-99a8-4501-8e1f-c9e3ecdd107c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:15.590086 dv-cinder-850320-3-smb devstack@keystone.service[80145]: WARNING py.warnings [None req-2ce7c6f0-e173-48d9-82f5-196cf876ab3a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 10:54:15.590086 dv-cinder-850320-3-smb devstack@keystone.service[80145]: warnings.warn(msg) Aug 07 10:54:15.590086 dv-cinder-850320-3-smb devstack@keystone.service[80145]: Aug 07 10:54:15.590422 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f3fd0-99a8-4501-8e1f-c9e3ecdd107c admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:15.590703 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f3fd0-99a8-4501-8e1f-c9e3ecdd107c admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:15.591094 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f3fd0-99a8-4501-8e1f-c9e3ecdd107c admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:15.591671 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7c6f0-e173-48d9-82f5-196cf876ab3a admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:15.591779 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f3fd0-99a8-4501-8e1f-c9e3ecdd107c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:54:15.592039 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f3fd0-99a8-4501-8e1f-c9e3ecdd107c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:15.593641 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f3fd0-99a8-4501-8e1f-c9e3ecdd107c admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:15.607753 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 790/1576] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:54:15.607753 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f3fd0-99a8-4501-8e1f-c9e3ecdd107c admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:15.617944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f3fd0-99a8-4501-8e1f-c9e3ecdd107c admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:15.621722 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 787/1577] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:54:15 2022] POST /identity/v3/users => generated 295 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:15.622752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870df0cf-dbd2-4db7-9e91-7df7954057ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:15.623041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7c6f0-e173-48d9-82f5-196cf876ab3a admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:15.623357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870df0cf-dbd2-4db7-9e91-7df7954057ee admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:15.623636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870df0cf-dbd2-4db7-9e91-7df7954057ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:15.623905 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870df0cf-dbd2-4db7-9e91-7df7954057ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:15.624584 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870df0cf-dbd2-4db7-9e91-7df7954057ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:15.626576 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870df0cf-dbd2-4db7-9e91-7df7954057ee admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:15.630543 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:15.637426 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7c6f0-e173-48d9-82f5-196cf876ab3a admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:15.644693 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7f6e8-7f2a-4762-972e-80b529748321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:15.645602 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7f6e8-7f2a-4762-972e-80b529748321 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:15.645890 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7f6e8-7f2a-4762-972e-80b529748321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:15.646161 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7f6e8-7f2a-4762-972e-80b529748321 admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:15.646814 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7f6e8-7f2a-4762-972e-80b529748321 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:15.650112 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7f6e8-7f2a-4762-972e-80b529748321 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:15.660270 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 791/1578] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:54:15 2022] POST /identity/v3/projects => generated 363 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:15.662102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870df0cf-dbd2-4db7-9e91-7df7954057ee admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:15.675193 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 788/1579] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:54:15 2022] POST /identity/v3/users => generated 293 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:15.676062 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7f6e8-7f2a-4762-972e-80b529748321 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:15.686285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7f6e8-7f2a-4762-972e-80b529748321 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:15.732263 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:15.738445 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870df0cf-dbd2-4db7-9e91-7df7954057ee admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:15.744517 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadf24e-174f-4eb2-9508-ccc0181671d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:15.745120 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadf24e-174f-4eb2-9508-ccc0181671d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:15.745435 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadf24e-174f-4eb2-9508-ccc0181671d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:15.745704 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadf24e-174f-4eb2-9508-ccc0181671d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:15.746324 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadf24e-174f-4eb2-9508-ccc0181671d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:15.748333 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadf24e-174f-4eb2-9508-ccc0181671d1 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:15.751492 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695129d-6a3b-4585-9436-30c0407652d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:15.752101 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695129d-6a3b-4585-9436-30c0407652d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:15.752378 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695129d-6a3b-4585-9436-30c0407652d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:15.752825 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695129d-6a3b-4585-9436-30c0407652d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:15.753750 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695129d-6a3b-4585-9436-30c0407652d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:15.755366 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695129d-6a3b-4585-9436-30c0407652d5 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:15.770700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 789/1580] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:15.770700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695129d-6a3b-4585-9436-30c0407652d5 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:15.781870 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 792/1581] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:54:15 2022] POST /identity/v3/projects => generated 393 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:15.782065 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695129d-6a3b-4585-9436-30c0407652d5 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:15.782886 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadf24e-174f-4eb2-9508-ccc0181671d1 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:15.854602 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d28802-503b-42b0-a226-ba4713440e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:15.854893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadf24e-174f-4eb2-9508-ccc0181671d1 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:15.855355 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d28802-503b-42b0-a226-ba4713440e00 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:15.855698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d28802-503b-42b0-a226-ba4713440e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:15.856033 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d28802-503b-42b0-a226-ba4713440e00 admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:15.856723 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d28802-503b-42b0-a226-ba4713440e00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:15.858737 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d28802-503b-42b0-a226-ba4713440e00 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:15.861156 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598261d1-af06-4083-94f3-6a3c553b4f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:15.862182 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598261d1-af06-4083-94f3-6a3c553b4f14 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:15.862497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598261d1-af06-4083-94f3-6a3c553b4f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:15.862800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598261d1-af06-4083-94f3-6a3c553b4f14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:15.863614 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598261d1-af06-4083-94f3-6a3c553b4f14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:15.866539 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598261d1-af06-4083-94f3-6a3c553b4f14 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:15.885216 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 790/1582] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:54:15 2022] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:15.885216 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d28802-503b-42b0-a226-ba4713440e00 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:15.893750 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d28802-503b-42b0-a226-ba4713440e00 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:15.899919 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e5dd4-2321-49ba-ad43-acaf7d6379b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:15.900993 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e5dd4-2321-49ba-ad43-acaf7d6379b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:15.901501 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e5dd4-2321-49ba-ad43-acaf7d6379b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:15.901956 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e5dd4-2321-49ba-ad43-acaf7d6379b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:15.902804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 793/1583] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:54:15 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:15.903096 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e5dd4-2321-49ba-ad43-acaf7d6379b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:15.903799 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598261d1-af06-4083-94f3-6a3c553b4f14 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:15.905261 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e5dd4-2321-49ba-ad43-acaf7d6379b1 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:15.921774 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 791/1584] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:15.921774 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e5dd4-2321-49ba-ad43-acaf7d6379b1 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:15.929741 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e5dd4-2321-49ba-ad43-acaf7d6379b1 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:15.978980 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598261d1-af06-4083-94f3-6a3c553b4f14 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:15.984656 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957e374-48bc-4c5f-9d50-9b6221b9fc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:15.985685 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957e374-48bc-4c5f-9d50-9b6221b9fc89 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:15.985685 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957e374-48bc-4c5f-9d50-9b6221b9fc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:15.986149 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957e374-48bc-4c5f-9d50-9b6221b9fc89 admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:15.986949 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957e374-48bc-4c5f-9d50-9b6221b9fc89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:15.989207 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957e374-48bc-4c5f-9d50-9b6221b9fc89 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:15.993138 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78234ffb-f685-4b44-9396-24f2aaf31bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:15.994087 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78234ffb-f685-4b44-9396-24f2aaf31bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:15.994469 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78234ffb-f685-4b44-9396-24f2aaf31bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:15.994846 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78234ffb-f685-4b44-9396-24f2aaf31bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:15.995923 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78234ffb-f685-4b44-9396-24f2aaf31bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:15.997705 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78234ffb-f685-4b44-9396-24f2aaf31bc8 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:15.999719 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:16.018650 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 794/1585] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:54:15 2022] POST /identity/v3/users => generated 282 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:16.018650 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957e374-48bc-4c5f-9d50-9b6221b9fc89 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:16.019383 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 792/1586] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:16.020475 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78234ffb-f685-4b44-9396-24f2aaf31bc8 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:16.032649 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957e374-48bc-4c5f-9d50-9b6221b9fc89 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:16.034197 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78234ffb-f685-4b44-9396-24f2aaf31bc8 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:16.050752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ead8ad-c713-41a9-8b74-e71e110729f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:16.051318 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ead8ad-c713-41a9-8b74-e71e110729f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:16.051601 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ead8ad-c713-41a9-8b74-e71e110729f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:16.051879 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ead8ad-c713-41a9-8b74-e71e110729f4 admin admin] PATH_INFO: `/v3/projects/c1d2fff06d694d3ca4b3692199fa9f78/users/cba1a3bf0e1f49e885e4c833549be406/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:16.052164 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a488b3-f29f-4803-9ecf-f425c3df9a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:16.053877 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a488b3-f29f-4803-9ecf-f425c3df9a2a admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:16.054155 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a488b3-f29f-4803-9ecf-f425c3df9a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:16.054399 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a488b3-f29f-4803-9ecf-f425c3df9a2a admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:16.055206 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a488b3-f29f-4803-9ecf-f425c3df9a2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:16.057193 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a488b3-f29f-4803-9ecf-f425c3df9a2a admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:16.068553 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ead8ad-c713-41a9-8b74-e71e110729f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1d2fff06d694d3ca4b3692199fa9f78, user_id=cba1a3bf0e1f49e885e4c833549be406, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:16.071409 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ead8ad-c713-41a9-8b74-e71e110729f4 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:16.091469 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 793/1587] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:54:16 2022] POST /identity/v3/users => generated 297 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:16.091469 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a488b3-f29f-4803-9ecf-f425c3df9a2a admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:16.095355 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 795/1588] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:54:16 2022] PUT /identity/v3/projects/c1d2fff06d694d3ca4b3692199fa9f78/users/cba1a3bf0e1f49e885e4c833549be406/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:16.096476 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ead8ad-c713-41a9-8b74-e71e110729f4 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:16.104453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a488b3-f29f-4803-9ecf-f425c3df9a2a admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:16.155353 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:16.185258 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca7890-bf9f-4185-ba46-f306f841e930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:16.185912 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca7890-bf9f-4185-ba46-f306f841e930 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:16.186205 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca7890-bf9f-4185-ba46-f306f841e930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:16.186462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca7890-bf9f-4185-ba46-f306f841e930 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:16.187147 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca7890-bf9f-4185-ba46-f306f841e930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:16.188795 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca7890-bf9f-4185-ba46-f306f841e930 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:16.194944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ead8ad-c713-41a9-8b74-e71e110729f4 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:16.200174 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 794/1589] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:16.200945 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a84fe1-b7a2-4d41-a155-85ef6a8e0161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:16.201688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a84fe1-b7a2-4d41-a155-85ef6a8e0161 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:16.202076 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a84fe1-b7a2-4d41-a155-85ef6a8e0161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:16.202445 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a84fe1-b7a2-4d41-a155-85ef6a8e0161 admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:16.203181 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a84fe1-b7a2-4d41-a155-85ef6a8e0161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:16.203906 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca7890-bf9f-4185-ba46-f306f841e930 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:16.205441 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a84fe1-b7a2-4d41-a155-85ef6a8e0161 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:16.214289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca7890-bf9f-4185-ba46-f306f841e930 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:16.221629 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8b956-478b-4160-80e4-7717a4ba34f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:16.222248 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8b956-478b-4160-80e4-7717a4ba34f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:16.222620 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8b956-478b-4160-80e4-7717a4ba34f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:16.222908 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8b956-478b-4160-80e4-7717a4ba34f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:16.223574 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8b956-478b-4160-80e4-7717a4ba34f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:16.225324 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8b956-478b-4160-80e4-7717a4ba34f7 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:16.234880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 796/1590] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:54:16 2022] POST /identity/v3/users => generated 290 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:16.234880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a84fe1-b7a2-4d41-a155-85ef6a8e0161 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:16.240846 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 795/1591] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:16.240846 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8b956-478b-4160-80e4-7717a4ba34f7 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:16.246530 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a84fe1-b7a2-4d41-a155-85ef6a8e0161 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:16.251579 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50bacf-98f1-490c-9063-a7c72089304c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:16.251818 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8b956-478b-4160-80e4-7717a4ba34f7 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:16.252171 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50bacf-98f1-490c-9063-a7c72089304c admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:16.252456 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50bacf-98f1-490c-9063-a7c72089304c admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:16.252845 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50bacf-98f1-490c-9063-a7c72089304c admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:16.253772 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50bacf-98f1-490c-9063-a7c72089304c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:16.255558 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50bacf-98f1-490c-9063-a7c72089304c admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:16.257615 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6fa20e-c62d-4612-8011-71601bfd8c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:16.258217 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fa20e-c62d-4612-8011-71601bfd8c3b admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:16.258499 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fa20e-c62d-4612-8011-71601bfd8c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:16.259084 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fa20e-c62d-4612-8011-71601bfd8c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:16.259443 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6fa20e-c62d-4612-8011-71601bfd8c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:16.261036 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6fa20e-c62d-4612-8011-71601bfd8c3b admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:16.268110 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 797/1592] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:16.269022 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50bacf-98f1-490c-9063-a7c72089304c admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:16.274791 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 796/1593] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:16.279137 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafa10b-8af4-4afe-9832-af9eab9a4be7 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:16.279408 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafa10b-8af4-4afe-9832-af9eab9a4be7 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:16.279719 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafa10b-8af4-4afe-9832-af9eab9a4be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:16.279851 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50bacf-98f1-490c-9063-a7c72089304c admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:16.284523 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cba20e-200c-4cee-ad07-6e1ce9437a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:16.285109 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cba20e-200c-4cee-ad07-6e1ce9437a8d admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:16.285419 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cba20e-200c-4cee-ad07-6e1ce9437a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:16.285698 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cba20e-200c-4cee-ad07-6e1ce9437a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:16.286338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cba20e-200c-4cee-ad07-6e1ce9437a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:16.288408 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cba20e-200c-4cee-ad07-6e1ce9437a8d admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:16.298908 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-ccafa10b-8af4-4afe-9832-af9eab9a4be7 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:16.299497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 798/1594] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:16.300116 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ccafa10b-8af4-4afe-9832-af9eab9a4be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:16.300430 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cba20e-200c-4cee-ad07-6e1ce9437a8d admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:16.308401 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 797/1595] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:16.309186 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccafa10b-8af4-4afe-9832-af9eab9a4be7 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:16.311351 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cba20e-200c-4cee-ad07-6e1ce9437a8d admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:16.318304 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29989e-9e73-48d2-9bdf-ae122328381e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:16.318454 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccafa10b-8af4-4afe-9832-af9eab9a4be7 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:16.318921 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29989e-9e73-48d2-9bdf-ae122328381e admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:16.319194 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29989e-9e73-48d2-9bdf-ae122328381e admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:16.319457 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29989e-9e73-48d2-9bdf-ae122328381e admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:16.320084 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29989e-9e73-48d2-9bdf-ae122328381e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:16.321746 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29989e-9e73-48d2-9bdf-ae122328381e admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:16.323114 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e49d9-bbb1-4f35-a83b-c65d15bfefa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:16.324005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e49d9-bbb1-4f35-a83b-c65d15bfefa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:16.324005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e49d9-bbb1-4f35-a83b-c65d15bfefa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:16.324208 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e49d9-bbb1-4f35-a83b-c65d15bfefa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:16.324850 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e49d9-bbb1-4f35-a83b-c65d15bfefa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:16.326448 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e49d9-bbb1-4f35-a83b-c65d15bfefa5 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:16.333146 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 799/1596] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:16.334329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29989e-9e73-48d2-9bdf-ae122328381e admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:16.336558 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 798/1597] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:16.338257 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e49d9-bbb1-4f35-a83b-c65d15bfefa5 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:16.348973 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e49d9-bbb1-4f35-a83b-c65d15bfefa5 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:16.349189 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29989e-9e73-48d2-9bdf-ae122328381e admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:16.354241 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a8589-0f45-4d2a-87bf-440d961304a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:16.354505 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1851b-af05-42ac-a885-2929fa761f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:16.354884 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a8589-0f45-4d2a-87bf-440d961304a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:16.355166 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a8589-0f45-4d2a-87bf-440d961304a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:16.355270 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1851b-af05-42ac-a885-2929fa761f38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:16.355445 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a8589-0f45-4d2a-87bf-440d961304a7 admin admin] PATH_INFO: `/v3/projects/3cb7bd62e83f4aff82c8543a83867128/users/f0c185ca1ea144dfbb74886bec8f8e29/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:16.355549 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1851b-af05-42ac-a885-2929fa761f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:16.355709 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1851b-af05-42ac-a885-2929fa761f38 admin admin] PATH_INFO: `/v3/projects/398d222dff9a41ce9b5340145bcf61b2/users/ca2075ca15d44405a71e24955ec99da4/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:16.371134 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a8589-0f45-4d2a-87bf-440d961304a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cb7bd62e83f4aff82c8543a83867128, user_id=f0c185ca1ea144dfbb74886bec8f8e29, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:16.371300 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc1851b-af05-42ac-a885-2929fa761f38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=398d222dff9a41ce9b5340145bcf61b2, user_id=ca2075ca15d44405a71e24955ec99da4, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:16.373894 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a8589-0f45-4d2a-87bf-440d961304a7 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:16.374014 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc1851b-af05-42ac-a885-2929fa761f38 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:16.396480 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 800/1598] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:54:16 2022] PUT /identity/v3/projects/398d222dff9a41ce9b5340145bcf61b2/users/ca2075ca15d44405a71e24955ec99da4/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:16.396973 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 799/1599] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:54:16 2022] PUT /identity/v3/projects/3cb7bd62e83f4aff82c8543a83867128/users/f0c185ca1ea144dfbb74886bec8f8e29/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:16.397074 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1851b-af05-42ac-a885-2929fa761f38 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:16.397174 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a8589-0f45-4d2a-87bf-440d961304a7 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:16.457386 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a8589-0f45-4d2a-87bf-440d961304a7 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:16.458237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1851b-af05-42ac-a885-2929fa761f38 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:16.462096 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e3e7e-9c7e-4f98-a087-5a56828cbe74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:16.462724 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e3e7e-9c7e-4f98-a087-5a56828cbe74 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:16.462997 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e3e7e-9c7e-4f98-a087-5a56828cbe74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:16.463111 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb088342-3da8-4e41-b720-84f20da0505d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:16.463262 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e3e7e-9c7e-4f98-a087-5a56828cbe74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:16.463768 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb088342-3da8-4e41-b720-84f20da0505d admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:16.463938 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e3e7e-9c7e-4f98-a087-5a56828cbe74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:16.464071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb088342-3da8-4e41-b720-84f20da0505d admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:16.464348 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb088342-3da8-4e41-b720-84f20da0505d admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:16.464989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb088342-3da8-4e41-b720-84f20da0505d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:16.465543 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e3e7e-9c7e-4f98-a087-5a56828cbe74 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:16.466710 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb088342-3da8-4e41-b720-84f20da0505d admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:16.476234 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 800/1600] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:16.477261 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e3e7e-9c7e-4f98-a087-5a56828cbe74 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:16.477931 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 801/1601] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:16.478766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb088342-3da8-4e41-b720-84f20da0505d admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:16.486793 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:16.489076 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb088342-3da8-4e41-b720-84f20da0505d admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:16.495358 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f13d5-231a-4557-be28-69591c7c82db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:16.495999 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f13d5-231a-4557-be28-69591c7c82db admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:16.496280 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f13d5-231a-4557-be28-69591c7c82db admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:16.496557 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f13d5-231a-4557-be28-69591c7c82db admin admin] PATH_INFO: `/v3/projects/0e2149e0214041f19068442396cd1d01/users/2eda8def7e754c869cd5ca64498e5c98/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:16.511949 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f13d5-231a-4557-be28-69591c7c82db admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e2149e0214041f19068442396cd1d01, user_id=2eda8def7e754c869cd5ca64498e5c98, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:16.514608 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f13d5-231a-4557-be28-69591c7c82db admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:16.527780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 802/1602] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:54:16 2022] PUT /identity/v3/projects/0e2149e0214041f19068442396cd1d01/users/2eda8def7e754c869cd5ca64498e5c98/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:16.530212 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f13d5-231a-4557-be28-69591c7c82db admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:16.535335 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e3e7e-9c7e-4f98-a087-5a56828cbe74 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:16.570951 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:16.586200 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654019fb-293b-4233-9213-890e2d3b441d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:16.587027 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654019fb-293b-4233-9213-890e2d3b441d service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:16.587319 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654019fb-293b-4233-9213-890e2d3b441d service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:16.587574 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654019fb-293b-4233-9213-890e2d3b441d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:16.596619 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654019fb-293b-4233-9213-890e2d3b441d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:16.596769 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f13d5-231a-4557-be28-69591c7c82db admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:16.598209 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654019fb-293b-4233-9213-890e2d3b441d service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:16.601518 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999b99e-2451-453e-a562-51df814635ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:16.602220 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999b99e-2451-453e-a562-51df814635ec admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:16.602488 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999b99e-2451-453e-a562-51df814635ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:16.602757 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999b99e-2451-453e-a562-51df814635ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:16.603423 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999b99e-2451-453e-a562-51df814635ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:16.605007 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999b99e-2451-453e-a562-51df814635ec admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:16.607902 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 801/1603] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:16.609140 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59af37-5569-4ccc-909a-e76403bd943e None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:16.609424 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59af37-5569-4ccc-909a-e76403bd943e None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:16.609699 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59af37-5569-4ccc-909a-e76403bd943e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:16.616725 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 803/1604] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:16.618059 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27792db0-519f-4b96-81bd-7328ba72f232 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:16.618339 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27792db0-519f-4b96-81bd-7328ba72f232 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:16.618612 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27792db0-519f-4b96-81bd-7328ba72f232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:16.633421 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-ac59af37-5569-4ccc-909a-e76403bd943e None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:16.634961 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ac59af37-5569-4ccc-909a-e76403bd943e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:16.643552 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 802/1605] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:16.644386 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59af37-5569-4ccc-909a-e76403bd943e None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:16.650065 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-27792db0-519f-4b96-81bd-7328ba72f232 None None] MFA Rules not processed for user `f0c185ca1ea144dfbb74886bec8f8e29`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:16.651356 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-27792db0-519f-4b96-81bd-7328ba72f232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:16.658975 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59af37-5569-4ccc-909a-e76403bd943e None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:16.664436 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f81ad7-94f7-4519-8583-cd40b88084bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:16.665216 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f81ad7-94f7-4519-8583-cd40b88084bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:16.665677 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f81ad7-94f7-4519-8583-cd40b88084bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:16.665983 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f81ad7-94f7-4519-8583-cd40b88084bf admin admin] PATH_INFO: `/v3/projects/7b8d68f42ef648299012b855fb485190/users/7696bfdd618a47eb91753adb60ea7812/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:16.683747 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f81ad7-94f7-4519-8583-cd40b88084bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b8d68f42ef648299012b855fb485190, user_id=7696bfdd618a47eb91753adb60ea7812, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:16.686673 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f81ad7-94f7-4519-8583-cd40b88084bf admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:16.701758 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 803/1606] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:54:16 2022] PUT /identity/v3/projects/7b8d68f42ef648299012b855fb485190/users/7696bfdd618a47eb91753adb60ea7812/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:16.702488 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f81ad7-94f7-4519-8583-cd40b88084bf admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:16.736024 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 804/1607] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:16.736024 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e1e47-99b3-496a-ab25-a4e1f7c5f51b None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:16.736024 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e1e47-99b3-496a-ab25-a4e1f7c5f51b None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:16.736024 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e1e47-99b3-496a-ab25-a4e1f7c5f51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:16.754350 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-921e1e47-99b3-496a-ab25-a4e1f7c5f51b None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:16.755538 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-921e1e47-99b3-496a-ab25-a4e1f7c5f51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:16.785182 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f81ad7-94f7-4519-8583-cd40b88084bf admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:16.792790 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a81c87-4b9a-48fe-b065-ba9eb6147406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:16.795738 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a81c87-4b9a-48fe-b065-ba9eb6147406 admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:16.795738 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a81c87-4b9a-48fe-b065-ba9eb6147406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:16.795738 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a81c87-4b9a-48fe-b065-ba9eb6147406 admin admin] PATH_INFO: `/v3/projects/0c024ff21daa497899662576313d666e/users/8315d37e8e30464b9362da12d2fded0a/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:16.822692 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a81c87-4b9a-48fe-b065-ba9eb6147406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c024ff21daa497899662576313d666e, user_id=8315d37e8e30464b9362da12d2fded0a, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:16.825098 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a81c87-4b9a-48fe-b065-ba9eb6147406 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:16.841074 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 805/1608] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:16.844321 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e1e47-99b3-496a-ab25-a4e1f7c5f51b None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:16.851884 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e1e47-99b3-496a-ab25-a4e1f7c5f51b None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:16.854064 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 804/1609] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:54:16 2022] PUT /identity/v3/projects/0c024ff21daa497899662576313d666e/users/8315d37e8e30464b9362da12d2fded0a/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:16.863521 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a81c87-4b9a-48fe-b065-ba9eb6147406 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:16.866804 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-e6a81c87-4b9a-48fe-b065-ba9eb6147406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:16.890740 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:16.922897 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b500e-fc71-4a7e-99bd-22e545e423c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:16.923563 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b500e-fc71-4a7e-99bd-22e545e423c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:16.923835 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b500e-fc71-4a7e-99bd-22e545e423c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:16.924103 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b500e-fc71-4a7e-99bd-22e545e423c1 admin admin] PATH_INFO: `/v3/projects/30af769ba167467ca426159c154afeb7/users/bc595b98b773483cbb9acc98ebb58718/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:16.927458 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:16.938698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a81c87-4b9a-48fe-b065-ba9eb6147406 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:16.942508 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b500e-fc71-4a7e-99bd-22e545e423c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30af769ba167467ca426159c154afeb7, user_id=bc595b98b773483cbb9acc98ebb58718, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:16.943196 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df83de-59cd-4248-8749-10d9278497bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:16.943862 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df83de-59cd-4248-8749-10d9278497bb service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:16.944143 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df83de-59cd-4248-8749-10d9278497bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:16.944415 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df83de-59cd-4248-8749-10d9278497bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:16.946811 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b500e-fc71-4a7e-99bd-22e545e423c1 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:16.954071 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df83de-59cd-4248-8749-10d9278497bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:16.955591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df83de-59cd-4248-8749-10d9278497bb service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:16.962123 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 806/1610] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:54:16 2022] PUT /identity/v3/projects/30af769ba167467ca426159c154afeb7/users/bc595b98b773483cbb9acc98ebb58718/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:16.964171 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82845a7b-7b39-475c-94e4-875abcf00951 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:16.964663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82845a7b-7b39-475c-94e4-875abcf00951 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:16.965157 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82845a7b-7b39-475c-94e4-875abcf00951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:16.978226 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 805/1611] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:16.991505 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006554b-cf91-4255-8e9a-61dba067c805 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:16.993556 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-82845a7b-7b39-475c-94e4-875abcf00951 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:16.995082 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-82845a7b-7b39-475c-94e4-875abcf00951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:17.000901 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006554b-cf91-4255-8e9a-61dba067c805 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:17.000901 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006554b-cf91-4255-8e9a-61dba067c805 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:17.008858 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 806/1612] 10.222.0.27 () {54 vars in 962 bytes} [Sun Aug 7 10:54:16 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:54:17.011417 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006554b-cf91-4255-8e9a-61dba067c805 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:17.089695 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 807/1613] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:17.091255 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cccc5-2459-4453-a3b1-822a0e9a6e2f None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:17.091541 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cccc5-2459-4453-a3b1-822a0e9a6e2f None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:17.091813 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cccc5-2459-4453-a3b1-822a0e9a6e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:17.094463 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006554b-cf91-4255-8e9a-61dba067c805 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:17.099280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51214727-0761-48e8-a444-abd526aec30c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:17.100578 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51214727-0761-48e8-a444-abd526aec30c service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:17.100892 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51214727-0761-48e8-a444-abd526aec30c service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:17.101383 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51214727-0761-48e8-a444-abd526aec30c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:17.113483 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51214727-0761-48e8-a444-abd526aec30c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:17.115423 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51214727-0761-48e8-a444-abd526aec30c service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:17.130867 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 807/1614] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:17.133843 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a71978-96f0-4daa-be05-16b4d5fcea55 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:17.134148 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-926cccc5-2459-4453-a3b1-822a0e9a6e2f None None] MFA Rules not processed for user `8315d37e8e30464b9362da12d2fded0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:17.134394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a71978-96f0-4daa-be05-16b4d5fcea55 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:17.134856 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a71978-96f0-4daa-be05-16b4d5fcea55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:17.135479 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-926cccc5-2459-4453-a3b1-822a0e9a6e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:17.174539 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-08a71978-96f0-4daa-be05-16b4d5fcea55 None None] MFA Rules not processed for user `bc595b98b773483cbb9acc98ebb58718`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:17.176654 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-08a71978-96f0-4daa-be05-16b4d5fcea55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:17.239601 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 808/1615] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:17.241814 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ccdb0-c8af-4645-993d-77c0e2d2659e None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:17.242082 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ccdb0-c8af-4645-993d-77c0e2d2659e None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:17.242531 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ccdb0-c8af-4645-993d-77c0e2d2659e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:17.305964 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 808/1616] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:17.307305 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a71978-96f0-4daa-be05-16b4d5fcea55 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:17.325642 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-ba3ccdb0-c8af-4645-993d-77c0e2d2659e None None] MFA Rules not processed for user `f98cb7abbb8942cebb71aa98da80a05a`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:17.328886 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-ba3ccdb0-c8af-4645-993d-77c0e2d2659e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:17.342301 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a71978-96f0-4daa-be05-16b4d5fcea55 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:17.355117 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323dfc49-774f-423e-9b4c-47fcdbecb9a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:17.355748 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323dfc49-774f-423e-9b4c-47fcdbecb9a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:17.356158 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323dfc49-774f-423e-9b4c-47fcdbecb9a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:17.356611 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323dfc49-774f-423e-9b4c-47fcdbecb9a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:17.386628 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323dfc49-774f-423e-9b4c-47fcdbecb9a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:17.389400 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323dfc49-774f-423e-9b4c-47fcdbecb9a4 service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:17.411724 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:17.426851 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 809/1617] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:17.431271 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323dfc49-774f-423e-9b4c-47fcdbecb9a4 service neutron] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:17.433079 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 809/1618] 10.222.0.27 () {58 vars in 1059 bytes} [Sun Aug 7 10:54:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:17.442283 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ccdb0-c8af-4645-993d-77c0e2d2659e None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:17.456455 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ccdb0-c8af-4645-993d-77c0e2d2659e None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:17.461285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323dfc49-774f-423e-9b4c-47fcdbecb9a4 service neutron] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:17.463871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c622e8-607d-4808-bb08-55587bd52bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:17.464204 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c622e8-607d-4808-bb08-55587bd52bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:17.464487 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c622e8-607d-4808-bb08-55587bd52bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:17.464764 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c622e8-607d-4808-bb08-55587bd52bc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:17.465437 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c622e8-607d-4808-bb08-55587bd52bc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:17.467412 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c622e8-607d-4808-bb08-55587bd52bc6 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:17.474884 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756499a9-0bb3-4cfc-aafe-4e7f273268bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:17.476087 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756499a9-0bb3-4cfc-aafe-4e7f273268bf admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:17.476367 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756499a9-0bb3-4cfc-aafe-4e7f273268bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:17.476632 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756499a9-0bb3-4cfc-aafe-4e7f273268bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:17.477596 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756499a9-0bb3-4cfc-aafe-4e7f273268bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:17.479681 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756499a9-0bb3-4cfc-aafe-4e7f273268bf admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:17.533129 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 810/1619] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:54:17 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:17.541033 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c622e8-607d-4808-bb08-55587bd52bc6 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:17.552468 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 810/1620] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:54:17 2022] POST /identity/v3/projects => generated 363 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:17.553986 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756499a9-0bb3-4cfc-aafe-4e7f273268bf admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:17.641081 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:17.716395 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c622e8-607d-4808-bb08-55587bd52bc6 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:17.736866 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756499a9-0bb3-4cfc-aafe-4e7f273268bf admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:17.743298 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e82cd-8c7f-40fd-a008-901b422c2eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:17.743702 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e82cd-8c7f-40fd-a008-901b422c2eef admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:17.744230 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e82cd-8c7f-40fd-a008-901b422c2eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:17.744521 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e82cd-8c7f-40fd-a008-901b422c2eef admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:17.745468 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e82cd-8c7f-40fd-a008-901b422c2eef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:17.747703 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e82cd-8c7f-40fd-a008-901b422c2eef admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:17.787181 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 811/1621] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:54:17 2022] POST /identity/v3/users => generated 297 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:17.792196 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e82cd-8c7f-40fd-a008-901b422c2eef admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:17.821600 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e82cd-8c7f-40fd-a008-901b422c2eef admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:17.843094 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4918952-9373-41d9-8cc7-07544c63d74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:17.843729 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4918952-9373-41d9-8cc7-07544c63d74b admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:17.844010 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4918952-9373-41d9-8cc7-07544c63d74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:17.844285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4918952-9373-41d9-8cc7-07544c63d74b admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:17.844925 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4918952-9373-41d9-8cc7-07544c63d74b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:17.845046 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e23de-fa1a-4438-9e76-8fdc06071633 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:17.845705 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e23de-fa1a-4438-9e76-8fdc06071633 service nova] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:17.845987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e23de-fa1a-4438-9e76-8fdc06071633 service nova] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:17.846431 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e23de-fa1a-4438-9e76-8fdc06071633 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:17.847945 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4918952-9373-41d9-8cc7-07544c63d74b admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:17.895311 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 812/1622] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:54:17 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:17.902135 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8f310-f73f-4631-9866-6b1a13d47f9c None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:17.902429 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8f310-f73f-4631-9866-6b1a13d47f9c None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:17.902865 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8f310-f73f-4631-9866-6b1a13d47f9c None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:17.908865 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 813/1623] 10.222.0.27 () {54 vars in 962 bytes} [Sun Aug 7 10:54:17 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:54:17.909905 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8f310-f73f-4631-9866-6b1a13d47f9c None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:17.933291 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e23de-fa1a-4438-9e76-8fdc06071633 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:17.935339 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e23de-fa1a-4438-9e76-8fdc06071633 service nova] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:17.940047 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8f310-f73f-4631-9866-6b1a13d47f9c None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:17.947424 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 811/1624] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:17.948435 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e23de-fa1a-4438-9e76-8fdc06071633 service nova] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:17.963015 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ef745-a61a-4204-9fe6-7098f6edfdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:17.963672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ef745-a61a-4204-9fe6-7098f6edfdcd admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:17.963804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e23de-fa1a-4438-9e76-8fdc06071633 service nova] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:17.963995 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ef745-a61a-4204-9fe6-7098f6edfdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:17.964281 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ef745-a61a-4204-9fe6-7098f6edfdcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:17.965221 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ef745-a61a-4204-9fe6-7098f6edfdcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:17.966868 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ef745-a61a-4204-9fe6-7098f6edfdcd admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:17.971134 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc67f6-74af-4cb9-8569-4f9646cbec58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:17.971920 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc67f6-74af-4cb9-8569-4f9646cbec58 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:17.972353 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc67f6-74af-4cb9-8569-4f9646cbec58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:17.972627 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc67f6-74af-4cb9-8569-4f9646cbec58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:17.973278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc67f6-74af-4cb9-8569-4f9646cbec58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:17.977971 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc67f6-74af-4cb9-8569-4f9646cbec58 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:17.979255 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:17.998965 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 812/1625] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:18.000655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc4f30-5065-4ddf-b449-1bd873f20d34 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:18.001173 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc4f30-5065-4ddf-b449-1bd873f20d34 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:18.001689 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc4f30-5065-4ddf-b449-1bd873f20d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:18.014767 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 814/1626] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:18.020238 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ef745-a61a-4204-9fe6-7098f6edfdcd admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:18.028141 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-2abc4f30-5065-4ddf-b449-1bd873f20d34 None None] MFA Rules not processed for user `f98cb7abbb8942cebb71aa98da80a05a`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:18.030120 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-2abc4f30-5065-4ddf-b449-1bd873f20d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:18.050117 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 813/1627] 10.222.0.27 () {58 vars in 1059 bytes} [Sun Aug 7 10:54:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:18.051793 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc4f30-5065-4ddf-b449-1bd873f20d34 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:18.057327 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ef745-a61a-4204-9fe6-7098f6edfdcd admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:18.067262 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc4f30-5065-4ddf-b449-1bd873f20d34 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:18.074063 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa0567-c7e8-4ad9-8472-698622e86693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:18.075147 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa0567-c7e8-4ad9-8472-698622e86693 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:18.075678 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa0567-c7e8-4ad9-8472-698622e86693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:18.076056 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa0567-c7e8-4ad9-8472-698622e86693 admin admin] PATH_INFO: `/v3/projects/ea9d8605de7b42fbba8727a7f1403633/users/eb2756e574734dbbab94ba77cacf5862/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:18.086152 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbba4b4-e3b0-44a2-8b94-c09f4f0f4ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:18.086895 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbba4b4-e3b0-44a2-8b94-c09f4f0f4ea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:18.087183 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbba4b4-e3b0-44a2-8b94-c09f4f0f4ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:18.087462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbba4b4-e3b0-44a2-8b94-c09f4f0f4ea7 admin admin] PATH_INFO: `/v3/projects/584b0e887fee40aaae63cc9332de2aac/users/d9fa72dccbd24765b3245630c15db430/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:18.096957 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa0567-c7e8-4ad9-8472-698622e86693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea9d8605de7b42fbba8727a7f1403633, user_id=eb2756e574734dbbab94ba77cacf5862, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:18.101829 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa0567-c7e8-4ad9-8472-698622e86693 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:18.123898 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 814/1628] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:54:18 2022] PUT /identity/v3/projects/ea9d8605de7b42fbba8727a7f1403633/users/eb2756e574734dbbab94ba77cacf5862/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:18.125253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ec646-f9f5-4139-bdd1-24a37425f22d None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:18.125724 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ec646-f9f5-4139-bdd1-24a37425f22d None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:18.126212 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ec646-f9f5-4139-bdd1-24a37425f22d None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:18.128448 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 815/1629] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 7 10:54:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:54:18.129501 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ec646-f9f5-4139-bdd1-24a37425f22d None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:18.148990 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbba4b4-e3b0-44a2-8b94-c09f4f0f4ea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=584b0e887fee40aaae63cc9332de2aac, user_id=d9fa72dccbd24765b3245630c15db430, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:18.151743 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbba4b4-e3b0-44a2-8b94-c09f4f0f4ea7 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:18.185829 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 815/1630] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:54:18 2022] PUT /identity/v3/projects/584b0e887fee40aaae63cc9332de2aac/users/d9fa72dccbd24765b3245630c15db430/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:18.189658 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4ee46-250d-437a-96ad-d7e67f5462f7 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:18.189943 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4ee46-250d-437a-96ad-d7e67f5462f7 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:18.190219 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4ee46-250d-437a-96ad-d7e67f5462f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:18.229397 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-a3f4ee46-250d-437a-96ad-d7e67f5462f7 None None] MFA Rules not processed for user `f98cb7abbb8942cebb71aa98da80a05a`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:18.230706 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a3f4ee46-250d-437a-96ad-d7e67f5462f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:18.231642 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ec646-f9f5-4139-bdd1-24a37425f22d None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:18.314902 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a0d79-4212-46d6-aef1-2fff85f3d4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:18.315682 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a0d79-4212-46d6-aef1-2fff85f3d4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:18.316068 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a0d79-4212-46d6-aef1-2fff85f3d4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:18.316439 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a0d79-4212-46d6-aef1-2fff85f3d4a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:18.317170 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a0d79-4212-46d6-aef1-2fff85f3d4a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:18.319551 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a0d79-4212-46d6-aef1-2fff85f3d4a9 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:18.333839 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 816/1631] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:18.335878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a0d79-4212-46d6-aef1-2fff85f3d4a9 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:18.350172 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a0d79-4212-46d6-aef1-2fff85f3d4a9 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:18.359997 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333925b9-7b78-41da-9eb8-0dc7ca01e482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:18.360616 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333925b9-7b78-41da-9eb8-0dc7ca01e482 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:18.360889 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333925b9-7b78-41da-9eb8-0dc7ca01e482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:18.361213 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333925b9-7b78-41da-9eb8-0dc7ca01e482 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:18.361893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333925b9-7b78-41da-9eb8-0dc7ca01e482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:18.368677 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333925b9-7b78-41da-9eb8-0dc7ca01e482 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:18.387069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 816/1632] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 7 10:54:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:18.387939 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4ee46-250d-437a-96ad-d7e67f5462f7 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:18.392117 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 817/1633] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:18.399079 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333925b9-7b78-41da-9eb8-0dc7ca01e482 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:18.414256 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333925b9-7b78-41da-9eb8-0dc7ca01e482 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:18.419732 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884f04b-9770-4bc2-a431-ea00a5e701f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:18.419964 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4ee46-250d-437a-96ad-d7e67f5462f7 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:18.420549 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884f04b-9770-4bc2-a431-ea00a5e701f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:18.420898 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884f04b-9770-4bc2-a431-ea00a5e701f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:18.421239 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884f04b-9770-4bc2-a431-ea00a5e701f9 admin admin] PATH_INFO: `/v3/projects/584b0e887fee40aaae63cc9332de2aac/users/d9fa72dccbd24765b3245630c15db430/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:18.423811 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884f04b-9770-4bc2-a431-ea00a5e701f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=584b0e887fee40aaae63cc9332de2aac, user_id=d9fa72dccbd24765b3245630c15db430, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:18.426362 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884f04b-9770-4bc2-a431-ea00a5e701f9 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:18.437256 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fdcb13-37f1-4316-a6ce-40349d816d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:18.437890 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdcb13-37f1-4316-a6ce-40349d816d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:18.438172 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdcb13-37f1-4316-a6ce-40349d816d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:18.438445 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdcb13-37f1-4316-a6ce-40349d816d1a admin admin] PATH_INFO: `/v3/projects/ea9d8605de7b42fbba8727a7f1403633/users/eb2756e574734dbbab94ba77cacf5862/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:18.443520 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fdcb13-37f1-4316-a6ce-40349d816d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea9d8605de7b42fbba8727a7f1403633, user_id=eb2756e574734dbbab94ba77cacf5862, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:18.444206 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 818/1634] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:54:18 2022] PUT /identity/v3/projects/584b0e887fee40aaae63cc9332de2aac/users/d9fa72dccbd24765b3245630c15db430/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:18.445345 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884f04b-9770-4bc2-a431-ea00a5e701f9 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:18.455086 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fdcb13-37f1-4316-a6ce-40349d816d1a admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:18.490942 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 817/1635] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:54:18 2022] PUT /identity/v3/projects/ea9d8605de7b42fbba8727a7f1403633/users/eb2756e574734dbbab94ba77cacf5862/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:18.492406 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38596f04-8e71-4cbf-8fd9-4afe8268a971 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:18.492784 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38596f04-8e71-4cbf-8fd9-4afe8268a971 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:18.493070 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38596f04-8e71-4cbf-8fd9-4afe8268a971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:18.532699 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-38596f04-8e71-4cbf-8fd9-4afe8268a971 None None] MFA Rules not processed for user `d9fa72dccbd24765b3245630c15db430`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:18.539420 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-38596f04-8e71-4cbf-8fd9-4afe8268a971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:18.569748 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:18.570429 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:18.589477 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884f04b-9770-4bc2-a431-ea00a5e701f9 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:18.691725 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 818/1636] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:18.694231 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea519e5-d2fe-4efb-9d80-2e2f1be7711a None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:18.694571 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea519e5-d2fe-4efb-9d80-2e2f1be7711a None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:18.694848 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea519e5-d2fe-4efb-9d80-2e2f1be7711a None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:18.696232 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 819/1637] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 7 10:54:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:54:18.698924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aba477-a302-4e34-a279-61cb6ccce9ac None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:18.699344 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aba477-a302-4e34-a279-61cb6ccce9ac None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:18.699623 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aba477-a302-4e34-a279-61cb6ccce9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:18.711223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d37298-21fd-44c1-9901-f83278b251f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:18.712356 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d37298-21fd-44c1-9901-f83278b251f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:18.712839 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d37298-21fd-44c1-9901-f83278b251f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:18.713342 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d37298-21fd-44c1-9901-f83278b251f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:18.746840 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-a1aba477-a302-4e34-a279-61cb6ccce9ac None None] MFA Rules not processed for user `eb2756e574734dbbab94ba77cacf5862`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:18.748386 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a1aba477-a302-4e34-a279-61cb6ccce9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:18.860840 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 820/1638] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:18 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:18.863000 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8af7bd-7bd2-4f90-b94a-548dbf5fa46f None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:18.863789 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8af7bd-7bd2-4f90-b94a-548dbf5fa46f None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:18.864429 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8af7bd-7bd2-4f90-b94a-548dbf5fa46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:18.875594 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d37298-21fd-44c1-9901-f83278b251f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:18.876840 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d37298-21fd-44c1-9901-f83278b251f2 service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:18.890845 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-cb8af7bd-7bd2-4f90-b94a-548dbf5fa46f None None] MFA Rules not processed for user `f98cb7abbb8942cebb71aa98da80a05a`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:18.892556 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-cb8af7bd-7bd2-4f90-b94a-548dbf5fa46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:18.906745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 819/1639] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:18.907979 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d37298-21fd-44c1-9901-f83278b251f2 service cinder] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:18.920163 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 821/1640] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 7 10:54:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:18.929348 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d37298-21fd-44c1-9901-f83278b251f2 service cinder] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:18.934017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1865ef1-b1ec-493e-a380-4f8513936dc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:18.934794 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1865ef1-b1ec-493e-a380-4f8513936dc9 service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:18.935490 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1865ef1-b1ec-493e-a380-4f8513936dc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:18.935874 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1865ef1-b1ec-493e-a380-4f8513936dc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:18.948163 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1865ef1-b1ec-493e-a380-4f8513936dc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:18.950193 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1865ef1-b1ec-493e-a380-4f8513936dc9 service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:18.976325 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 820/1641] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:18 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:19.020622 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8af7bd-7bd2-4f90-b94a-548dbf5fa46f None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:19.024731 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1865ef1-b1ec-493e-a380-4f8513936dc9 service cinder] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:19.034367 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1865ef1-b1ec-493e-a380-4f8513936dc9 service cinder] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:19.034928 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8af7bd-7bd2-4f90-b94a-548dbf5fa46f None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:19.039582 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509beda-ee89-4a43-bc88-ab12666250d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:19.040860 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9281450-ca1b-44e8-a2ac-9f0cd4e96deb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:19.041304 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509beda-ee89-4a43-bc88-ab12666250d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:19.041790 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509beda-ee89-4a43-bc88-ab12666250d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:19.042078 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9281450-ca1b-44e8-a2ac-9f0cd4e96deb service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:19.042420 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509beda-ee89-4a43-bc88-ab12666250d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:19.042550 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9281450-ca1b-44e8-a2ac-9f0cd4e96deb service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:19.042954 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9281450-ca1b-44e8-a2ac-9f0cd4e96deb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:19.056958 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509beda-ee89-4a43-bc88-ab12666250d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:19.057803 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9281450-ca1b-44e8-a2ac-9f0cd4e96deb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:19.059168 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509beda-ee89-4a43-bc88-ab12666250d2 service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:19.060257 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9281450-ca1b-44e8-a2ac-9f0cd4e96deb service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:19.085108 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 821/1642] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 10:54:19.087254 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 822/1643] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:19.739066 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509beda-ee89-4a43-bc88-ab12666250d2 service cinder] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:19.751375 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509beda-ee89-4a43-bc88-ab12666250d2 service cinder] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:19.758599 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fd7ef-4a19-4735-a611-561c759dfbe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:19.760872 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fd7ef-4a19-4735-a611-561c759dfbe2 service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:19.761705 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fd7ef-4a19-4735-a611-561c759dfbe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:19.762081 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fd7ef-4a19-4735-a611-561c759dfbe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:19.813484 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9281450-ca1b-44e8-a2ac-9f0cd4e96deb service cinder] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:19.830846 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9281450-ca1b-44e8-a2ac-9f0cd4e96deb service cinder] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:19.838242 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46264329-64a5-4fce-8378-3d4f355331ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:19.840410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46264329-64a5-4fce-8378-3d4f355331ac service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:19.841483 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46264329-64a5-4fce-8378-3d4f355331ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:19.841881 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46264329-64a5-4fce-8378-3d4f355331ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:19.907213 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034fd7ef-4a19-4735-a611-561c759dfbe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:19.910248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034fd7ef-4a19-4735-a611-561c759dfbe2 service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:19.934961 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 822/1644] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:19.982118 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46264329-64a5-4fce-8378-3d4f355331ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:19.983676 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46264329-64a5-4fce-8378-3d4f355331ac service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:20.013067 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 823/1645] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 10:54:25.038989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fd7ef-4a19-4735-a611-561c759dfbe2 service cinder] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:25.081018 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:25.270082 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fd7ef-4a19-4735-a611-561c759dfbe2 service cinder] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:25.291622 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138137e-a42c-45c8-b0e4-b0b363aaec08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:25.292526 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138137e-a42c-45c8-b0e4-b0b363aaec08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:25.293044 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138137e-a42c-45c8-b0e4-b0b363aaec08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:25.293524 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138137e-a42c-45c8-b0e4-b0b363aaec08 admin admin] PATH_INFO: `/v3/users/8315d37e8e30464b9362da12d2fded0a` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:25.307230 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138137e-a42c-45c8-b0e4-b0b363aaec08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8315d37e8e30464b9362da12d2fded0a)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:25.308739 dv-cinder-850320-3-smb devstack@keystone.service[80144]: WARNING py.warnings [None req-a138137e-a42c-45c8-b0e4-b0b363aaec08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 10:54:25.308739 dv-cinder-850320-3-smb devstack@keystone.service[80144]: warnings.warn(msg) Aug 07 10:54:25.308739 dv-cinder-850320-3-smb devstack@keystone.service[80144]: Aug 07 10:54:25.310692 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138137e-a42c-45c8-b0e4-b0b363aaec08 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:25.525789 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-a138137e-a42c-45c8-b0e4-b0b363aaec08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8315d37e8e30464b9362da12d2fded0a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:25.590709 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-a138137e-a42c-45c8-b0e4-b0b363aaec08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8315d37e8e30464b9362da12d2fded0a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:25.597957 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-a138137e-a42c-45c8-b0e4-b0b363aaec08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8315d37e8e30464b9362da12d2fded0a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:25.628156 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-a138137e-a42c-45c8-b0e4-b0b363aaec08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8315d37e8e30464b9362da12d2fded0a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:25.649516 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-a138137e-a42c-45c8-b0e4-b0b363aaec08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8315d37e8e30464b9362da12d2fded0a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:25.673432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 823/1646] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:54:25 2022] DELETE /identity/v3/users/8315d37e8e30464b9362da12d2fded0a => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:25.676096 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f056a4-ff72-4a8e-abcd-f63c58604005 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:25.676590 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f056a4-ff72-4a8e-abcd-f63c58604005 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:25.676916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f056a4-ff72-4a8e-abcd-f63c58604005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:25.750207 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-d1f056a4-ff72-4a8e-abcd-f63c58604005 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:25.771396 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-d1f056a4-ff72-4a8e-abcd-f63c58604005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:25.864299 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:25.997889 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 824/1647] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:26.106312 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138137e-a42c-45c8-b0e4-b0b363aaec08 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:26.108795 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-a138137e-a42c-45c8-b0e4-b0b363aaec08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:26.301792 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138137e-a42c-45c8-b0e4-b0b363aaec08 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:26.313185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e22f17-3e21-4387-b96e-b42aa19b333f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:26.314501 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e22f17-3e21-4387-b96e-b42aa19b333f service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:26.315022 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e22f17-3e21-4387-b96e-b42aa19b333f service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:26.315297 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e22f17-3e21-4387-b96e-b42aa19b333f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:26.340043 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e22f17-3e21-4387-b96e-b42aa19b333f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:26.343784 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e22f17-3e21-4387-b96e-b42aa19b333f service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:26.369214 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 824/1648] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:27.416494 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f056a4-ff72-4a8e-abcd-f63c58604005 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:27.417860 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-d1f056a4-ff72-4a8e-abcd-f63c58604005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:27.438894 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f056a4-ff72-4a8e-abcd-f63c58604005 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:27.452817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834d3ba-b644-4186-a12b-b1d0f228dbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:27.453794 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834d3ba-b644-4186-a12b-b1d0f228dbff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:27.454070 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834d3ba-b644-4186-a12b-b1d0f228dbff admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:27.454341 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834d3ba-b644-4186-a12b-b1d0f228dbff admin admin] PATH_INFO: `/v3/users/f0c185ca1ea144dfbb74886bec8f8e29` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:27.464703 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834d3ba-b644-4186-a12b-b1d0f228dbff admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0c185ca1ea144dfbb74886bec8f8e29)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:27.466816 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834d3ba-b644-4186-a12b-b1d0f228dbff admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:27.585445 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-1834d3ba-b644-4186-a12b-b1d0f228dbff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0c185ca1ea144dfbb74886bec8f8e29'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:27.608119 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-1834d3ba-b644-4186-a12b-b1d0f228dbff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0c185ca1ea144dfbb74886bec8f8e29'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:27.609729 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-1834d3ba-b644-4186-a12b-b1d0f228dbff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0c185ca1ea144dfbb74886bec8f8e29'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:27.626220 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-1834d3ba-b644-4186-a12b-b1d0f228dbff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0c185ca1ea144dfbb74886bec8f8e29'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:27.643527 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-1834d3ba-b644-4186-a12b-b1d0f228dbff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0c185ca1ea144dfbb74886bec8f8e29'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:27.669035 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 825/1649] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:54:27 2022] DELETE /identity/v3/users/f0c185ca1ea144dfbb74886bec8f8e29 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:27.673499 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925952b-3897-433a-aab6-5a8a23cfe2d2 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:27.673988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925952b-3897-433a-aab6-5a8a23cfe2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:27.674066 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925952b-3897-433a-aab6-5a8a23cfe2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:27.713943 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-9925952b-3897-433a-aab6-5a8a23cfe2d2 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:27.715349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-9925952b-3897-433a-aab6-5a8a23cfe2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:27.795120 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:27.879249 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 825/1650] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:27.976514 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d689891-a396-46c3-90b1-3f79ffebe525 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:27.976996 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d689891-a396-46c3-90b1-3f79ffebe525 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:27.978410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d689891-a396-46c3-90b1-3f79ffebe525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:28.008634 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925952b-3897-433a-aab6-5a8a23cfe2d2 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:28.010370 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-9925952b-3897-433a-aab6-5a8a23cfe2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:28.076349 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-8d689891-a396-46c3-90b1-3f79ffebe525 None None] MFA Rules not processed for user `cba1a3bf0e1f49e885e4c833549be406`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:28.080492 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-8d689891-a396-46c3-90b1-3f79ffebe525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:28.205786 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925952b-3897-433a-aab6-5a8a23cfe2d2 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:28.211001 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646d9d4-f087-4945-b252-3fbd95bb67ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:28.211751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646d9d4-f087-4945-b252-3fbd95bb67ce service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:28.212476 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646d9d4-f087-4945-b252-3fbd95bb67ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:28.212755 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646d9d4-f087-4945-b252-3fbd95bb67ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:28.228355 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646d9d4-f087-4945-b252-3fbd95bb67ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:28.229984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646d9d4-f087-4945-b252-3fbd95bb67ce service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:28.251130 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 826/1651] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 10:54:28.291532 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 826/1652] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:28.308875 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646d9d4-f087-4945-b252-3fbd95bb67ce service neutron] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:28.313470 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-0646d9d4-f087-4945-b252-3fbd95bb67ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:28.455939 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646d9d4-f087-4945-b252-3fbd95bb67ce service neutron] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:28.473248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806c033-e441-4c2b-af65-55739eeb3a0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:28.474057 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806c033-e441-4c2b-af65-55739eeb3a0e service nova] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:28.474380 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806c033-e441-4c2b-af65-55739eeb3a0e service nova] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:28.480746 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806c033-e441-4c2b-af65-55739eeb3a0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:28.504407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806c033-e441-4c2b-af65-55739eeb3a0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:28.508476 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806c033-e441-4c2b-af65-55739eeb3a0e service nova] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:28.531840 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 827/1653] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:29.233706 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d689891-a396-46c3-90b1-3f79ffebe525 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:29.236883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-8d689891-a396-46c3-90b1-3f79ffebe525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:29.246858 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806c033-e441-4c2b-af65-55739eeb3a0e service nova] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:29.253880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-d806c033-e441-4c2b-af65-55739eeb3a0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:29.296553 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d689891-a396-46c3-90b1-3f79ffebe525 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:29.300450 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806c033-e441-4c2b-af65-55739eeb3a0e service nova] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:29.312194 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212c4a0-9913-4215-ac9a-05574308829e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:29.316642 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212c4a0-9913-4215-ac9a-05574308829e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:29.317422 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daf584-8270-45fd-bd81-94e8999e06ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:29.317823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212c4a0-9913-4215-ac9a-05574308829e admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:29.318194 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212c4a0-9913-4215-ac9a-05574308829e admin admin] PATH_INFO: `/v3/projects/0c024ff21daa497899662576313d666e` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:29.320052 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daf584-8270-45fd-bd81-94e8999e06ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:29.321613 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daf584-8270-45fd-bd81-94e8999e06ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:29.322553 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daf584-8270-45fd-bd81-94e8999e06ff admin admin] PATH_INFO: `/v3/users/b4a6bab9e8d54454a50ee76b03a24cde` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:29.325259 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212c4a0-9913-4215-ac9a-05574308829e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c024ff21daa497899662576313d666e)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:29.326367 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84daf584-8270-45fd-bd81-94e8999e06ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4a6bab9e8d54454a50ee76b03a24cde)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:29.328560 dv-cinder-850320-3-smb devstack@keystone.service[80145]: WARNING py.warnings [None req-5212c4a0-9913-4215-ac9a-05574308829e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 10:54:29.328560 dv-cinder-850320-3-smb devstack@keystone.service[80145]: warnings.warn(msg) Aug 07 10:54:29.328560 dv-cinder-850320-3-smb devstack@keystone.service[80145]: Aug 07 10:54:29.334261 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212c4a0-9913-4215-ac9a-05574308829e admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:29.335470 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84daf584-8270-45fd-bd81-94e8999e06ff admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:29.434132 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:29.497850 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-84daf584-8270-45fd-bd81-94e8999e06ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4a6bab9e8d54454a50ee76b03a24cde'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:29.519592 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:29.533102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-84daf584-8270-45fd-bd81-94e8999e06ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4a6bab9e8d54454a50ee76b03a24cde'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:29.535276 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-84daf584-8270-45fd-bd81-94e8999e06ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4a6bab9e8d54454a50ee76b03a24cde'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:29.537193 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5212c4a0-9913-4215-ac9a-05574308829e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c024ff21daa497899662576313d666e', 'request_id': 'req-5212c4a0-9913-4215-ac9a-05574308829e'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:29.549693 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5212c4a0-9913-4215-ac9a-05574308829e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c024ff21daa497899662576313d666e', 'request_id': 'req-5212c4a0-9913-4215-ac9a-05574308829e'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:29.557115 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-84daf584-8270-45fd-bd81-94e8999e06ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4a6bab9e8d54454a50ee76b03a24cde'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:29.574391 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-84daf584-8270-45fd-bd81-94e8999e06ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4a6bab9e8d54454a50ee76b03a24cde'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:29.579460 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5212c4a0-9913-4215-ac9a-05574308829e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c024ff21daa497899662576313d666e', 'request_id': 'req-5212c4a0-9913-4215-ac9a-05574308829e'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:29.590974 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 828/1654] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:54:29 2022] DELETE /identity/v3/users/b4a6bab9e8d54454a50ee76b03a24cde => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 10:54:29.595771 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599adc5-03a6-4d08-a327-a487c07c5d4a None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:29.596119 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599adc5-03a6-4d08-a327-a487c07c5d4a None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:29.596471 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599adc5-03a6-4d08-a327-a487c07c5d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:29.620610 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5212c4a0-9913-4215-ac9a-05574308829e admin admin] The token cache is being invalidate because project 0c024ff21daa497899662576313d666e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:54:29.621260 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5212c4a0-9913-4215-ac9a-05574308829e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:29.622177 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5212c4a0-9913-4215-ac9a-05574308829e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:29.627701 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 827/1655] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:54:29 2022] DELETE /identity/v3/projects/0c024ff21daa497899662576313d666e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:29.632953 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212c4a0-9913-4215-ac9a-05574308829e admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:29.639036 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-5212c4a0-9913-4215-ac9a-05574308829e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:29.646031 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-9599adc5-03a6-4d08-a327-a487c07c5d4a None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:29.651233 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-9599adc5-03a6-4d08-a327-a487c07c5d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:29.780052 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212c4a0-9913-4215-ac9a-05574308829e admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:29.821852 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 829/1656] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:54:29.841106 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599adc5-03a6-4d08-a327-a487c07c5d4a None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:29.845514 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-9599adc5-03a6-4d08-a327-a487c07c5d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:29.988030 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599adc5-03a6-4d08-a327-a487c07c5d4a None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:30.000270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1084e53a-5e0f-46d5-870d-89ba1e1751bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:30.001332 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084e53a-5e0f-46d5-870d-89ba1e1751bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:30.001461 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb285dd7-4800-45e9-91b5-34aec163cb80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:30.001924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084e53a-5e0f-46d5-870d-89ba1e1751bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:30.002352 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb285dd7-4800-45e9-91b5-34aec163cb80 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:30.002552 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084e53a-5e0f-46d5-870d-89ba1e1751bc admin admin] PATH_INFO: `/v3/users/d9fa72dccbd24765b3245630c15db430` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:30.002802 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb285dd7-4800-45e9-91b5-34aec163cb80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:30.003192 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb285dd7-4800-45e9-91b5-34aec163cb80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:30.006374 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1084e53a-5e0f-46d5-870d-89ba1e1751bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9fa72dccbd24765b3245630c15db430)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:30.008621 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1084e53a-5e0f-46d5-870d-89ba1e1751bc admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:30.036719 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb285dd7-4800-45e9-91b5-34aec163cb80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:30.039082 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb285dd7-4800-45e9-91b5-34aec163cb80 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:30.059418 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 830/1657] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:30.087243 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb285dd7-4800-45e9-91b5-34aec163cb80 service neutron] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:30.088707 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-eb285dd7-4800-45e9-91b5-34aec163cb80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:30.113959 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb285dd7-4800-45e9-91b5-34aec163cb80 service neutron] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:30.127692 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a1d31-cbc4-4969-91ae-5d6475f4a3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:30.128131 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-1084e53a-5e0f-46d5-870d-89ba1e1751bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9fa72dccbd24765b3245630c15db430'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:30.128720 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a1d31-cbc4-4969-91ae-5d6475f4a3ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:30.129103 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a1d31-cbc4-4969-91ae-5d6475f4a3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:30.129623 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a1d31-cbc4-4969-91ae-5d6475f4a3ad admin admin] PATH_INFO: `/v3/users/bc595b98b773483cbb9acc98ebb58718` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:30.132391 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a1d31-cbc4-4969-91ae-5d6475f4a3ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc595b98b773483cbb9acc98ebb58718)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:30.134652 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a1d31-cbc4-4969-91ae-5d6475f4a3ad admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:30.142606 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:30.158318 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-1084e53a-5e0f-46d5-870d-89ba1e1751bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9fa72dccbd24765b3245630c15db430'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:30.159341 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-1084e53a-5e0f-46d5-870d-89ba1e1751bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9fa72dccbd24765b3245630c15db430'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:30.169655 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-1084e53a-5e0f-46d5-870d-89ba1e1751bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9fa72dccbd24765b3245630c15db430'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:30.189432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-1084e53a-5e0f-46d5-870d-89ba1e1751bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9fa72dccbd24765b3245630c15db430'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:30.198058 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 828/1658] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:54:29 2022] DELETE /identity/v3/users/d9fa72dccbd24765b3245630c15db430 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:30.234267 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-f42a1d31-cbc4-4969-91ae-5d6475f4a3ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc595b98b773483cbb9acc98ebb58718'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:30.259196 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-f42a1d31-cbc4-4969-91ae-5d6475f4a3ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc595b98b773483cbb9acc98ebb58718'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:30.260132 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-f42a1d31-cbc4-4969-91ae-5d6475f4a3ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc595b98b773483cbb9acc98ebb58718'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:30.269099 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-f42a1d31-cbc4-4969-91ae-5d6475f4a3ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc595b98b773483cbb9acc98ebb58718'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:30.271064 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:30.278265 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-f42a1d31-cbc4-4969-91ae-5d6475f4a3ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc595b98b773483cbb9acc98ebb58718'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:30.289251 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 831/1659] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:54:30 2022] DELETE /identity/v3/users/bc595b98b773483cbb9acc98ebb58718 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 10:54:30.294373 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12133a-5ff3-4ce3-9cca-2ed2131d66c4 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:30.294859 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12133a-5ff3-4ce3-9cca-2ed2131d66c4 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:30.294947 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12133a-5ff3-4ce3-9cca-2ed2131d66c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:30.360766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-7f12133a-5ff3-4ce3-9cca-2ed2131d66c4 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:30.362263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-7f12133a-5ff3-4ce3-9cca-2ed2131d66c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:30.498096 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 829/1660] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:30.526521 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a1d31-cbc4-4969-91ae-5d6475f4a3ad admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:30.528378 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-f42a1d31-cbc4-4969-91ae-5d6475f4a3ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:30.716431 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a1d31-cbc4-4969-91ae-5d6475f4a3ad admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:30.735867 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48554763-5164-47b3-9495-3e06d6ba32b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:30.736918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48554763-5164-47b3-9495-3e06d6ba32b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:30.737479 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48554763-5164-47b3-9495-3e06d6ba32b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:30.737972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48554763-5164-47b3-9495-3e06d6ba32b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:30.773551 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48554763-5164-47b3-9495-3e06d6ba32b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:30.776305 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48554763-5164-47b3-9495-3e06d6ba32b0 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:30.821877 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 832/1661] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:31.387347 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12133a-5ff3-4ce3-9cca-2ed2131d66c4 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:31.389875 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-7f12133a-5ff3-4ce3-9cca-2ed2131d66c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:31.426450 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12133a-5ff3-4ce3-9cca-2ed2131d66c4 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:31.434764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59715d2-c83b-4b38-bbaa-177c04fca7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:31.451179 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59715d2-c83b-4b38-bbaa-177c04fca7d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:31.453654 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59715d2-c83b-4b38-bbaa-177c04fca7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:31.455442 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59715d2-c83b-4b38-bbaa-177c04fca7d4 admin admin] PATH_INFO: `/v3/projects/538a7990320f43408a5c073ec08cf228` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:31.460269 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59715d2-c83b-4b38-bbaa-177c04fca7d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=538a7990320f43408a5c073ec08cf228)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:31.462498 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59715d2-c83b-4b38-bbaa-177c04fca7d4 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:31.560674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-f59715d2-c83b-4b38-bbaa-177c04fca7d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '538a7990320f43408a5c073ec08cf228', 'request_id': 'req-f59715d2-c83b-4b38-bbaa-177c04fca7d4'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:31.567394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-f59715d2-c83b-4b38-bbaa-177c04fca7d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '538a7990320f43408a5c073ec08cf228', 'request_id': 'req-f59715d2-c83b-4b38-bbaa-177c04fca7d4'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:31.575327 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-f59715d2-c83b-4b38-bbaa-177c04fca7d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '538a7990320f43408a5c073ec08cf228', 'request_id': 'req-f59715d2-c83b-4b38-bbaa-177c04fca7d4'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:31.622560 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-f59715d2-c83b-4b38-bbaa-177c04fca7d4 admin admin] The token cache is being invalidate because project 538a7990320f43408a5c073ec08cf228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:54:31.623102 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-f59715d2-c83b-4b38-bbaa-177c04fca7d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:31.624094 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-f59715d2-c83b-4b38-bbaa-177c04fca7d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:31.632880 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 830/1662] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:54:31 2022] DELETE /identity/v3/projects/538a7990320f43408a5c073ec08cf228 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:31.635461 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57713949-a87f-4df8-8afa-2c27024d82f5 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:31.635953 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57713949-a87f-4df8-8afa-2c27024d82f5 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:31.636627 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57713949-a87f-4df8-8afa-2c27024d82f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:31.671052 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-57713949-a87f-4df8-8afa-2c27024d82f5 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:31.680307 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-57713949-a87f-4df8-8afa-2c27024d82f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:31.819492 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 833/1663] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:31.828364 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59715d2-c83b-4b38-bbaa-177c04fca7d4 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:31.829019 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d529a07-bfad-45af-bd7e-e8b25345a855 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:31.829393 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d529a07-bfad-45af-bd7e-e8b25345a855 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:31.829807 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d529a07-bfad-45af-bd7e-e8b25345a855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:31.830498 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-f59715d2-c83b-4b38-bbaa-177c04fca7d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:31.846705 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59715d2-c83b-4b38-bbaa-177c04fca7d4 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:31.870860 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc423857-8a19-4b10-a59d-0c184880947e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:31.871971 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc423857-8a19-4b10-a59d-0c184880947e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:31.872914 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc423857-8a19-4b10-a59d-0c184880947e admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:31.873627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc423857-8a19-4b10-a59d-0c184880947e admin admin] PATH_INFO: `/v3/projects/30af769ba167467ca426159c154afeb7` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:31.874830 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-9d529a07-bfad-45af-bd7e-e8b25345a855 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:31.876292 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-9d529a07-bfad-45af-bd7e-e8b25345a855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:31.876779 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc423857-8a19-4b10-a59d-0c184880947e admin admin] RBAC: Authorizing `identity:delete_project(project_id=30af769ba167467ca426159c154afeb7)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:31.879308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc423857-8a19-4b10-a59d-0c184880947e admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:31.894134 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 834/1664] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:31.899845 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d529a07-bfad-45af-bd7e-e8b25345a855 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:31.920198 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d529a07-bfad-45af-bd7e-e8b25345a855 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:31.928439 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94783894-6655-4610-973a-48a2d1d1a337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:31.929962 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94783894-6655-4610-973a-48a2d1d1a337 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:31.930395 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94783894-6655-4610-973a-48a2d1d1a337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:31.930760 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94783894-6655-4610-973a-48a2d1d1a337 admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:31.933561 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94783894-6655-4610-973a-48a2d1d1a337 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:54:31.934210 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94783894-6655-4610-973a-48a2d1d1a337 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:31.938269 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94783894-6655-4610-973a-48a2d1d1a337 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:31.962118 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 835/1665] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:54:31.963160 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94783894-6655-4610-973a-48a2d1d1a337 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:31.985838 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94783894-6655-4610-973a-48a2d1d1a337 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:31.993098 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-fc423857-8a19-4b10-a59d-0c184880947e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30af769ba167467ca426159c154afeb7', 'request_id': 'req-fc423857-8a19-4b10-a59d-0c184880947e'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:31.996871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:32.014759 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-fc423857-8a19-4b10-a59d-0c184880947e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30af769ba167467ca426159c154afeb7', 'request_id': 'req-fc423857-8a19-4b10-a59d-0c184880947e'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:32.048615 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-fc423857-8a19-4b10-a59d-0c184880947e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30af769ba167467ca426159c154afeb7', 'request_id': 'req-fc423857-8a19-4b10-a59d-0c184880947e'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:32.081285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-fc423857-8a19-4b10-a59d-0c184880947e admin admin] The token cache is being invalidate because project 30af769ba167467ca426159c154afeb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:54:32.084887 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-fc423857-8a19-4b10-a59d-0c184880947e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:32.086405 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-fc423857-8a19-4b10-a59d-0c184880947e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:32.093535 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 831/1666] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:54:31 2022] DELETE /identity/v3/projects/30af769ba167467ca426159c154afeb7 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:32.098614 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc423857-8a19-4b10-a59d-0c184880947e admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:32.102489 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-fc423857-8a19-4b10-a59d-0c184880947e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:32.110494 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c7df9-3797-46d8-a948-7b0ff4424fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:32.111027 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c7df9-3797-46d8-a948-7b0ff4424fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:32.111308 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c7df9-3797-46d8-a948-7b0ff4424fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:32.111573 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c7df9-3797-46d8-a948-7b0ff4424fc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:32.112205 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c7df9-3797-46d8-a948-7b0ff4424fc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:32.114284 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c7df9-3797-46d8-a948-7b0ff4424fc2 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:32.151488 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc423857-8a19-4b10-a59d-0c184880947e admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:32.152290 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:32.165487 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 836/1667] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:54:31 2022] POST /identity/v3/projects => generated 403 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:32.166598 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c7df9-3797-46d8-a948-7b0ff4424fc2 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:32.168904 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-7a8c7df9-3797-46d8-a948-7b0ff4424fc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:32.169297 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55e89f-ded3-4aaa-9b80-e86de2b7cb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:32.173093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55e89f-ded3-4aaa-9b80-e86de2b7cb1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:32.173729 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55e89f-ded3-4aaa-9b80-e86de2b7cb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:32.174318 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55e89f-ded3-4aaa-9b80-e86de2b7cb1d admin admin] PATH_INFO: `/v3/users/eb2756e574734dbbab94ba77cacf5862` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:32.178011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55e89f-ded3-4aaa-9b80-e86de2b7cb1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb2756e574734dbbab94ba77cacf5862)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:32.184718 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55e89f-ded3-4aaa-9b80-e86de2b7cb1d admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:32.264155 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c7df9-3797-46d8-a948-7b0ff4424fc2 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:32.290826 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a8a87-c2ec-4f42-96fe-e85b102c19a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:32.291777 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a8a87-c2ec-4f42-96fe-e85b102c19a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:32.292256 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a8a87-c2ec-4f42-96fe-e85b102c19a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:32.292703 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a8a87-c2ec-4f42-96fe-e85b102c19a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:32.293588 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a8a87-c2ec-4f42-96fe-e85b102c19a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:32.295840 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a8a87-c2ec-4f42-96fe-e85b102c19a7 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:32.314978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5c55e89f-ded3-4aaa-9b80-e86de2b7cb1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb2756e574734dbbab94ba77cacf5862'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:32.343791 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 837/1668] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:54:32 2022] POST /identity/v3/users => generated 302 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:32.345946 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5c55e89f-ded3-4aaa-9b80-e86de2b7cb1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb2756e574734dbbab94ba77cacf5862'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:32.354225 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a8a87-c2ec-4f42-96fe-e85b102c19a7 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:32.355440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5c55e89f-ded3-4aaa-9b80-e86de2b7cb1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb2756e574734dbbab94ba77cacf5862'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:32.369637 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5c55e89f-ded3-4aaa-9b80-e86de2b7cb1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb2756e574734dbbab94ba77cacf5862'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:32.379911 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a8a87-c2ec-4f42-96fe-e85b102c19a7 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:32.384964 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5c55e89f-ded3-4aaa-9b80-e86de2b7cb1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb2756e574734dbbab94ba77cacf5862'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:32.391948 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182916de-1100-4db9-8c05-d9b69fa8e249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:32.393764 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182916de-1100-4db9-8c05-d9b69fa8e249 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:32.394054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182916de-1100-4db9-8c05-d9b69fa8e249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:32.394376 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182916de-1100-4db9-8c05-d9b69fa8e249 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:32.398245 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182916de-1100-4db9-8c05-d9b69fa8e249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:32.401130 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 832/1669] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:54:32 2022] DELETE /identity/v3/users/eb2756e574734dbbab94ba77cacf5862 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:32.402517 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182916de-1100-4db9-8c05-d9b69fa8e249 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:32.430124 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 838/1670] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:32.431688 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55e89f-ded3-4aaa-9b80-e86de2b7cb1d admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:32.433408 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-5c55e89f-ded3-4aaa-9b80-e86de2b7cb1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:32.564198 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182916de-1100-4db9-8c05-d9b69fa8e249 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:32.567076 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-182916de-1100-4db9-8c05-d9b69fa8e249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:32.567215 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55e89f-ded3-4aaa-9b80-e86de2b7cb1d admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:32.577746 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f9a89-fec7-4bbc-96d3-5be7b0803db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:32.578645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f9a89-fec7-4bbc-96d3-5be7b0803db0 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:32.578992 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f9a89-fec7-4bbc-96d3-5be7b0803db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:32.579368 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f9a89-fec7-4bbc-96d3-5be7b0803db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:32.580170 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f9a89-fec7-4bbc-96d3-5be7b0803db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:32.584590 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f9a89-fec7-4bbc-96d3-5be7b0803db0 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:32.588575 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182916de-1100-4db9-8c05-d9b69fa8e249 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:32.595898 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca856e-e91c-414a-bc02-18040c91869e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:32.597619 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca856e-e91c-414a-bc02-18040c91869e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:32.598101 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca856e-e91c-414a-bc02-18040c91869e admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:32.598582 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca856e-e91c-414a-bc02-18040c91869e admin admin] PATH_INFO: `/v3/projects/3cb7bd62e83f4aff82c8543a83867128` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:32.601564 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca856e-e91c-414a-bc02-18040c91869e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cb7bd62e83f4aff82c8543a83867128)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:32.603818 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca856e-e91c-414a-bc02-18040c91869e admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:32.621877 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 833/1671] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:32.622860 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f9a89-fec7-4bbc-96d3-5be7b0803db0 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:32.625349 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-f44f9a89-fec7-4bbc-96d3-5be7b0803db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:32.648701 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f9a89-fec7-4bbc-96d3-5be7b0803db0 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:32.664074 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590c293-efd2-470e-bb23-74685fc64401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:32.665885 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590c293-efd2-470e-bb23-74685fc64401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:32.666328 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590c293-efd2-470e-bb23-74685fc64401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:32.666906 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590c293-efd2-470e-bb23-74685fc64401 admin admin] PATH_INFO: `/v3/projects/584b0e887fee40aaae63cc9332de2aac` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:32.668446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590c293-efd2-470e-bb23-74685fc64401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=584b0e887fee40aaae63cc9332de2aac)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:32.671498 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590c293-efd2-470e-bb23-74685fc64401 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:32.733356 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-66ca856e-e91c-414a-bc02-18040c91869e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cb7bd62e83f4aff82c8543a83867128', 'request_id': 'req-66ca856e-e91c-414a-bc02-18040c91869e'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:32.770783 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-66ca856e-e91c-414a-bc02-18040c91869e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cb7bd62e83f4aff82c8543a83867128', 'request_id': 'req-66ca856e-e91c-414a-bc02-18040c91869e'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:32.782520 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-66ca856e-e91c-414a-bc02-18040c91869e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cb7bd62e83f4aff82c8543a83867128', 'request_id': 'req-66ca856e-e91c-414a-bc02-18040c91869e'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:32.784102 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:32.792719 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-1590c293-efd2-470e-bb23-74685fc64401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '584b0e887fee40aaae63cc9332de2aac', 'request_id': 'req-1590c293-efd2-470e-bb23-74685fc64401'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:32.807772 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-1590c293-efd2-470e-bb23-74685fc64401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '584b0e887fee40aaae63cc9332de2aac', 'request_id': 'req-1590c293-efd2-470e-bb23-74685fc64401'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:32.816529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-66ca856e-e91c-414a-bc02-18040c91869e admin admin] The token cache is being invalidate because project 3cb7bd62e83f4aff82c8543a83867128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:54:32.816827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-66ca856e-e91c-414a-bc02-18040c91869e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:32.817753 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-66ca856e-e91c-414a-bc02-18040c91869e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:32.819576 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-1590c293-efd2-470e-bb23-74685fc64401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '584b0e887fee40aaae63cc9332de2aac', 'request_id': 'req-1590c293-efd2-470e-bb23-74685fc64401'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:32.820042 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 839/1672] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:54:32 2022] DELETE /identity/v3/projects/3cb7bd62e83f4aff82c8543a83867128 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 10:54:32.820706 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca856e-e91c-414a-bc02-18040c91869e admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:32.822042 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-66ca856e-e91c-414a-bc02-18040c91869e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:32.854415 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-1590c293-efd2-470e-bb23-74685fc64401 admin admin] The token cache is being invalidate because project 584b0e887fee40aaae63cc9332de2aac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:54:32.854813 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-1590c293-efd2-470e-bb23-74685fc64401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:32.857424 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-1590c293-efd2-470e-bb23-74685fc64401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:32.870709 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 834/1673] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:54:32 2022] DELETE /identity/v3/projects/584b0e887fee40aaae63cc9332de2aac => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:32.872454 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeaebb6-2150-4574-ab4d-efbe67e0e2cf None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:32.872843 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeaebb6-2150-4574-ab4d-efbe67e0e2cf None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:32.874978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeaebb6-2150-4574-ab4d-efbe67e0e2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:32.921051 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-baeaebb6-2150-4574-ab4d-efbe67e0e2cf None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:32.923539 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-baeaebb6-2150-4574-ab4d-efbe67e0e2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:32.974653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca856e-e91c-414a-bc02-18040c91869e admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:32.992632 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:33.135353 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 835/1674] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:33.150019 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd6853-50dd-4382-83a1-fe68a076096b None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:33.150360 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd6853-50dd-4382-83a1-fe68a076096b None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:33.150571 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd6853-50dd-4382-83a1-fe68a076096b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:33.174092 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab41eda-97c4-4adf-9c9a-fc5824a4b3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:33.175492 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab41eda-97c4-4adf-9c9a-fc5824a4b3db admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:33.176288 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab41eda-97c4-4adf-9c9a-fc5824a4b3db admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:33.176288 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab41eda-97c4-4adf-9c9a-fc5824a4b3db admin admin] PATH_INFO: `/v3/projects/c17ad37918004eca81e904ea2000bf95/users/3ef9b1c6a92445b9a69aaa0628786e85/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:33.203662 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab41eda-97c4-4adf-9c9a-fc5824a4b3db admin admin] RBAC: Authorizing `identity:create_grant(project_id=c17ad37918004eca81e904ea2000bf95, user_id=3ef9b1c6a92445b9a69aaa0628786e85, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:33.206932 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab41eda-97c4-4adf-9c9a-fc5824a4b3db admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:33.217298 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-b6bd6853-50dd-4382-83a1-fe68a076096b None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:33.221445 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-b6bd6853-50dd-4382-83a1-fe68a076096b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:33.237462 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 840/1675] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:54:32 2022] PUT /identity/v3/projects/c17ad37918004eca81e904ea2000bf95/users/3ef9b1c6a92445b9a69aaa0628786e85/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:33.237462 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf5b7d-3b2d-418b-98fc-1da4b8846ec4 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:33.237462 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf5b7d-3b2d-418b-98fc-1da4b8846ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:33.237462 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf5b7d-3b2d-418b-98fc-1da4b8846ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:33.273750 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-cbaf5b7d-3b2d-418b-98fc-1da4b8846ec4 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:33.275450 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-cbaf5b7d-3b2d-418b-98fc-1da4b8846ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:33.436861 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 841/1676] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:33.440421 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893ecf0-afae-4521-9f5b-2bd689504270 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:33.441213 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893ecf0-afae-4521-9f5b-2bd689504270 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:33.442391 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893ecf0-afae-4521-9f5b-2bd689504270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:33.452764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 836/1677] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:33.454767 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd6853-50dd-4382-83a1-fe68a076096b None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:33.484092 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd6853-50dd-4382-83a1-fe68a076096b None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:33.492591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d735ada-f21b-4d6f-9573-af3a03d4ae01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:33.493214 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d735ada-f21b-4d6f-9573-af3a03d4ae01 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:33.493511 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d735ada-f21b-4d6f-9573-af3a03d4ae01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:33.493784 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d735ada-f21b-4d6f-9573-af3a03d4ae01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:33.494806 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d735ada-f21b-4d6f-9573-af3a03d4ae01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:54:33.494806 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d735ada-f21b-4d6f-9573-af3a03d4ae01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:33.496787 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d735ada-f21b-4d6f-9573-af3a03d4ae01 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:33.525425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 837/1678] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:54:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:54:33.526723 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4f061-fb7b-4381-a9fd-40e46a324638 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:33.527009 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4f061-fb7b-4381-a9fd-40e46a324638 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:33.527372 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4f061-fb7b-4381-a9fd-40e46a324638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:33.530970 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-1893ecf0-afae-4521-9f5b-2bd689504270 None None] MFA Rules not processed for user `3ef9b1c6a92445b9a69aaa0628786e85`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:33.532219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-1893ecf0-afae-4521-9f5b-2bd689504270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:33.572898 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-8cd4f061-fb7b-4381-a9fd-40e46a324638 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:33.574160 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-8cd4f061-fb7b-4381-a9fd-40e46a324638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:33.604872 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 838/1679] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:33.608330 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4f061-fb7b-4381-a9fd-40e46a324638 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:33.629956 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4f061-fb7b-4381-a9fd-40e46a324638 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:33.645227 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9d954-32ec-4684-9298-7fef0d9450f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:33.646007 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9d954-32ec-4684-9298-7fef0d9450f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:33.646376 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9d954-32ec-4684-9298-7fef0d9450f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:33.647031 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9d954-32ec-4684-9298-7fef0d9450f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:33.647678 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9d954-32ec-4684-9298-7fef0d9450f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:33.649638 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9d954-32ec-4684-9298-7fef0d9450f2 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:33.683924 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 842/1680] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:33 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:33.684930 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893ecf0-afae-4521-9f5b-2bd689504270 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:33.699210 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 839/1681] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:54:33 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:33.700222 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9d954-32ec-4684-9298-7fef0d9450f2 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:33.702172 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-eca9d954-32ec-4684-9298-7fef0d9450f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:33.706211 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893ecf0-afae-4521-9f5b-2bd689504270 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:33.764099 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:33.836637 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:33.838931 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13239f01-938b-4d8d-ae2f-c0fd229f349d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:33.839557 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13239f01-938b-4d8d-ae2f-c0fd229f349d admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:33.839933 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13239f01-938b-4d8d-ae2f-c0fd229f349d admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:33.840197 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13239f01-938b-4d8d-ae2f-c0fd229f349d admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:33.840916 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13239f01-938b-4d8d-ae2f-c0fd229f349d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:54:33.841216 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13239f01-938b-4d8d-ae2f-c0fd229f349d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:33.845193 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13239f01-938b-4d8d-ae2f-c0fd229f349d admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:33.902838 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 843/1682] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:54:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:54:33.905586 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13239f01-938b-4d8d-ae2f-c0fd229f349d admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:33.916069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9d954-32ec-4684-9298-7fef0d9450f2 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:33.926028 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13239f01-938b-4d8d-ae2f-c0fd229f349d admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:33.926249 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2ac2e-1b94-489a-8a31-21caba541ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:33.926743 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2ac2e-1b94-489a-8a31-21caba541ead admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:33.927040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2ac2e-1b94-489a-8a31-21caba541ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:33.927391 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2ac2e-1b94-489a-8a31-21caba541ead admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:33.929788 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2ac2e-1b94-489a-8a31-21caba541ead admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:33.932113 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2ac2e-1b94-489a-8a31-21caba541ead admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:33.939118 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859f232-13a4-43da-a487-3cf41bce6bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:33.939752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859f232-13a4-43da-a487-3cf41bce6bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:33.940027 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859f232-13a4-43da-a487-3cf41bce6bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:33.941383 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859f232-13a4-43da-a487-3cf41bce6bf5 admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:33.942040 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859f232-13a4-43da-a487-3cf41bce6bf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:33.947270 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859f232-13a4-43da-a487-3cf41bce6bf5 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:33.992134 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 840/1683] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:54:33 2022] POST /identity/v3/projects => generated 405 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:33.993106 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2ac2e-1b94-489a-8a31-21caba541ead admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:34.001204 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 844/1684] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:54:33 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:34.002601 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859f232-13a4-43da-a487-3cf41bce6bf5 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:34.026891 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859f232-13a4-43da-a487-3cf41bce6bf5 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:34.134679 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2ac2e-1b94-489a-8a31-21caba541ead admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:34.169116 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12022b2-978b-4448-9cfb-17b6f9a61ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:34.170022 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12022b2-978b-4448-9cfb-17b6f9a61ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:34.170300 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12022b2-978b-4448-9cfb-17b6f9a61ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:34.170565 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12022b2-978b-4448-9cfb-17b6f9a61ce1 admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:34.171096 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cbbbf-ae69-41db-9332-3d89e20f42d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:34.171224 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12022b2-978b-4448-9cfb-17b6f9a61ce1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:34.171955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cbbbf-ae69-41db-9332-3d89e20f42d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:34.172391 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cbbbf-ae69-41db-9332-3d89e20f42d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:34.172783 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cbbbf-ae69-41db-9332-3d89e20f42d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:34.173579 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0cbbbf-ae69-41db-9332-3d89e20f42d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:34.174696 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12022b2-978b-4448-9cfb-17b6f9a61ce1 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:34.175709 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0cbbbf-ae69-41db-9332-3d89e20f42d9 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:34.239171 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 845/1685] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:54:34 2022] POST /identity/v3/users => generated 309 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:34.240120 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12022b2-978b-4448-9cfb-17b6f9a61ce1 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:34.260253 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 841/1686] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:54:33 2022] POST /identity/v3/projects => generated 377 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:34.261226 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cbbbf-ae69-41db-9332-3d89e20f42d9 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:34.263096 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12022b2-978b-4448-9cfb-17b6f9a61ce1 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:34.266297 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-5d0cbbbf-ae69-41db-9332-3d89e20f42d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:34.398012 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf10db2-53d9-4575-ba8d-ddeaaf40283f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:34.398964 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf10db2-53d9-4575-ba8d-ddeaaf40283f admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:34.399424 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf10db2-53d9-4575-ba8d-ddeaaf40283f admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:34.399872 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf10db2-53d9-4575-ba8d-ddeaaf40283f admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:34.400724 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf10db2-53d9-4575-ba8d-ddeaaf40283f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:34.402870 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf10db2-53d9-4575-ba8d-ddeaaf40283f admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:34.418563 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cbbbf-ae69-41db-9332-3d89e20f42d9 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:34.432154 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95823295-efd3-478a-8860-cfa163699361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:34.432835 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95823295-efd3-478a-8860-cfa163699361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:34.433134 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95823295-efd3-478a-8860-cfa163699361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:34.436178 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95823295-efd3-478a-8860-cfa163699361 admin admin] PATH_INFO: `/v3/projects/ea9d8605de7b42fbba8727a7f1403633` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:34.436178 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95823295-efd3-478a-8860-cfa163699361 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea9d8605de7b42fbba8727a7f1403633)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:34.436900 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 846/1687] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:34.437480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95823295-efd3-478a-8860-cfa163699361 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:34.438288 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf10db2-53d9-4575-ba8d-ddeaaf40283f admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:34.462685 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf10db2-53d9-4575-ba8d-ddeaaf40283f admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:34.479097 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797759a-584c-4033-998e-3556b0d89e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:34.479820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797759a-584c-4033-998e-3556b0d89e81 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:34.480140 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797759a-584c-4033-998e-3556b0d89e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:34.480464 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797759a-584c-4033-998e-3556b0d89e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:34.481218 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797759a-584c-4033-998e-3556b0d89e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:34.484595 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797759a-584c-4033-998e-3556b0d89e81 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:34.519637 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 847/1688] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:34.519637 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797759a-584c-4033-998e-3556b0d89e81 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:34.533152 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:34.540766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-95823295-efd3-478a-8860-cfa163699361 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea9d8605de7b42fbba8727a7f1403633', 'request_id': 'req-95823295-efd3-478a-8860-cfa163699361'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:34.543176 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797759a-584c-4033-998e-3556b0d89e81 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:34.556530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-95823295-efd3-478a-8860-cfa163699361 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea9d8605de7b42fbba8727a7f1403633', 'request_id': 'req-95823295-efd3-478a-8860-cfa163699361'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:34.563946 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-95823295-efd3-478a-8860-cfa163699361 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea9d8605de7b42fbba8727a7f1403633', 'request_id': 'req-95823295-efd3-478a-8860-cfa163699361'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:34.573345 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:34.594599 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-95823295-efd3-478a-8860-cfa163699361 admin admin] The token cache is being invalidate because project ea9d8605de7b42fbba8727a7f1403633 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:54:34.595213 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-95823295-efd3-478a-8860-cfa163699361 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:34.598770 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-95823295-efd3-478a-8860-cfa163699361 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:34.607040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 842/1689] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:54:34 2022] DELETE /identity/v3/projects/ea9d8605de7b42fbba8727a7f1403633 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:34.607040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95823295-efd3-478a-8860-cfa163699361 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:34.610815 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-95823295-efd3-478a-8860-cfa163699361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:34.745702 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b36f3c-90ce-45a8-9d0f-c24667431328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:34.746692 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b36f3c-90ce-45a8-9d0f-c24667431328 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:34.747074 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b36f3c-90ce-45a8-9d0f-c24667431328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:34.747451 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b36f3c-90ce-45a8-9d0f-c24667431328 admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:34.748267 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b36f3c-90ce-45a8-9d0f-c24667431328 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:34.752484 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b36f3c-90ce-45a8-9d0f-c24667431328 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:34.799598 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95823295-efd3-478a-8860-cfa163699361 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:34.801348 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 848/1690] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:54:34 2022] POST /identity/v3/users => generated 289 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:34.802523 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b36f3c-90ce-45a8-9d0f-c24667431328 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:34.807325 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-97b36f3c-90ce-45a8-9d0f-c24667431328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:34.813897 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18766aa0-819f-4d23-bdb5-5c2538fb0fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:34.814524 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18766aa0-819f-4d23-bdb5-5c2538fb0fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:34.814800 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18766aa0-819f-4d23-bdb5-5c2538fb0fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:34.815068 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18766aa0-819f-4d23-bdb5-5c2538fb0fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:34.815727 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18766aa0-819f-4d23-bdb5-5c2538fb0fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:34.817342 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18766aa0-819f-4d23-bdb5-5c2538fb0fe6 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:34.830913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b36f3c-90ce-45a8-9d0f-c24667431328 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:34.842150 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 843/1691] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:34.843118 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68aa86-e9a4-47b1-9982-baa7142ce4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:34.843973 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68aa86-e9a4-47b1-9982-baa7142ce4a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:34.845557 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68aa86-e9a4-47b1-9982-baa7142ce4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:34.845989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68aa86-e9a4-47b1-9982-baa7142ce4a5 admin admin] PATH_INFO: `/v3/projects/ea7ee880da954a01ade121c2527e3b14/users/047e744b6e8043df9965c8b29dbd2e84/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:34.846583 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efddb44-4f6d-42a3-a163-559808432e06 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:34.846865 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efddb44-4f6d-42a3-a163-559808432e06 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:34.847135 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efddb44-4f6d-42a3-a163-559808432e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:34.891456 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-6efddb44-4f6d-42a3-a163-559808432e06 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:34.893168 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-6efddb44-4f6d-42a3-a163-559808432e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:34.913066 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68aa86-e9a4-47b1-9982-baa7142ce4a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea7ee880da954a01ade121c2527e3b14, user_id=047e744b6e8043df9965c8b29dbd2e84, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:34.916407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68aa86-e9a4-47b1-9982-baa7142ce4a5 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:34.917689 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 844/1692] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:34.918537 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efddb44-4f6d-42a3-a163-559808432e06 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:34.926737 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-6efddb44-4f6d-42a3-a163-559808432e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:34.947185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 849/1693] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:54:34 2022] PUT /identity/v3/projects/ea7ee880da954a01ade121c2527e3b14/users/047e744b6e8043df9965c8b29dbd2e84/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:34.948380 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68aa86-e9a4-47b1-9982-baa7142ce4a5 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:34.954914 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efddb44-4f6d-42a3-a163-559808432e06 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:35.081101 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68aa86-e9a4-47b1-9982-baa7142ce4a5 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:35.095954 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72aa7d9-d067-4108-81e0-f41de1e1625a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:35.100099 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72aa7d9-d067-4108-81e0-f41de1e1625a admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:35.100380 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72aa7d9-d067-4108-81e0-f41de1e1625a admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:35.100663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72aa7d9-d067-4108-81e0-f41de1e1625a admin admin] PATH_INFO: `/v3/projects/0d46a72297ec4d27871f3591b6f44f8c/users/ec876c5a22454a3d9d81071442994dda/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:35.105334 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c0c59-3498-4e24-9c9d-627c39d81018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:35.105958 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c0c59-3498-4e24-9c9d-627c39d81018 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:35.106232 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c0c59-3498-4e24-9c9d-627c39d81018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:35.106575 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c0c59-3498-4e24-9c9d-627c39d81018 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:35.107234 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c0c59-3498-4e24-9c9d-627c39d81018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:35.108857 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c0c59-3498-4e24-9c9d-627c39d81018 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:35.136133 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 845/1694] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:35.137770 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bd50c-90fa-42ea-8989-d0ee07b68fe7 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:35.137770 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bd50c-90fa-42ea-8989-d0ee07b68fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:35.138059 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bd50c-90fa-42ea-8989-d0ee07b68fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:35.138234 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72aa7d9-d067-4108-81e0-f41de1e1625a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d46a72297ec4d27871f3591b6f44f8c, user_id=ec876c5a22454a3d9d81071442994dda, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:35.141222 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72aa7d9-d067-4108-81e0-f41de1e1625a admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:35.165081 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-ba5bd50c-90fa-42ea-8989-d0ee07b68fe7 None None] MFA Rules not processed for user `cba1a3bf0e1f49e885e4c833549be406`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:35.166692 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ba5bd50c-90fa-42ea-8989-d0ee07b68fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:35.175890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 850/1695] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:54:34 2022] PUT /identity/v3/projects/0d46a72297ec4d27871f3591b6f44f8c/users/ec876c5a22454a3d9d81071442994dda/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:35.177258 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad0b9c-55b5-4806-802b-f7b0ad7d12a0 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:35.177519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad0b9c-55b5-4806-802b-f7b0ad7d12a0 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:35.177861 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad0b9c-55b5-4806-802b-f7b0ad7d12a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:35.224944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-d3ad0b9c-55b5-4806-802b-f7b0ad7d12a0 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:35.230139 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-d3ad0b9c-55b5-4806-802b-f7b0ad7d12a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:35.304073 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 846/1696] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:35.305872 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bd50c-90fa-42ea-8989-d0ee07b68fe7 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:35.320314 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:35.383987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 851/1697] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:35.383987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ca4ac-a7a6-4577-bb3f-3930152038d9 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:35.383987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ca4ac-a7a6-4577-bb3f-3930152038d9 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:35.383987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ca4ac-a7a6-4577-bb3f-3930152038d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:35.395683 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:35.446435 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bd50c-90fa-42ea-8989-d0ee07b68fe7 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:35.453652 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d663ec2-91f0-493e-94c4-1089bd8df23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:35.454953 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d663ec2-91f0-493e-94c4-1089bd8df23c admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:35.454953 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d663ec2-91f0-493e-94c4-1089bd8df23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:35.455640 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d663ec2-91f0-493e-94c4-1089bd8df23c admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:35.456576 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d663ec2-91f0-493e-94c4-1089bd8df23c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:35.458460 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d663ec2-91f0-493e-94c4-1089bd8df23c admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:35.460059 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-9f0ca4ac-a7a6-4577-bb3f-3930152038d9 None None] MFA Rules not processed for user `2eda8def7e754c869cd5ca64498e5c98`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:35.463312 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-9f0ca4ac-a7a6-4577-bb3f-3930152038d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:35.473153 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 847/1698] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:35.474361 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d663ec2-91f0-493e-94c4-1089bd8df23c admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:35.493605 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d663ec2-91f0-493e-94c4-1089bd8df23c admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:35.501357 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e46a80-f0e5-4cdb-8834-216509d17089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:35.502844 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e46a80-f0e5-4cdb-8834-216509d17089 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:35.503251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e46a80-f0e5-4cdb-8834-216509d17089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:35.503866 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e46a80-f0e5-4cdb-8834-216509d17089 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:35.504781 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e46a80-f0e5-4cdb-8834-216509d17089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:35.508330 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e46a80-f0e5-4cdb-8834-216509d17089 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:35.524357 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 848/1699] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:35.530283 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7992ab8-8ac4-4cf3-8353-15d4e63e4d94 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:35.530707 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7992ab8-8ac4-4cf3-8353-15d4e63e4d94 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:35.531084 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7992ab8-8ac4-4cf3-8353-15d4e63e4d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:35.575066 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-e7992ab8-8ac4-4cf3-8353-15d4e63e4d94 None None] MFA Rules not processed for user `ec876c5a22454a3d9d81071442994dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:35.576538 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-e7992ab8-8ac4-4cf3-8353-15d4e63e4d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:35.603169 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 852/1700] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:35.603768 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ca4ac-a7a6-4577-bb3f-3930152038d9 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:35.626891 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ca4ac-a7a6-4577-bb3f-3930152038d9 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:35.634579 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d1b9d-20dc-46eb-9b35-f7da308d5224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:35.635132 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d1b9d-20dc-46eb-9b35-f7da308d5224 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:35.635403 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d1b9d-20dc-46eb-9b35-f7da308d5224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:35.635665 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d1b9d-20dc-46eb-9b35-f7da308d5224 admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:35.636321 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d1b9d-20dc-46eb-9b35-f7da308d5224 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:54:35.636615 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d1b9d-20dc-46eb-9b35-f7da308d5224 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:35.638233 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d1b9d-20dc-46eb-9b35-f7da308d5224 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:35.665064 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 853/1701] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:54:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:54:35.665807 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d1b9d-20dc-46eb-9b35-f7da308d5224 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:35.699519 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 849/1702] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:35.700579 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7992ab8-8ac4-4cf3-8353-15d4e63e4d94 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:35.710882 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d1b9d-20dc-46eb-9b35-f7da308d5224 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:35.721089 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2750140-a4ed-4686-820e-e0eac14ba206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:35.721800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2750140-a4ed-4686-820e-e0eac14ba206 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:35.722075 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2750140-a4ed-4686-820e-e0eac14ba206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:35.722342 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2750140-a4ed-4686-820e-e0eac14ba206 admin admin] PATH_INFO: `/v3/projects/ea7ee880da954a01ade121c2527e3b14/users/047e744b6e8043df9965c8b29dbd2e84/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:35.726394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2750140-a4ed-4686-820e-e0eac14ba206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea7ee880da954a01ade121c2527e3b14, user_id=047e744b6e8043df9965c8b29dbd2e84, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:35.729155 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2750140-a4ed-4686-820e-e0eac14ba206 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:35.730622 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7992ab8-8ac4-4cf3-8353-15d4e63e4d94 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:35.743452 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44bada-823a-4960-a13c-e51504155034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:35.744302 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44bada-823a-4960-a13c-e51504155034 admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:35.744691 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44bada-823a-4960-a13c-e51504155034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:35.745075 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44bada-823a-4960-a13c-e51504155034 admin admin] PATH_INFO: `/v3/projects/84abdba45e474aa7981fbae91aae7bd2/users/9b8876d3eb9243baab46bd652271b726/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:35.759663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 854/1703] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:54:35 2022] PUT /identity/v3/projects/ea7ee880da954a01ade121c2527e3b14/users/047e744b6e8043df9965c8b29dbd2e84/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:35.759663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394db6b-0766-4310-9c78-5c4fe58c8c3d None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:35.759663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394db6b-0766-4310-9c78-5c4fe58c8c3d None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:35.759663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394db6b-0766-4310-9c78-5c4fe58c8c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:35.788023 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44bada-823a-4960-a13c-e51504155034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84abdba45e474aa7981fbae91aae7bd2, user_id=9b8876d3eb9243baab46bd652271b726, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:35.790519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-2394db6b-0766-4310-9c78-5c4fe58c8c3d None None] MFA Rules not processed for user `2eda8def7e754c869cd5ca64498e5c98`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:35.791047 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44bada-823a-4960-a13c-e51504155034 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:35.791821 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-2394db6b-0766-4310-9c78-5c4fe58c8c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:35.822190 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 850/1704] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:54:35 2022] PUT /identity/v3/projects/84abdba45e474aa7981fbae91aae7bd2/users/9b8876d3eb9243baab46bd652271b726/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:35.824273 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44bada-823a-4960-a13c-e51504155034 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:35.900390 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 855/1705] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:35.901774 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394db6b-0766-4310-9c78-5c4fe58c8c3d None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:35.903253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-2394db6b-0766-4310-9c78-5c4fe58c8c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:35.913461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:35.929269 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44bada-823a-4960-a13c-e51504155034 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:35.935711 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192da354-51b9-4a2b-858a-cd4c4cbc6100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:35.936719 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192da354-51b9-4a2b-858a-cd4c4cbc6100 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:35.937111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192da354-51b9-4a2b-858a-cd4c4cbc6100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:35.937803 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192da354-51b9-4a2b-858a-cd4c4cbc6100 admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:35.938453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192da354-51b9-4a2b-858a-cd4c4cbc6100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:35.941718 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192da354-51b9-4a2b-858a-cd4c4cbc6100 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:35.982528 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 851/1706] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:54:35 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:35.983990 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7c530-a6bb-49fe-a45c-383a2a82acd5 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:35.984765 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7c530-a6bb-49fe-a45c-383a2a82acd5 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:35.985346 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7c530-a6bb-49fe-a45c-383a2a82acd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:36.025484 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-06f7c530-a6bb-49fe-a45c-383a2a82acd5 None None] MFA Rules not processed for user `047e744b6e8043df9965c8b29dbd2e84`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:36.036917 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-06f7c530-a6bb-49fe-a45c-383a2a82acd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:36.051979 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394db6b-0766-4310-9c78-5c4fe58c8c3d None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:36.058992 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:36.140905 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 852/1707] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:35 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:36.142926 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025fc71-fe68-44ef-a950-04a3449bc53c None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:36.143355 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025fc71-fe68-44ef-a950-04a3449bc53c None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:36.143731 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025fc71-fe68-44ef-a950-04a3449bc53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:36.162761 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082ce05-d4b6-47eb-9883-4250bbccab83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:36.163637 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082ce05-d4b6-47eb-9883-4250bbccab83 service nova] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:36.163921 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082ce05-d4b6-47eb-9883-4250bbccab83 service nova] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:36.164191 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082ce05-d4b6-47eb-9883-4250bbccab83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:36.188970 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-3025fc71-fe68-44ef-a950-04a3449bc53c None None] MFA Rules not processed for user `9b8876d3eb9243baab46bd652271b726`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:36.191403 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-3025fc71-fe68-44ef-a950-04a3449bc53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:36.353990 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082ce05-d4b6-47eb-9883-4250bbccab83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:36.355949 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082ce05-d4b6-47eb-9883-4250bbccab83 service nova] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:36.386480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 853/1708] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:36.388042 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025fc71-fe68-44ef-a950-04a3449bc53c None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:36.416961 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 856/1709] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:36.418719 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082ce05-d4b6-47eb-9883-4250bbccab83 service nova] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:36.423363 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-8082ce05-d4b6-47eb-9883-4250bbccab83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:36.457421 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:36.480102 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025fc71-fe68-44ef-a950-04a3449bc53c None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:36.486652 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac140848-50fc-4744-b271-67c736f7197d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:36.487269 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac140848-50fc-4744-b271-67c736f7197d admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:36.487547 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac140848-50fc-4744-b271-67c736f7197d admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:36.487818 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac140848-50fc-4744-b271-67c736f7197d admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:36.488450 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac140848-50fc-4744-b271-67c736f7197d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:36.490751 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac140848-50fc-4744-b271-67c736f7197d admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:36.515433 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082ce05-d4b6-47eb-9883-4250bbccab83 service nova] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:36.519865 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781ec48-0b77-4894-9d7d-fad0da3a3557 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:36.520816 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781ec48-0b77-4894-9d7d-fad0da3a3557 service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:36.521752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781ec48-0b77-4894-9d7d-fad0da3a3557 service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:36.522259 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781ec48-0b77-4894-9d7d-fad0da3a3557 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:36.527842 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 854/1710] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:54:36 2022] POST /identity/v3/users => generated 287 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:36.529375 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe406f-6d65-4bd1-8c51-94c7c0791ef3 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:36.529945 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe406f-6d65-4bd1-8c51-94c7c0791ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:36.530361 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe406f-6d65-4bd1-8c51-94c7c0791ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:36.534532 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781ec48-0b77-4894-9d7d-fad0da3a3557 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:36.536378 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781ec48-0b77-4894-9d7d-fad0da3a3557 service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:36.550599 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 857/1711] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:36 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:36.553458 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe84563-c781-40a3-b60e-d471f7584de5 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:36.554028 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe84563-c781-40a3-b60e-d471f7584de5 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:36.554619 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe84563-c781-40a3-b60e-d471f7584de5 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:36.556542 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 858/1712] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 7 10:54:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:54:36.557952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdd89f-8ac4-4279-a0e5-cd67a2431fbd None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:36.558536 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdd89f-8ac4-4279-a0e5-cd67a2431fbd None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:36.559014 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdd89f-8ac4-4279-a0e5-cd67a2431fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:36.590972 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-9fbe406f-6d65-4bd1-8c51-94c7c0791ef3 None None] MFA Rules not processed for user `ca2075ca15d44405a71e24955ec99da4`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:36.592311 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-9fbe406f-6d65-4bd1-8c51-94c7c0791ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:36.601935 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-59cdd89f-8ac4-4279-a0e5-cd67a2431fbd None None] MFA Rules not processed for user `7696bfdd618a47eb91753adb60ea7812`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:36.608598 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-59cdd89f-8ac4-4279-a0e5-cd67a2431fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:36.706137 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:36.760660 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 859/1713] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:36.763415 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cdd89f-8ac4-4279-a0e5-cd67a2431fbd None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:36.767025 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 855/1714] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:36.768776 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe406f-6d65-4bd1-8c51-94c7c0791ef3 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:36.789172 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cdd89f-8ac4-4279-a0e5-cd67a2431fbd None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:36.793272 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe406f-6d65-4bd1-8c51-94c7c0791ef3 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:36.796995 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c79d4b-a251-4c12-a3fb-3a9d245f15a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:36.798173 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c79d4b-a251-4c12-a3fb-3a9d245f15a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:36.798794 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c79d4b-a251-4c12-a3fb-3a9d245f15a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:36.799597 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c79d4b-a251-4c12-a3fb-3a9d245f15a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:36.800417 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c79d4b-a251-4c12-a3fb-3a9d245f15a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:36.803148 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c79d4b-a251-4c12-a3fb-3a9d245f15a1 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:36.805783 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956415cb-e2ee-4181-b758-7a3e4f93a7d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:36.806775 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956415cb-e2ee-4181-b758-7a3e4f93a7d5 service nova] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:36.807051 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956415cb-e2ee-4181-b758-7a3e4f93a7d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:36.807342 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956415cb-e2ee-4181-b758-7a3e4f93a7d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:36.849359 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 860/1715] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:54:36 2022] POST /identity/v3/projects => generated 375 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:36.850761 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c79d4b-a251-4c12-a3fb-3a9d245f15a1 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:36.889256 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956415cb-e2ee-4181-b758-7a3e4f93a7d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:36.891703 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956415cb-e2ee-4181-b758-7a3e4f93a7d5 service nova] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:36.906840 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 856/1716] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:36.908133 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22f6fa-379f-4019-86e5-1df55af95d02 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:36.908427 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22f6fa-379f-4019-86e5-1df55af95d02 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:36.908702 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22f6fa-379f-4019-86e5-1df55af95d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:36.973078 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-ab22f6fa-379f-4019-86e5-1df55af95d02 None None] MFA Rules not processed for user `9b03428b48264b9da9800283496de2e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:36.974292 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ab22f6fa-379f-4019-86e5-1df55af95d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:37.020937 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c79d4b-a251-4c12-a3fb-3a9d245f15a1 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:37.031507 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2be07-7ca5-406a-bf52-bb4b68a6c855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:37.032224 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2be07-7ca5-406a-bf52-bb4b68a6c855 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:37.032802 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2be07-7ca5-406a-bf52-bb4b68a6c855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:37.033176 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2be07-7ca5-406a-bf52-bb4b68a6c855 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:37.033967 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2be07-7ca5-406a-bf52-bb4b68a6c855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:37.035964 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2be07-7ca5-406a-bf52-bb4b68a6c855 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:37.052283 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 861/1717] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:37.054917 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e656d-21fa-49a6-bcec-2c3b3eb5375e None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:37.055451 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e656d-21fa-49a6-bcec-2c3b3eb5375e None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:37.055872 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e656d-21fa-49a6-bcec-2c3b3eb5375e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:37.097197 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 857/1718] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 7 10:54:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:37.098431 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22f6fa-379f-4019-86e5-1df55af95d02 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:37.131996 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-db9e656d-21fa-49a6-bcec-2c3b3eb5375e None None] MFA Rules not processed for user `7696bfdd618a47eb91753adb60ea7812`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:37.137947 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-db9e656d-21fa-49a6-bcec-2c3b3eb5375e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:37.140421 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22f6fa-379f-4019-86e5-1df55af95d02 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:37.170103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb47dd-866f-4cfa-860e-c172d34b99d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:37.170826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb47dd-866f-4cfa-860e-c172d34b99d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:37.171141 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb47dd-866f-4cfa-860e-c172d34b99d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:37.171391 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb47dd-866f-4cfa-860e-c172d34b99d9 admin admin] PATH_INFO: `/v3/users/3ef9b1c6a92445b9a69aaa0628786e85` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:37.178634 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb47dd-866f-4cfa-860e-c172d34b99d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ef9b1c6a92445b9a69aaa0628786e85)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:37.181360 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb47dd-866f-4cfa-860e-c172d34b99d9 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:37.183403 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:37.285089 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 862/1719] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:37.290614 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e656d-21fa-49a6-bcec-2c3b3eb5375e None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:37.328552 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-06eb47dd-866f-4cfa-860e-c172d34b99d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ef9b1c6a92445b9a69aaa0628786e85'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:37.338842 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e656d-21fa-49a6-bcec-2c3b3eb5375e None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:37.358278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62a066-6fcc-4c00-9801-ca6269a4213c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:37.366541 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62a066-6fcc-4c00-9801-ca6269a4213c admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:37.368295 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62a066-6fcc-4c00-9801-ca6269a4213c admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:37.368815 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62a066-6fcc-4c00-9801-ca6269a4213c admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:37.373963 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62a066-6fcc-4c00-9801-ca6269a4213c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:37.378165 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62a066-6fcc-4c00-9801-ca6269a4213c admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:37.394829 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-06eb47dd-866f-4cfa-860e-c172d34b99d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ef9b1c6a92445b9a69aaa0628786e85'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:37.396223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-06eb47dd-866f-4cfa-860e-c172d34b99d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ef9b1c6a92445b9a69aaa0628786e85'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:37.413777 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-06eb47dd-866f-4cfa-860e-c172d34b99d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ef9b1c6a92445b9a69aaa0628786e85'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:37.421933 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 863/1720] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:54:37 2022] POST /identity/v3/users => generated 294 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:37.424502 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62a066-6fcc-4c00-9801-ca6269a4213c admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:37.429790 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-06eb47dd-866f-4cfa-860e-c172d34b99d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ef9b1c6a92445b9a69aaa0628786e85'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:37.444232 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 858/1721] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:54:37 2022] DELETE /identity/v3/users/3ef9b1c6a92445b9a69aaa0628786e85 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:37.445569 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb47dd-866f-4cfa-860e-c172d34b99d9 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:37.448589 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-06eb47dd-866f-4cfa-860e-c172d34b99d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:37.462178 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62a066-6fcc-4c00-9801-ca6269a4213c admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:37.547773 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:37.579999 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb47dd-866f-4cfa-860e-c172d34b99d9 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:37.585849 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5be2b-134b-4755-b96d-6cbc590f7c9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:37.586614 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5be2b-134b-4755-b96d-6cbc590f7c9d service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:37.586995 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5be2b-134b-4755-b96d-6cbc590f7c9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:37.587400 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5be2b-134b-4755-b96d-6cbc590f7c9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:37.589559 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a3b5be2b-134b-4755-b96d-6cbc590f7c9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:37.591645 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa859d-cbb9-46ed-9a8e-9edee41bdd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:37.592470 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa859d-cbb9-46ed-9a8e-9edee41bdd5f admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:37.592773 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa859d-cbb9-46ed-9a8e-9edee41bdd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:37.593116 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa859d-cbb9-46ed-9a8e-9edee41bdd5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:37.593872 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa859d-cbb9-46ed-9a8e-9edee41bdd5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:37.598820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa859d-cbb9-46ed-9a8e-9edee41bdd5f admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:37.605437 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5be2b-134b-4755-b96d-6cbc590f7c9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:37.608300 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5be2b-134b-4755-b96d-6cbc590f7c9d service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:37.624988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 864/1722] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:37.625982 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa859d-cbb9-46ed-9a8e-9edee41bdd5f admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:37.628848 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 859/1723] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:37.630550 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841bb50-e460-4213-9190-c61cebced83d None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:37.631591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841bb50-e460-4213-9190-c61cebced83d None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:37.632000 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9841bb50-e460-4213-9190-c61cebced83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:37.633217 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-b9fa859d-cbb9-46ed-9a8e-9edee41bdd5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:37.657305 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa859d-cbb9-46ed-9a8e-9edee41bdd5f admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:37.669489 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3436e-bf96-4a4c-99ef-3de6dc09fd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:37.670126 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3436e-bf96-4a4c-99ef-3de6dc09fd7a admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:37.670403 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3436e-bf96-4a4c-99ef-3de6dc09fd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:37.670677 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3436e-bf96-4a4c-99ef-3de6dc09fd7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:37.671349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf3436e-bf96-4a4c-99ef-3de6dc09fd7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:37.672941 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf3436e-bf96-4a4c-99ef-3de6dc09fd7a admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:37.677510 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-9841bb50-e460-4213-9190-c61cebced83d None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:37.678574 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-9841bb50-e460-4213-9190-c61cebced83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:37.687227 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 860/1724] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:37.688770 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273da5c6-a77a-4e6b-91ee-d45f9221ae7a None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:37.689058 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273da5c6-a77a-4e6b-91ee-d45f9221ae7a None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:37.689329 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273da5c6-a77a-4e6b-91ee-d45f9221ae7a None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:37.691372 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 861/1725] 10.222.0.27 () {54 vars in 912 bytes} [Sun Aug 7 10:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:54:37.692137 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273da5c6-a77a-4e6b-91ee-d45f9221ae7a None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:37.694904 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-273da5c6-a77a-4e6b-91ee-d45f9221ae7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:37.706128 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 865/1726] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:37.707335 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3436e-bf96-4a4c-99ef-3de6dc09fd7a admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:37.713804 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273da5c6-a77a-4e6b-91ee-d45f9221ae7a None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:37.720708 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b33022-bed3-4604-9b0c-3551179cb166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:37.722548 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b33022-bed3-4604-9b0c-3551179cb166 admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:37.722712 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b33022-bed3-4604-9b0c-3551179cb166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:37.723169 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b33022-bed3-4604-9b0c-3551179cb166 admin admin] PATH_INFO: `/v3/projects/d98a7d2dae044b599370ac542ed568f9/users/d85c6bcdb5094fb7b37229a092f454c6/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:37.736169 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3436e-bf96-4a4c-99ef-3de6dc09fd7a admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:37.745426 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642663d-9609-46d7-98b7-3b14dff11361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:37.746211 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642663d-9609-46d7-98b7-3b14dff11361 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:37.746874 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642663d-9609-46d7-98b7-3b14dff11361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:37.747854 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642663d-9609-46d7-98b7-3b14dff11361 admin admin] PATH_INFO: `/v3/projects/9760e238c7d645cc9aa5169fade9b77b/users/2868b33b980e430eb8a0517cac7dad9b/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:37.749953 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b33022-bed3-4604-9b0c-3551179cb166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d98a7d2dae044b599370ac542ed568f9, user_id=d85c6bcdb5094fb7b37229a092f454c6, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:37.754226 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b33022-bed3-4604-9b0c-3551179cb166 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:37.775766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 862/1727] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:54:37 2022] PUT /identity/v3/projects/d98a7d2dae044b599370ac542ed568f9/users/d85c6bcdb5094fb7b37229a092f454c6/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:37.778161 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b33022-bed3-4604-9b0c-3551179cb166 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:37.781045 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-20b33022-bed3-4604-9b0c-3551179cb166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:37.786030 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5642663d-9609-46d7-98b7-3b14dff11361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9760e238c7d645cc9aa5169fade9b77b, user_id=2868b33b980e430eb8a0517cac7dad9b, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:37.789749 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5642663d-9609-46d7-98b7-3b14dff11361 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:37.821619 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 866/1728] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:54:37 2022] PUT /identity/v3/projects/9760e238c7d645cc9aa5169fade9b77b/users/2868b33b980e430eb8a0517cac7dad9b/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:37.823153 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c555d-7c80-4f7c-aa4e-6d8a45c24c8e None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:37.823436 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c555d-7c80-4f7c-aa4e-6d8a45c24c8e None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:37.823731 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c555d-7c80-4f7c-aa4e-6d8a45c24c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:37.864261 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-224c555d-7c80-4f7c-aa4e-6d8a45c24c8e None None] MFA Rules not processed for user `9b03428b48264b9da9800283496de2e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:37.864653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-224c555d-7c80-4f7c-aa4e-6d8a45c24c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:37.887306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b33022-bed3-4604-9b0c-3551179cb166 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:37.897559 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:37.982677 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 867/1729] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 7 10:54:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:37.990961 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ce681-988a-4b7c-bce6-2cfb228acb92 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:37.991177 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ce681-988a-4b7c-bce6-2cfb228acb92 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:37.991471 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ce681-988a-4b7c-bce6-2cfb228acb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:38.017388 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e78256-c3f9-4de1-9921-c41e8294bdff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:38.018103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e78256-c3f9-4de1-9921-c41e8294bdff service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:38.018377 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e78256-c3f9-4de1-9921-c41e8294bdff service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:38.018639 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e78256-c3f9-4de1-9921-c41e8294bdff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:38.059915 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-743ce681-988a-4b7c-bce6-2cfb228acb92 None None] MFA Rules not processed for user `d85c6bcdb5094fb7b37229a092f454c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:38.062067 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-743ce681-988a-4b7c-bce6-2cfb228acb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:38.206427 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e78256-c3f9-4de1-9921-c41e8294bdff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:38.208345 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e78256-c3f9-4de1-9921-c41e8294bdff service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:38.220402 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 863/1730] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:38.221359 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e78256-c3f9-4de1-9921-c41e8294bdff service neutron] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:38.238398 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e78256-c3f9-4de1-9921-c41e8294bdff service neutron] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:38.248823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fd88a-022f-4600-80e1-147c2d3fc00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:38.249529 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fd88a-022f-4600-80e1-147c2d3fc00f admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:38.249810 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fd88a-022f-4600-80e1-147c2d3fc00f admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:38.250082 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fd88a-022f-4600-80e1-147c2d3fc00f admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:38.250766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0fd88a-022f-4600-80e1-147c2d3fc00f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:38.252718 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0fd88a-022f-4600-80e1-147c2d3fc00f admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:38.259975 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 868/1731] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:38.259975 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ce681-988a-4b7c-bce6-2cfb228acb92 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:38.270273 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 864/1732] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:38.272169 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fd88a-022f-4600-80e1-147c2d3fc00f admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:38.274084 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-fd0fd88a-022f-4600-80e1-147c2d3fc00f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:38.274851 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ce681-988a-4b7c-bce6-2cfb228acb92 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:38.280042 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b443b53-b2e3-4490-96a2-3e8ed4bcaae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:38.281049 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b443b53-b2e3-4490-96a2-3e8ed4bcaae8 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:38.281361 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b443b53-b2e3-4490-96a2-3e8ed4bcaae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:38.281632 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b443b53-b2e3-4490-96a2-3e8ed4bcaae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:38.290505 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b443b53-b2e3-4490-96a2-3e8ed4bcaae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:38.292074 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b443b53-b2e3-4490-96a2-3e8ed4bcaae8 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:38.320786 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 869/1733] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:38.323508 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b443b53-b2e3-4490-96a2-3e8ed4bcaae8 service neutron] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:38.357852 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b443b53-b2e3-4490-96a2-3e8ed4bcaae8 service neutron] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:38.380995 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b51e7-838f-42ae-a008-8f97221e7300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:38.392458 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b51e7-838f-42ae-a008-8f97221e7300 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:38.393447 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b51e7-838f-42ae-a008-8f97221e7300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:38.393961 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b51e7-838f-42ae-a008-8f97221e7300 admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:38.395158 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b51e7-838f-42ae-a008-8f97221e7300 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:38.399465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b51e7-838f-42ae-a008-8f97221e7300 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:38.466405 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 870/1734] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:54:38 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:38.467593 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b51e7-838f-42ae-a008-8f97221e7300 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:38.481430 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:38.488943 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fd88a-022f-4600-80e1-147c2d3fc00f admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:38.581173 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:38.626773 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741885cb-34ef-42bc-9828-c7ec6a16d37e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:38.628149 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741885cb-34ef-42bc-9828-c7ec6a16d37e service nova] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:38.631028 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741885cb-34ef-42bc-9828-c7ec6a16d37e service nova] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:38.631427 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741885cb-34ef-42bc-9828-c7ec6a16d37e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:38.637079 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-741885cb-34ef-42bc-9828-c7ec6a16d37e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:38.639726 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b51e7-838f-42ae-a008-8f97221e7300 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:38.653054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06aed0b-5fc3-4dec-996e-11cee38a5e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:38.658066 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06aed0b-5fc3-4dec-996e-11cee38a5e23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:38.658359 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06aed0b-5fc3-4dec-996e-11cee38a5e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:38.658613 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06aed0b-5fc3-4dec-996e-11cee38a5e23 admin admin] PATH_INFO: `/v3/projects/9760e238c7d645cc9aa5169fade9b77b/users/2868b33b980e430eb8a0517cac7dad9b/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:38.664805 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06aed0b-5fc3-4dec-996e-11cee38a5e23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9760e238c7d645cc9aa5169fade9b77b, user_id=2868b33b980e430eb8a0517cac7dad9b, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:38.673932 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06aed0b-5fc3-4dec-996e-11cee38a5e23 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:38.698829 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 871/1735] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:54:38 2022] PUT /identity/v3/projects/9760e238c7d645cc9aa5169fade9b77b/users/2868b33b980e430eb8a0517cac7dad9b/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:38.704754 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b47f1-c491-43c0-a891-3e4c59aa3281 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:38.705417 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b47f1-c491-43c0-a891-3e4c59aa3281 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:38.706588 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b47f1-c491-43c0-a891-3e4c59aa3281 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:38.727005 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 872/1736] 10.222.0.27 () {54 vars in 961 bytes} [Sun Aug 7 10:54:38 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:54:38.741398 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b47f1-c491-43c0-a891-3e4c59aa3281 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:38.787897 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741885cb-34ef-42bc-9828-c7ec6a16d37e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:38.789546 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741885cb-34ef-42bc-9828-c7ec6a16d37e service nova] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:38.810929 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 865/1737] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:38 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:38.813043 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cf36d-dcf3-4dcc-a68c-1f3e518f1b4e None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:38.813356 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cf36d-dcf3-4dcc-a68c-1f3e518f1b4e None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:38.813630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91cf36d-dcf3-4dcc-a68c-1f3e518f1b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:38.856475 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b47f1-c491-43c0-a891-3e4c59aa3281 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:38.857659 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-b91cf36d-dcf3-4dcc-a68c-1f3e518f1b4e None None] MFA Rules not processed for user `2868b33b980e430eb8a0517cac7dad9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:38.859194 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-b91cf36d-dcf3-4dcc-a68c-1f3e518f1b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:38.865780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9750a91-c014-4e4e-ac9b-3fb0352e931a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:38.866409 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9750a91-c014-4e4e-ac9b-3fb0352e931a admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:38.866680 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9750a91-c014-4e4e-ac9b-3fb0352e931a admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:38.867095 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9750a91-c014-4e4e-ac9b-3fb0352e931a admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:38.867630 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9750a91-c014-4e4e-ac9b-3fb0352e931a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:38.869869 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9750a91-c014-4e4e-ac9b-3fb0352e931a admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:38.916703 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 873/1738] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:54:38 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:38.917967 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f7edb-dc4b-4a8a-8d2e-3c29a44de945 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:38.918249 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f7edb-dc4b-4a8a-8d2e-3c29a44de945 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:38.920497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f7edb-dc4b-4a8a-8d2e-3c29a44de945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:38.973742 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-081f7edb-dc4b-4a8a-8d2e-3c29a44de945 None None] MFA Rules not processed for user `b33f797a9af946a4b296d973388891be`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:38.975742 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-081f7edb-dc4b-4a8a-8d2e-3c29a44de945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:39.042554 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 866/1739] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:39.048858 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91cf36d-dcf3-4dcc-a68c-1f3e518f1b4e None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:39.066802 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-b91cf36d-dcf3-4dcc-a68c-1f3e518f1b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:39.112186 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91cf36d-dcf3-4dcc-a68c-1f3e518f1b4e None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:39.120610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 874/1740] 10.222.0.27 () {58 vars in 1058 bytes} [Sun Aug 7 10:54:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:39.121743 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f7edb-dc4b-4a8a-8d2e-3c29a44de945 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:39.130163 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40090f9-1c36-4219-94b9-bdd097436092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:39.132347 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40090f9-1c36-4219-94b9-bdd097436092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:39.132656 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40090f9-1c36-4219-94b9-bdd097436092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:39.132825 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f7edb-dc4b-4a8a-8d2e-3c29a44de945 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:39.132937 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40090f9-1c36-4219-94b9-bdd097436092 admin admin] PATH_INFO: `/v3/projects/c17ad37918004eca81e904ea2000bf95` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:39.134914 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40090f9-1c36-4219-94b9-bdd097436092 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c17ad37918004eca81e904ea2000bf95)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:39.139687 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c66da-ff9e-4000-be36-fa8330331992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:39.140598 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c66da-ff9e-4000-be36-fa8330331992 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:39.140759 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c66da-ff9e-4000-be36-fa8330331992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:39.140943 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40090f9-1c36-4219-94b9-bdd097436092 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:39.141048 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c66da-ff9e-4000-be36-fa8330331992 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:39.141847 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c66da-ff9e-4000-be36-fa8330331992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:39.144796 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c66da-ff9e-4000-be36-fa8330331992 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:39.164194 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 875/1741] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:39.165394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c66da-ff9e-4000-be36-fa8330331992 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:39.187445 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:39.242259 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-e40090f9-1c36-4219-94b9-bdd097436092 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c17ad37918004eca81e904ea2000bf95', 'request_id': 'req-e40090f9-1c36-4219-94b9-bdd097436092'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:39.255969 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-e40090f9-1c36-4219-94b9-bdd097436092 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c17ad37918004eca81e904ea2000bf95', 'request_id': 'req-e40090f9-1c36-4219-94b9-bdd097436092'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:39.259657 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:39.275218 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-e40090f9-1c36-4219-94b9-bdd097436092 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c17ad37918004eca81e904ea2000bf95', 'request_id': 'req-e40090f9-1c36-4219-94b9-bdd097436092'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:39.279102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c66da-ff9e-4000-be36-fa8330331992 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:39.314046 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-e40090f9-1c36-4219-94b9-bdd097436092 admin admin] The token cache is being invalidate because project c17ad37918004eca81e904ea2000bf95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:54:39.315764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-e40090f9-1c36-4219-94b9-bdd097436092 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:39.319061 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-e40090f9-1c36-4219-94b9-bdd097436092 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:39.332373 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 867/1742] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:54:39 2022] DELETE /identity/v3/projects/c17ad37918004eca81e904ea2000bf95 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:39.346969 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40090f9-1c36-4219-94b9-bdd097436092 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:39.352404 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-e40090f9-1c36-4219-94b9-bdd097436092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:39.415760 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374cf03b-a97a-46ef-8228-804f61e2de0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:39.416447 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cf03b-a97a-46ef-8228-804f61e2de0f service nova] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:39.417433 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cf03b-a97a-46ef-8228-804f61e2de0f service nova] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:39.417768 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cf03b-a97a-46ef-8228-804f61e2de0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:39.424077 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-374cf03b-a97a-46ef-8228-804f61e2de0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:39.482046 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40090f9-1c36-4219-94b9-bdd097436092 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:39.520632 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7526a05-537f-449c-94ff-3eafe552e3cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:39.526094 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7526a05-537f-449c-94ff-3eafe552e3cb service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:39.526679 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7526a05-537f-449c-94ff-3eafe552e3cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:39.527917 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7526a05-537f-449c-94ff-3eafe552e3cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:39.540692 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-c7526a05-537f-449c-94ff-3eafe552e3cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:39.596547 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374cf03b-a97a-46ef-8228-804f61e2de0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:39.608287 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374cf03b-a97a-46ef-8228-804f61e2de0f service nova] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:39.632660 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 876/1743] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:39 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:39.632660 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374cf03b-a97a-46ef-8228-804f61e2de0f service nova] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:39.636304 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-374cf03b-a97a-46ef-8228-804f61e2de0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:39.725713 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7526a05-537f-449c-94ff-3eafe552e3cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:39.730258 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7526a05-537f-449c-94ff-3eafe552e3cb service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:39.763905 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 868/1744] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:39.764964 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7526a05-537f-449c-94ff-3eafe552e3cb service cinder] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:39.769523 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-c7526a05-537f-449c-94ff-3eafe552e3cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:39.782562 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:39.835000 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374cf03b-a97a-46ef-8228-804f61e2de0f service nova] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:39.851396 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3dfd50-9785-43b3-b559-e2691a3cfa86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b33f797a9af946a4b296d973388891be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:39.852119 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dfd50-9785-43b3-b559-e2691a3cfa86 service placement] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:39.852406 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dfd50-9785-43b3-b559-e2691a3cfa86 service placement] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:39.852698 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dfd50-9785-43b3-b559-e2691a3cfa86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:39.858935 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-fe3dfd50-9785-43b3-b559-e2691a3cfa86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:39.899521 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3dfd50-9785-43b3-b559-e2691a3cfa86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:39.902179 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3dfd50-9785-43b3-b559-e2691a3cfa86 service placement] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:39.918660 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 877/1745] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:39.919950 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3dfd50-9785-43b3-b559-e2691a3cfa86 service placement] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:39.921754 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-fe3dfd50-9785-43b3-b559-e2691a3cfa86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:39.941600 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3dfd50-9785-43b3-b559-e2691a3cfa86 service placement] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:39.948982 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d472fe9-c1be-42ec-95be-ca0944880787 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b33f797a9af946a4b296d973388891be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:39.949913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d472fe9-c1be-42ec-95be-ca0944880787 service placement] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:39.950290 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d472fe9-c1be-42ec-95be-ca0944880787 service placement] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:39.950666 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d472fe9-c1be-42ec-95be-ca0944880787 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:39.969672 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d472fe9-c1be-42ec-95be-ca0944880787 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:39.973277 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d472fe9-c1be-42ec-95be-ca0944880787 service placement] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:40.000380 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7526a05-537f-449c-94ff-3eafe552e3cb service cinder] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:40.009885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 878/1746] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:40.014180 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d472fe9-c1be-42ec-95be-ca0944880787 service placement] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:40.020226 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6259a69-953f-47f0-888b-fec963f857fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:40.020894 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6259a69-953f-47f0-888b-fec963f857fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:40.022908 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-2d472fe9-c1be-42ec-95be-ca0944880787 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:40.025356 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6259a69-953f-47f0-888b-fec963f857fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:40.027269 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6259a69-953f-47f0-888b-fec963f857fe admin admin] PATH_INFO: `/v3/projects/816b96abbaa646ad90d750174c8c6ba5/users/e6de45c5c8e74ece9cd43abb287c92cb/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:40.085790 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6259a69-953f-47f0-888b-fec963f857fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=816b96abbaa646ad90d750174c8c6ba5, user_id=e6de45c5c8e74ece9cd43abb287c92cb, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:40.088723 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6259a69-953f-47f0-888b-fec963f857fe admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:40.101050 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d472fe9-c1be-42ec-95be-ca0944880787 service placement] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:40.114960 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437a285-ad38-485e-bed8-ab3a8e93942f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:40.118958 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437a285-ad38-485e-bed8-ab3a8e93942f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:40.122018 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437a285-ad38-485e-bed8-ab3a8e93942f admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:40.122792 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437a285-ad38-485e-bed8-ab3a8e93942f admin admin] PATH_INFO: `/v3/users/047e744b6e8043df9965c8b29dbd2e84` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:40.125913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437a285-ad38-485e-bed8-ab3a8e93942f admin admin] RBAC: Authorizing `identity:delete_user(user_id=047e744b6e8043df9965c8b29dbd2e84)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:40.129821 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 869/1747] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:54:39 2022] PUT /identity/v3/projects/816b96abbaa646ad90d750174c8c6ba5/users/e6de45c5c8e74ece9cd43abb287c92cb/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:40.131447 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6259a69-953f-47f0-888b-fec963f857fe admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:40.134919 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437a285-ad38-485e-bed8-ab3a8e93942f admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:40.137649 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a6259a69-953f-47f0-888b-fec963f857fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:40.247509 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:40.248763 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-5437a285-ad38-485e-bed8-ab3a8e93942f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '047e744b6e8043df9965c8b29dbd2e84'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:40.289037 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-5437a285-ad38-485e-bed8-ab3a8e93942f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '047e744b6e8043df9965c8b29dbd2e84'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:40.290567 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-5437a285-ad38-485e-bed8-ab3a8e93942f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '047e744b6e8043df9965c8b29dbd2e84'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:40.311721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-5437a285-ad38-485e-bed8-ab3a8e93942f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '047e744b6e8043df9965c8b29dbd2e84'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:40.329953 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-5437a285-ad38-485e-bed8-ab3a8e93942f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '047e744b6e8043df9965c8b29dbd2e84'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:40.334311 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6259a69-953f-47f0-888b-fec963f857fe admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:40.343583 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2bba8d-e339-40b4-a0dd-6a740bb1b4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:40.343951 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bba8d-e339-40b4-a0dd-6a740bb1b4fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:40.347158 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bba8d-e339-40b4-a0dd-6a740bb1b4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:40.347158 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bba8d-e339-40b4-a0dd-6a740bb1b4fa admin admin] PATH_INFO: `/v3/users/ec876c5a22454a3d9d81071442994dda` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:40.353021 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2bba8d-e339-40b4-a0dd-6a740bb1b4fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec876c5a22454a3d9d81071442994dda)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:40.360391 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 879/1748] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:54:40 2022] DELETE /identity/v3/users/047e744b6e8043df9965c8b29dbd2e84 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:40.361150 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437a285-ad38-485e-bed8-ab3a8e93942f admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:40.366481 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-5437a285-ad38-485e-bed8-ab3a8e93942f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:40.376345 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2bba8d-e339-40b4-a0dd-6a740bb1b4fa admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:40.553199 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ca2bba8d-e339-40b4-a0dd-6a740bb1b4fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec876c5a22454a3d9d81071442994dda'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:40.597981 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ca2bba8d-e339-40b4-a0dd-6a740bb1b4fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec876c5a22454a3d9d81071442994dda'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:40.600528 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ca2bba8d-e339-40b4-a0dd-6a740bb1b4fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec876c5a22454a3d9d81071442994dda'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:40.621193 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ca2bba8d-e339-40b4-a0dd-6a740bb1b4fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec876c5a22454a3d9d81071442994dda'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:40.635045 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ca2bba8d-e339-40b4-a0dd-6a740bb1b4fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec876c5a22454a3d9d81071442994dda'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:40.651472 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 870/1749] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:54:40 2022] DELETE /identity/v3/users/ec876c5a22454a3d9d81071442994dda => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:40.655881 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a3835-2be6-40ff-bed7-303e8ae8677b None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:40.656961 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a3835-2be6-40ff-bed7-303e8ae8677b None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:40.660151 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a3835-2be6-40ff-bed7-303e8ae8677b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:40.666654 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437a285-ad38-485e-bed8-ab3a8e93942f admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:40.711273 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-704a3835-2be6-40ff-bed7-303e8ae8677b None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:40.713495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-704a3835-2be6-40ff-bed7-303e8ae8677b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:40.769179 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:40.792153 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4616929-c622-404f-b815-4481cc921f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:40.794032 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4616929-c622-404f-b815-4481cc921f42 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:40.795745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4616929-c622-404f-b815-4481cc921f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:40.796038 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4616929-c622-404f-b815-4481cc921f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:40.798006 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4616929-c622-404f-b815-4481cc921f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:40.803254 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4616929-c622-404f-b815-4481cc921f42 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:40.840057 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 880/1750] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 479 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:40.845829 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4616929-c622-404f-b815-4481cc921f42 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:40.847993 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-f4616929-c622-404f-b815-4481cc921f42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:40.866162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4616929-c622-404f-b815-4481cc921f42 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:40.874905 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de44236-e71a-4ea1-aebf-54485c694551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:40.875981 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de44236-e71a-4ea1-aebf-54485c694551 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:40.876332 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de44236-e71a-4ea1-aebf-54485c694551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:40.876941 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de44236-e71a-4ea1-aebf-54485c694551 admin admin] PATH_INFO: `/v3/projects/816b96abbaa646ad90d750174c8c6ba5/users/e6de45c5c8e74ece9cd43abb287c92cb/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:40.879725 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de44236-e71a-4ea1-aebf-54485c694551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=816b96abbaa646ad90d750174c8c6ba5, user_id=e6de45c5c8e74ece9cd43abb287c92cb, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:40.883172 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de44236-e71a-4ea1-aebf-54485c694551 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:40.898379 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 871/1751] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:40.900586 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 881/1752] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:54:40 2022] PUT /identity/v3/projects/816b96abbaa646ad90d750174c8c6ba5/users/e6de45c5c8e74ece9cd43abb287c92cb/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:40.911401 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635574e-c3e8-4b92-b9e8-febb42f1f954 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:40.912135 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635574e-c3e8-4b92-b9e8-febb42f1f954 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:40.912568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635574e-c3e8-4b92-b9e8-febb42f1f954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:40.973429 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-b635574e-c3e8-4b92-b9e8-febb42f1f954 None None] MFA Rules not processed for user `e6de45c5c8e74ece9cd43abb287c92cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:40.975234 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-b635574e-c3e8-4b92-b9e8-febb42f1f954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:41.081899 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:41.124806 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de44236-e71a-4ea1-aebf-54485c694551 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:41.127406 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-6de44236-e71a-4ea1-aebf-54485c694551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:41.233539 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 872/1753] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:41.244332 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635574e-c3e8-4b92-b9e8-febb42f1f954 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:41.246642 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-b635574e-c3e8-4b92-b9e8-febb42f1f954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:41.375370 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635574e-c3e8-4b92-b9e8-febb42f1f954 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:41.387621 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516df622-2c2a-416d-85b2-c1ea8a4fb965 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:41.388534 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516df622-2c2a-416d-85b2-c1ea8a4fb965 service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:41.388948 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516df622-2c2a-416d-85b2-c1ea8a4fb965 service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:41.389342 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516df622-2c2a-416d-85b2-c1ea8a4fb965 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:41.405961 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de44236-e71a-4ea1-aebf-54485c694551 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:41.412152 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516df622-2c2a-416d-85b2-c1ea8a4fb965 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:41.414244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516df622-2c2a-416d-85b2-c1ea8a4fb965 service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:41.423553 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4e78c-90c7-4a9c-a005-444637852906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:41.425012 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4e78c-90c7-4a9c-a005-444637852906 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:41.426563 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4e78c-90c7-4a9c-a005-444637852906 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:41.426816 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4e78c-90c7-4a9c-a005-444637852906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:41.448435 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 873/1754] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:41.705543 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e4e78c-90c7-4a9c-a005-444637852906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:41.710461 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e4e78c-90c7-4a9c-a005-444637852906 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:41.744787 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 882/1755] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:41.896284 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43473e0-f2df-43dd-9ae2-f84df894e381 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:41.897169 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43473e0-f2df-43dd-9ae2-f84df894e381 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:41.897612 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43473e0-f2df-43dd-9ae2-f84df894e381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:41.944859 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-f43473e0-f2df-43dd-9ae2-f84df894e381 None None] MFA Rules not processed for user `7696bfdd618a47eb91753adb60ea7812`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:41.951444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-f43473e0-f2df-43dd-9ae2-f84df894e381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:42.208654 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 874/1756] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:54:42.535988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4e78c-90c7-4a9c-a005-444637852906 service neutron] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:42.542573 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-74e4e78c-90c7-4a9c-a005-444637852906 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:42.618820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ab32f-dafe-4d66-951c-715908af106e None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:42.619278 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ab32f-dafe-4d66-951c-715908af106e None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:42.619647 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ab32f-dafe-4d66-951c-715908af106e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:42.673732 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e4e78c-90c7-4a9c-a005-444637852906 service neutron] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:42.692996 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-423ab32f-dafe-4d66-951c-715908af106e None None] MFA Rules not processed for user `ca2075ca15d44405a71e24955ec99da4`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:42.695536 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-423ab32f-dafe-4d66-951c-715908af106e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:42.696394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873345e5-df34-48c0-9954-c4e0c5b8852b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:42.698954 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873345e5-df34-48c0-9954-c4e0c5b8852b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:42.700029 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873345e5-df34-48c0-9954-c4e0c5b8852b admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:42.700508 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873345e5-df34-48c0-9954-c4e0c5b8852b admin admin] PATH_INFO: `/v3/projects/ea7ee880da954a01ade121c2527e3b14` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:42.703197 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873345e5-df34-48c0-9954-c4e0c5b8852b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea7ee880da954a01ade121c2527e3b14)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:42.728288 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873345e5-df34-48c0-9954-c4e0c5b8852b admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:42.949918 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 875/1757] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:42.957985 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ab32f-dafe-4d66-951c-715908af106e None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:42.966253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-873345e5-df34-48c0-9954-c4e0c5b8852b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea7ee880da954a01ade121c2527e3b14', 'request_id': 'req-873345e5-df34-48c0-9954-c4e0c5b8852b'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:42.983268 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ab32f-dafe-4d66-951c-715908af106e None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:42.987127 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-873345e5-df34-48c0-9954-c4e0c5b8852b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea7ee880da954a01ade121c2527e3b14', 'request_id': 'req-873345e5-df34-48c0-9954-c4e0c5b8852b'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:43.002685 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-873345e5-df34-48c0-9954-c4e0c5b8852b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea7ee880da954a01ade121c2527e3b14', 'request_id': 'req-873345e5-df34-48c0-9954-c4e0c5b8852b'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:43.028273 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:43.046492 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:43.058100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-873345e5-df34-48c0-9954-c4e0c5b8852b admin admin] The token cache is being invalidate because project ea7ee880da954a01ade121c2527e3b14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:54:43.059898 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-873345e5-df34-48c0-9954-c4e0c5b8852b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:43.062259 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-873345e5-df34-48c0-9954-c4e0c5b8852b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:43.065599 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 883/1758] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:54:42 2022] DELETE /identity/v3/projects/ea7ee880da954a01ade121c2527e3b14 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:43.071864 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfb58c-6791-4bb8-a4f0-1bac79a80a06 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:43.073140 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfb58c-6791-4bb8-a4f0-1bac79a80a06 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:43.073804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfb58c-6791-4bb8-a4f0-1bac79a80a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:43.133684 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957a46f-9287-4a38-9670-33fc1a35de66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:43.134500 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957a46f-9287-4a38-9670-33fc1a35de66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:43.134728 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957a46f-9287-4a38-9670-33fc1a35de66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:43.134998 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957a46f-9287-4a38-9670-33fc1a35de66 admin admin] PATH_INFO: `/v3/users/d85c6bcdb5094fb7b37229a092f454c6` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:43.136532 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957a46f-9287-4a38-9670-33fc1a35de66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d85c6bcdb5094fb7b37229a092f454c6)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:43.149253 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957a46f-9287-4a38-9670-33fc1a35de66 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:43.167408 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-f9bfb58c-6791-4bb8-a4f0-1bac79a80a06 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:43.171664 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-f9bfb58c-6791-4bb8-a4f0-1bac79a80a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:43.234569 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 884/1759] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:43.235966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfb58c-6791-4bb8-a4f0-1bac79a80a06 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:43.237844 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-f9bfb58c-6791-4bb8-a4f0-1bac79a80a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:43.269025 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfb58c-6791-4bb8-a4f0-1bac79a80a06 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:43.279705 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-2957a46f-9287-4a38-9670-33fc1a35de66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd85c6bcdb5094fb7b37229a092f454c6'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:43.282674 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c750ab-2e44-41de-b608-6f49a13c542a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:43.283435 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c750ab-2e44-41de-b608-6f49a13c542a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:43.284565 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c750ab-2e44-41de-b608-6f49a13c542a admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:43.286487 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c750ab-2e44-41de-b608-6f49a13c542a admin admin] PATH_INFO: `/v3/projects/0d46a72297ec4d27871f3591b6f44f8c` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:43.288230 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c750ab-2e44-41de-b608-6f49a13c542a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d46a72297ec4d27871f3591b6f44f8c)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:43.293347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c750ab-2e44-41de-b608-6f49a13c542a admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:43.308585 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-2957a46f-9287-4a38-9670-33fc1a35de66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd85c6bcdb5094fb7b37229a092f454c6'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:43.310575 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-2957a46f-9287-4a38-9670-33fc1a35de66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd85c6bcdb5094fb7b37229a092f454c6'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:43.328365 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-2957a46f-9287-4a38-9670-33fc1a35de66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd85c6bcdb5094fb7b37229a092f454c6'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:43.351688 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-2957a46f-9287-4a38-9670-33fc1a35de66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd85c6bcdb5094fb7b37229a092f454c6'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:43.363323 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 876/1760] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:54:42 2022] DELETE /identity/v3/users/d85c6bcdb5094fb7b37229a092f454c6 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:43.367570 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696d1d6-1dcd-4810-86d9-25df6c8e5f53 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:43.368039 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696d1d6-1dcd-4810-86d9-25df6c8e5f53 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:43.369357 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696d1d6-1dcd-4810-86d9-25df6c8e5f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:43.399120 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-1696d1d6-1dcd-4810-86d9-25df6c8e5f53 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:43.401115 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-1696d1d6-1dcd-4810-86d9-25df6c8e5f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:43.404717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-e6c750ab-2e44-41de-b608-6f49a13c542a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d46a72297ec4d27871f3591b6f44f8c', 'request_id': 'req-e6c750ab-2e44-41de-b608-6f49a13c542a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:43.423125 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-e6c750ab-2e44-41de-b608-6f49a13c542a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d46a72297ec4d27871f3591b6f44f8c', 'request_id': 'req-e6c750ab-2e44-41de-b608-6f49a13c542a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:43.449592 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-e6c750ab-2e44-41de-b608-6f49a13c542a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d46a72297ec4d27871f3591b6f44f8c', 'request_id': 'req-e6c750ab-2e44-41de-b608-6f49a13c542a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:43.467951 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-e6c750ab-2e44-41de-b608-6f49a13c542a admin admin] The token cache is being invalidate because project 0d46a72297ec4d27871f3591b6f44f8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:54:43.468820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-e6c750ab-2e44-41de-b608-6f49a13c542a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:43.469849 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-e6c750ab-2e44-41de-b608-6f49a13c542a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:43.471965 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 885/1761] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:54:43 2022] DELETE /identity/v3/projects/0d46a72297ec4d27871f3591b6f44f8c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:43.473752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d48c92-86ba-4d75-9647-9857e703cef4 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:43.474252 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d48c92-86ba-4d75-9647-9857e703cef4 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:43.474765 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d48c92-86ba-4d75-9647-9857e703cef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:43.504090 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-e8d48c92-86ba-4d75-9647-9857e703cef4 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:43.513718 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-e8d48c92-86ba-4d75-9647-9857e703cef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:43.532137 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 877/1762] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:43.535895 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696d1d6-1dcd-4810-86d9-25df6c8e5f53 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:43.537375 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-1696d1d6-1dcd-4810-86d9-25df6c8e5f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:43.656561 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 886/1763] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:43.656561 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea40b6a-ca69-40bd-85dc-25e434f6bb69 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:43.656561 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea40b6a-ca69-40bd-85dc-25e434f6bb69 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:43.656561 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea40b6a-ca69-40bd-85dc-25e434f6bb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:43.717848 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-cea40b6a-ca69-40bd-85dc-25e434f6bb69 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:43.720428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-cea40b6a-ca69-40bd-85dc-25e434f6bb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:43.737952 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:43.764174 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 887/1764] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:43.767669 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea40b6a-ca69-40bd-85dc-25e434f6bb69 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:43.786033 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696d1d6-1dcd-4810-86d9-25df6c8e5f53 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:43.797831 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ba147-c9dd-46f8-9004-040e9e4eb60f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:43.800119 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ba147-c9dd-46f8-9004-040e9e4eb60f service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:43.802062 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ba147-c9dd-46f8-9004-040e9e4eb60f service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:43.802149 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ba147-c9dd-46f8-9004-040e9e4eb60f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:43.806610 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-c03ba147-c9dd-46f8-9004-040e9e4eb60f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:43.816984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea40b6a-ca69-40bd-85dc-25e434f6bb69 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:43.841836 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e3a87-75ab-4c78-a6a4-b64ad21535dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:43.844696 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e3a87-75ab-4c78-a6a4-b64ad21535dc admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:43.844696 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e3a87-75ab-4c78-a6a4-b64ad21535dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:43.844696 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e3a87-75ab-4c78-a6a4-b64ad21535dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:43.844696 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e3a87-75ab-4c78-a6a4-b64ad21535dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:54:43.844696 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e3a87-75ab-4c78-a6a4-b64ad21535dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:43.845649 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e3a87-75ab-4c78-a6a4-b64ad21535dc admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:43.865276 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 888/1765] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:54:43.867268 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e3a87-75ab-4c78-a6a4-b64ad21535dc admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:43.893254 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-791e3a87-75ab-4c78-a6a4-b64ad21535dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:43.999506 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ba147-c9dd-46f8-9004-040e9e4eb60f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:44.008621 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ba147-c9dd-46f8-9004-040e9e4eb60f service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:44.036564 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 878/1766] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:44.038574 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9585a7-86f4-42e0-9fd3-0eaf59cdb159 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:44.038863 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9585a7-86f4-42e0-9fd3-0eaf59cdb159 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:44.039175 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9585a7-86f4-42e0-9fd3-0eaf59cdb159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:44.094891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-7d9585a7-86f4-42e0-9fd3-0eaf59cdb159 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:44.096067 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-7d9585a7-86f4-42e0-9fd3-0eaf59cdb159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:44.116554 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 879/1767] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:44.118057 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9585a7-86f4-42e0-9fd3-0eaf59cdb159 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:44.141365 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9585a7-86f4-42e0-9fd3-0eaf59cdb159 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:44.151747 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdbbe0e-1d5c-45f1-84d3-f1fac5ef7378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:44.152394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbbe0e-1d5c-45f1-84d3-f1fac5ef7378 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:44.152817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbbe0e-1d5c-45f1-84d3-f1fac5ef7378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:44.153209 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbbe0e-1d5c-45f1-84d3-f1fac5ef7378 admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:44.153767 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdbbe0e-1d5c-45f1-84d3-f1fac5ef7378 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:44.157660 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdbbe0e-1d5c-45f1-84d3-f1fac5ef7378 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:44.175757 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e3a87-75ab-4c78-a6a4-b64ad21535dc admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:44.195918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9955f1a-a5ff-4518-b781-570188f6de63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:44.197424 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9955f1a-a5ff-4518-b781-570188f6de63 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:44.197775 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9955f1a-a5ff-4518-b781-570188f6de63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:44.198049 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9955f1a-a5ff-4518-b781-570188f6de63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:44.226409 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 880/1768] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:54:44 2022] POST /identity/v3/projects => generated 405 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:44.227631 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdbbe0e-1d5c-45f1-84d3-f1fac5ef7378 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:44.237201 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9955f1a-a5ff-4518-b781-570188f6de63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:44.244194 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9955f1a-a5ff-4518-b781-570188f6de63 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:44.266923 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:44.282943 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 889/1769] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:44.287737 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9955f1a-a5ff-4518-b781-570188f6de63 service neutron] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:44.330374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9955f1a-a5ff-4518-b781-570188f6de63 service neutron] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:44.435986 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdbbe0e-1d5c-45f1-84d3-f1fac5ef7378 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:44.445479 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef007ba-15f7-4b47-a06d-79947626876b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:44.446103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef007ba-15f7-4b47-a06d-79947626876b admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:44.446382 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef007ba-15f7-4b47-a06d-79947626876b admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:44.446657 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef007ba-15f7-4b47-a06d-79947626876b admin admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:44.447313 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef007ba-15f7-4b47-a06d-79947626876b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:54:44.447615 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef007ba-15f7-4b47-a06d-79947626876b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:44.449228 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef007ba-15f7-4b47-a06d-79947626876b admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:44.457650 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134cb6a1-6c5d-4af9-aa2c-8bc9eff35f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:44.460186 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134cb6a1-6c5d-4af9-aa2c-8bc9eff35f80 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:44.460534 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134cb6a1-6c5d-4af9-aa2c-8bc9eff35f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:44.460875 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134cb6a1-6c5d-4af9-aa2c-8bc9eff35f80 admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:44.461609 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134cb6a1-6c5d-4af9-aa2c-8bc9eff35f80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:44.468862 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134cb6a1-6c5d-4af9-aa2c-8bc9eff35f80 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:44.507295 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 881/1770] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:54:44.508280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef007ba-15f7-4b47-a06d-79947626876b admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:44.528288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef007ba-15f7-4b47-a06d-79947626876b admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:44.533138 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 890/1771] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:54:44 2022] POST /identity/v3/users => generated 303 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:44.537130 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134cb6a1-6c5d-4af9-aa2c-8bc9eff35f80 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:44.548835 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8aa1af-faf4-4023-b9ba-8111e66b378e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:44.549511 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8aa1af-faf4-4023-b9ba-8111e66b378e admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:44.549793 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8aa1af-faf4-4023-b9ba-8111e66b378e admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:44.550065 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8aa1af-faf4-4023-b9ba-8111e66b378e admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:44.550704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8aa1af-faf4-4023-b9ba-8111e66b378e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:44.553210 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8aa1af-faf4-4023-b9ba-8111e66b378e admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:44.553738 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134cb6a1-6c5d-4af9-aa2c-8bc9eff35f80 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:44.561713 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82ee3f-9f0b-4a08-a853-e150165341af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:44.576850 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82ee3f-9f0b-4a08-a853-e150165341af admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:44.577073 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82ee3f-9f0b-4a08-a853-e150165341af admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:44.577325 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82ee3f-9f0b-4a08-a853-e150165341af admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:44.578030 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82ee3f-9f0b-4a08-a853-e150165341af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:44.579611 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82ee3f-9f0b-4a08-a853-e150165341af admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:44.622353 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 891/1772] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:44.626401 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82ee3f-9f0b-4a08-a853-e150165341af admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:44.648139 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 882/1773] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:54:44 2022] POST /identity/v3/projects => generated 369 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:44.654613 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8aa1af-faf4-4023-b9ba-8111e66b378e admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:44.672982 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82ee3f-9f0b-4a08-a853-e150165341af admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:44.776624 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:44.831693 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9ff74-1505-4c0f-b546-4d79dabbf873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:44.832589 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9ff74-1505-4c0f-b546-4d79dabbf873 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:44.834476 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9ff74-1505-4c0f-b546-4d79dabbf873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:44.835091 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9ff74-1505-4c0f-b546-4d79dabbf873 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:44.836137 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9ff74-1505-4c0f-b546-4d79dabbf873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:44.838053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9ff74-1505-4c0f-b546-4d79dabbf873 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:44.855597 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 892/1774] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:44.860914 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9ff74-1505-4c0f-b546-4d79dabbf873 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:44.893018 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9ff74-1505-4c0f-b546-4d79dabbf873 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:44.907899 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0673e-197b-466a-b0bb-cad2775783f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:44.908581 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0673e-197b-466a-b0bb-cad2775783f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:44.908859 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0673e-197b-466a-b0bb-cad2775783f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:44.909130 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0673e-197b-466a-b0bb-cad2775783f0 admin admin] PATH_INFO: `/v3/projects/33ecbb774d064105b3180117e143efe3/users/27997821407d4feb81fb07f5a8721bad/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:44.932721 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8aa1af-faf4-4023-b9ba-8111e66b378e admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:44.950106 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de0673e-197b-466a-b0bb-cad2775783f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33ecbb774d064105b3180117e143efe3, user_id=27997821407d4feb81fb07f5a8721bad, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:44.967720 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f1a03-622c-430f-9e62-d4546b16f06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:44.970339 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de0673e-197b-466a-b0bb-cad2775783f0 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:44.973709 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f1a03-622c-430f-9e62-d4546b16f06a admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:44.974940 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f1a03-622c-430f-9e62-d4546b16f06a admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:44.975100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f1a03-622c-430f-9e62-d4546b16f06a admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:44.975922 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f1a03-622c-430f-9e62-d4546b16f06a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:44.978269 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f1a03-622c-430f-9e62-d4546b16f06a admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:45.005140 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 893/1775] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:54:44 2022] PUT /identity/v3/projects/33ecbb774d064105b3180117e143efe3/users/27997821407d4feb81fb07f5a8721bad/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:45.024169 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a25eb-0b1e-4f0e-85c1-1d14b65f3686 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:45.024471 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a25eb-0b1e-4f0e-85c1-1d14b65f3686 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:45.024746 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a25eb-0b1e-4f0e-85c1-1d14b65f3686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:45.046480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 883/1776] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:54:44 2022] POST /identity/v3/users => generated 285 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:45.047909 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4290ede-fbda-42f9-8544-2e5ece1971e4 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:45.048206 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4290ede-fbda-42f9-8544-2e5ece1971e4 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:45.055215 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4290ede-fbda-42f9-8544-2e5ece1971e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:45.097175 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-d4290ede-fbda-42f9-8544-2e5ece1971e4 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:45.098934 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-d4290ede-fbda-42f9-8544-2e5ece1971e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:45.248495 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-211a25eb-0b1e-4f0e-85c1-1d14b65f3686 None None] MFA Rules not processed for user `e7eebb4bd7e04ff8bc4304a40cf6ba35`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:45.250487 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-211a25eb-0b1e-4f0e-85c1-1d14b65f3686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:45.291518 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:45.363216 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 884/1777] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:45.364368 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4290ede-fbda-42f9-8544-2e5ece1971e4 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:45.392575 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4290ede-fbda-42f9-8544-2e5ece1971e4 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:45.402752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 894/1778] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 7 10:54:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:45.411592 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14299c3-8f8e-4921-8121-dd701d8535a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:45.413435 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14299c3-8f8e-4921-8121-dd701d8535a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:45.414566 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14299c3-8f8e-4921-8121-dd701d8535a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:45.415391 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14299c3-8f8e-4921-8121-dd701d8535a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:45.416175 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14299c3-8f8e-4921-8121-dd701d8535a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:45.420601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14299c3-8f8e-4921-8121-dd701d8535a1 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:45.449728 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a25eb-0b1e-4f0e-85c1-1d14b65f3686 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:45.449890 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 885/1779] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:45.453041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14299c3-8f8e-4921-8121-dd701d8535a1 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:45.492872 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14299c3-8f8e-4921-8121-dd701d8535a1 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:45.502781 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed966721-cd72-45f5-be3b-1cbfc32f3ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:45.506250 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed966721-cd72-45f5-be3b-1cbfc32f3ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:45.506880 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed966721-cd72-45f5-be3b-1cbfc32f3ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:45.507282 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed966721-cd72-45f5-be3b-1cbfc32f3ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:45.520826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed966721-cd72-45f5-be3b-1cbfc32f3ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:45.525843 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed966721-cd72-45f5-be3b-1cbfc32f3ad6 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:45.561811 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 886/1780] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 10:54:45.565724 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed966721-cd72-45f5-be3b-1cbfc32f3ad6 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:45.598076 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed966721-cd72-45f5-be3b-1cbfc32f3ad6 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:45.617136 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d671669-593a-4d24-94ec-921283eb00d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:45.617893 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d671669-593a-4d24-94ec-921283eb00d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:45.618258 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d671669-593a-4d24-94ec-921283eb00d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:45.619551 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d671669-593a-4d24-94ec-921283eb00d7 admin admin] PATH_INFO: `/v3/projects/4d5a0bcf78eb44c5b498a023ce06a8ea/users/854043eadaae4dae89ba48bff0b84f87/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:45.635310 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a25eb-0b1e-4f0e-85c1-1d14b65f3686 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:45.647379 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f32299-0685-4b1d-8f14-0296919e2535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:45.649305 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f32299-0685-4b1d-8f14-0296919e2535 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:45.650560 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f32299-0685-4b1d-8f14-0296919e2535 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:45.650993 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f32299-0685-4b1d-8f14-0296919e2535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:45.667855 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f32299-0685-4b1d-8f14-0296919e2535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:45.684018 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f32299-0685-4b1d-8f14-0296919e2535 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:45.701860 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 895/1781] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:45.703262 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f32299-0685-4b1d-8f14-0296919e2535 service neutron] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:45.703669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d671669-593a-4d24-94ec-921283eb00d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d5a0bcf78eb44c5b498a023ce06a8ea, user_id=854043eadaae4dae89ba48bff0b84f87, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:45.705267 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-c2f32299-0685-4b1d-8f14-0296919e2535 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:45.706412 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d671669-593a-4d24-94ec-921283eb00d7 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:45.758463 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 887/1782] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:54:45 2022] PUT /identity/v3/projects/4d5a0bcf78eb44c5b498a023ce06a8ea/users/854043eadaae4dae89ba48bff0b84f87/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 10:54:45.769238 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5f18f-07a8-461f-b02f-7e78b3c13d71 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:45.769700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5f18f-07a8-461f-b02f-7e78b3c13d71 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:45.770119 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5f18f-07a8-461f-b02f-7e78b3c13d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:45.868953 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-faa5f18f-07a8-461f-b02f-7e78b3c13d71 None None] MFA Rules not processed for user `854043eadaae4dae89ba48bff0b84f87`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:45.870336 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-faa5f18f-07a8-461f-b02f-7e78b3c13d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:45.976812 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f32299-0685-4b1d-8f14-0296919e2535 service neutron] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:46.078131 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 888/1783] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:46.086607 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:46.088332 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5f18f-07a8-461f-b02f-7e78b3c13d71 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:46.114454 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060edd39-2b2e-4037-9c18-0e6593be38a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7181e5118c547a3a31d2e080c25ff01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:46.116933 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:46.118536 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060edd39-2b2e-4037-9c18-0e6593be38a5 service swift] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:46.119210 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060edd39-2b2e-4037-9c18-0e6593be38a5 service swift] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:46.119701 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060edd39-2b2e-4037-9c18-0e6593be38a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:46.242288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5f18f-07a8-461f-b02f-7e78b3c13d71 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:46.259978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59aae5-6c22-4b7a-bc41-14a85d154f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:46.260660 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59aae5-6c22-4b7a-bc41-14a85d154f9e admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:46.260955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59aae5-6c22-4b7a-bc41-14a85d154f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:46.261265 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59aae5-6c22-4b7a-bc41-14a85d154f9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:46.262094 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59aae5-6c22-4b7a-bc41-14a85d154f9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:46.264143 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59aae5-6c22-4b7a-bc41-14a85d154f9e admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:46.290498 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060edd39-2b2e-4037-9c18-0e6593be38a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:46.292192 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060edd39-2b2e-4037-9c18-0e6593be38a5 service swift] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:46.331759 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 889/1784] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:54:46 2022] POST /identity/v3/projects => generated 367 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:46.336197 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59aae5-6c22-4b7a-bc41-14a85d154f9e admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:46.342852 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 896/1785] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 7 10:54:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 10:54:46.458496 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59aae5-6c22-4b7a-bc41-14a85d154f9e admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:46.464309 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0600bc-ceca-4271-9570-d669c909adbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:46.465647 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0600bc-ceca-4271-9570-d669c909adbe admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:46.465991 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0600bc-ceca-4271-9570-d669c909adbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:46.466359 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0600bc-ceca-4271-9570-d669c909adbe admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:46.467419 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0600bc-ceca-4271-9570-d669c909adbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:46.469976 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0600bc-ceca-4271-9570-d669c909adbe admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:46.522859 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 890/1786] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:54:46 2022] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:46.529028 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060edd39-2b2e-4037-9c18-0e6593be38a5 service swift] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:46.554752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060edd39-2b2e-4037-9c18-0e6593be38a5 service swift] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:46.578689 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0c15d-2453-4df5-b3e5-61318ce8743c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:46.579377 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0c15d-2453-4df5-b3e5-61318ce8743c admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:46.581291 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0c15d-2453-4df5-b3e5-61318ce8743c admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:46.581816 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0c15d-2453-4df5-b3e5-61318ce8743c admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:46.584352 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0c15d-2453-4df5-b3e5-61318ce8743c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:46.593202 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0c15d-2453-4df5-b3e5-61318ce8743c admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:46.621878 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0600bc-ceca-4271-9570-d669c909adbe admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:46.645296 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 897/1787] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:46.647775 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0600bc-ceca-4271-9570-d669c909adbe admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:46.683397 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3647cf-9f07-4de1-aa96-518eca106210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:46.684470 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3647cf-9f07-4de1-aa96-518eca106210 admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:46.684964 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3647cf-9f07-4de1-aa96-518eca106210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:46.685480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3647cf-9f07-4de1-aa96-518eca106210 admin admin] PATH_INFO: `/v3/projects/e3d54ecd8c3a455c8fb934f89f3ac630/users/3ffbe88cb6114c39b08be9b4d5df0c52/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:46.738462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3647cf-9f07-4de1-aa96-518eca106210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3d54ecd8c3a455c8fb934f89f3ac630, user_id=3ffbe88cb6114c39b08be9b4d5df0c52, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:46.752216 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3647cf-9f07-4de1-aa96-518eca106210 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:46.798835 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 891/1788] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:54:46 2022] PUT /identity/v3/projects/e3d54ecd8c3a455c8fb934f89f3ac630/users/3ffbe88cb6114c39b08be9b4d5df0c52/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:46.803047 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0c15d-2453-4df5-b3e5-61318ce8743c admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:46.823739 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0c15d-2453-4df5-b3e5-61318ce8743c admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:46.993874 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd4cb4-b062-4ecc-98ce-f04f6182e7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:46.995427 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd4cb4-b062-4ecc-98ce-f04f6182e7ff admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:46.997439 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd4cb4-b062-4ecc-98ce-f04f6182e7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:46.997865 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd4cb4-b062-4ecc-98ce-f04f6182e7ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:47.000350 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd4cb4-b062-4ecc-98ce-f04f6182e7ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:47.005748 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd4cb4-b062-4ecc-98ce-f04f6182e7ff admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:47.027653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 898/1789] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:47.031687 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3647cf-9f07-4de1-aa96-518eca106210 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:47.044546 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3647cf-9f07-4de1-aa96-518eca106210 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:47.067522 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e670ec5-9c92-4a3f-871d-1dd00abb2918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:47.068323 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e670ec5-9c92-4a3f-871d-1dd00abb2918 admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:47.068643 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e670ec5-9c92-4a3f-871d-1dd00abb2918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:47.068972 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e670ec5-9c92-4a3f-871d-1dd00abb2918 admin admin] PATH_INFO: `/v3/projects/e3d54ecd8c3a455c8fb934f89f3ac630/users/3ffbe88cb6114c39b08be9b4d5df0c52/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:47.074201 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e670ec5-9c92-4a3f-871d-1dd00abb2918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3d54ecd8c3a455c8fb934f89f3ac630, user_id=3ffbe88cb6114c39b08be9b4d5df0c52, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:47.077037 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e670ec5-9c92-4a3f-871d-1dd00abb2918 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:47.116100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 892/1790] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:54:47 2022] PUT /identity/v3/projects/e3d54ecd8c3a455c8fb934f89f3ac630/users/3ffbe88cb6114c39b08be9b4d5df0c52/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:47.127740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f58595-0d39-4d52-8e25-ef8a717466d2 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:47.128060 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f58595-0d39-4d52-8e25-ef8a717466d2 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:47.128294 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f58595-0d39-4d52-8e25-ef8a717466d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:47.211150 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-b4f58595-0d39-4d52-8e25-ef8a717466d2 None None] MFA Rules not processed for user `3ffbe88cb6114c39b08be9b4d5df0c52`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:47.215732 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-b4f58595-0d39-4d52-8e25-ef8a717466d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:47.368717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:47.381078 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 899/1791] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:47.387650 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e670ec5-9c92-4a3f-871d-1dd00abb2918 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:47.564955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:47.576581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e670ec5-9c92-4a3f-871d-1dd00abb2918 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:47.586888 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e62bc-f7fa-40dc-a854-a02417101410 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:47.589140 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e62bc-f7fa-40dc-a854-a02417101410 service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:47.589518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e62bc-f7fa-40dc-a854-a02417101410 service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:47.589891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e62bc-f7fa-40dc-a854-a02417101410 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:47.608920 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e62bc-f7fa-40dc-a854-a02417101410 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:47.613560 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e62bc-f7fa-40dc-a854-a02417101410 service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:47.638723 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 893/1792] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:47 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 10:54:47.746827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f58595-0d39-4d52-8e25-ef8a717466d2 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:47.748294 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-b4f58595-0d39-4d52-8e25-ef8a717466d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:47.789264 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e62bc-f7fa-40dc-a854-a02417101410 service cinder] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:47.801581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e62bc-f7fa-40dc-a854-a02417101410 service cinder] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:47.813457 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e7085-f578-4e8c-ace1-a32ac58ad68a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:47.820004 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e7085-f578-4e8c-ace1-a32ac58ad68a service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:47.822890 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e7085-f578-4e8c-ace1-a32ac58ad68a service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:47.823805 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e7085-f578-4e8c-ace1-a32ac58ad68a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:47.938611 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f58595-0d39-4d52-8e25-ef8a717466d2 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:47.955199 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d40cb-e298-4651-9e0e-d1e18701bf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:47.956193 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d40cb-e298-4651-9e0e-d1e18701bf4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:47.956675 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d40cb-e298-4651-9e0e-d1e18701bf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:47.957170 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d40cb-e298-4651-9e0e-d1e18701bf4d admin admin] PATH_INFO: `/v3/projects/d98a7d2dae044b599370ac542ed568f9` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:47.958970 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d40cb-e298-4651-9e0e-d1e18701bf4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d98a7d2dae044b599370ac542ed568f9)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:47.961164 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d40cb-e298-4651-9e0e-d1e18701bf4d admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:48.063918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-ce6d40cb-e298-4651-9e0e-d1e18701bf4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd98a7d2dae044b599370ac542ed568f9', 'request_id': 'req-ce6d40cb-e298-4651-9e0e-d1e18701bf4d'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:48.083781 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-ce6d40cb-e298-4651-9e0e-d1e18701bf4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd98a7d2dae044b599370ac542ed568f9', 'request_id': 'req-ce6d40cb-e298-4651-9e0e-d1e18701bf4d'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:48.095478 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-ce6d40cb-e298-4651-9e0e-d1e18701bf4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd98a7d2dae044b599370ac542ed568f9', 'request_id': 'req-ce6d40cb-e298-4651-9e0e-d1e18701bf4d'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:48.097011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e7085-f578-4e8c-ace1-a32ac58ad68a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:48.103301 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e7085-f578-4e8c-ace1-a32ac58ad68a service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:48.134434 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-ce6d40cb-e298-4651-9e0e-d1e18701bf4d admin admin] The token cache is being invalidate because project d98a7d2dae044b599370ac542ed568f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:54:48.135068 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-ce6d40cb-e298-4651-9e0e-d1e18701bf4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:48.138698 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-ce6d40cb-e298-4651-9e0e-d1e18701bf4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:48.147115 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 900/1793] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:54:47 2022] DELETE /identity/v3/projects/d98a7d2dae044b599370ac542ed568f9 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:48.151874 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d40cb-e298-4651-9e0e-d1e18701bf4d admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:48.157681 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 894/1794] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 10:54:48.158890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-ce6d40cb-e298-4651-9e0e-d1e18701bf4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:48.355374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d40cb-e298-4651-9e0e-d1e18701bf4d admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:48.362539 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294863a-527f-4b2d-a5a8-a4e4cf878c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:48.364294 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294863a-527f-4b2d-a5a8-a4e4cf878c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:48.364802 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294863a-527f-4b2d-a5a8-a4e4cf878c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:48.365432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294863a-527f-4b2d-a5a8-a4e4cf878c54 admin admin] PATH_INFO: `/v3/users/e6de45c5c8e74ece9cd43abb287c92cb` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:48.367072 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5294863a-527f-4b2d-a5a8-a4e4cf878c54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6de45c5c8e74ece9cd43abb287c92cb)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:48.369932 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5294863a-527f-4b2d-a5a8-a4e4cf878c54 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:48.488816 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:48.540579 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-5294863a-527f-4b2d-a5a8-a4e4cf878c54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6de45c5c8e74ece9cd43abb287c92cb'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:48.562984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-5294863a-527f-4b2d-a5a8-a4e4cf878c54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6de45c5c8e74ece9cd43abb287c92cb'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:48.563990 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-5294863a-527f-4b2d-a5a8-a4e4cf878c54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6de45c5c8e74ece9cd43abb287c92cb'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:48.586461 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-5294863a-527f-4b2d-a5a8-a4e4cf878c54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6de45c5c8e74ece9cd43abb287c92cb'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:48.596220 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-5294863a-527f-4b2d-a5a8-a4e4cf878c54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6de45c5c8e74ece9cd43abb287c92cb'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:48.614435 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 901/1795] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:54:48 2022] DELETE /identity/v3/users/e6de45c5c8e74ece9cd43abb287c92cb => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 10:54:48.948344 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb915d2a-2c08-4254-b0df-bf6d29db3deb None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:48.948751 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb915d2a-2c08-4254-b0df-bf6d29db3deb None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:48.949250 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb915d2a-2c08-4254-b0df-bf6d29db3deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:49.037413 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-eb915d2a-2c08-4254-b0df-bf6d29db3deb None None] MFA Rules not processed for user `9b03428b48264b9da9800283496de2e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:49.040484 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-eb915d2a-2c08-4254-b0df-bf6d29db3deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:49.353766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 895/1796] 10.222.0.30 () {58 vars in 1015 bytes} [Sun Aug 7 10:54:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:49.418367 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294863a-527f-4b2d-a5a8-a4e4cf878c54 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:49.420456 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-5294863a-527f-4b2d-a5a8-a4e4cf878c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:49.450164 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294863a-527f-4b2d-a5a8-a4e4cf878c54 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:49.463266 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d35975-7b71-438a-9df5-0d7c220b1e59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:49.464131 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d35975-7b71-438a-9df5-0d7c220b1e59 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:49.465094 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d35975-7b71-438a-9df5-0d7c220b1e59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:49.465589 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d35975-7b71-438a-9df5-0d7c220b1e59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:49.517018 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d35975-7b71-438a-9df5-0d7c220b1e59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:49.525845 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d35975-7b71-438a-9df5-0d7c220b1e59 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:49.552988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 902/1797] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:49.629416 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb915d2a-2c08-4254-b0df-bf6d29db3deb None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:49.631335 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-eb915d2a-2c08-4254-b0df-bf6d29db3deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:49.649740 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb915d2a-2c08-4254-b0df-bf6d29db3deb None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:49.654506 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5b762-c771-48fb-827d-f123ac6e5b65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:49.655800 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5b762-c771-48fb-827d-f123ac6e5b65 service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:49.656415 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5b762-c771-48fb-827d-f123ac6e5b65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:49.656905 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5b762-c771-48fb-827d-f123ac6e5b65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:49.667678 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5b762-c771-48fb-827d-f123ac6e5b65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:49.669691 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b5b762-c771-48fb-827d-f123ac6e5b65 service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:49.684057 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 896/1798] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:51.206432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d35975-7b71-438a-9df5-0d7c220b1e59 service neutron] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:51.208060 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-f0d35975-7b71-438a-9df5-0d7c220b1e59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:51.418881 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d35975-7b71-438a-9df5-0d7c220b1e59 service neutron] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:51.426289 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f71a1-277f-4134-b868-b83067c5a78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:51.428132 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f71a1-277f-4134-b868-b83067c5a78a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:51.428611 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f71a1-277f-4134-b868-b83067c5a78a admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:51.429067 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f71a1-277f-4134-b868-b83067c5a78a admin admin] PATH_INFO: `/v3/projects/816b96abbaa646ad90d750174c8c6ba5` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:51.430807 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f71a1-277f-4134-b868-b83067c5a78a admin admin] RBAC: Authorizing `identity:delete_project(project_id=816b96abbaa646ad90d750174c8c6ba5)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:51.433468 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f71a1-277f-4134-b868-b83067c5a78a admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:51.549229 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-661f71a1-277f-4134-b868-b83067c5a78a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '816b96abbaa646ad90d750174c8c6ba5', 'request_id': 'req-661f71a1-277f-4134-b868-b83067c5a78a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:51.559943 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-661f71a1-277f-4134-b868-b83067c5a78a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '816b96abbaa646ad90d750174c8c6ba5', 'request_id': 'req-661f71a1-277f-4134-b868-b83067c5a78a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:51.580682 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-661f71a1-277f-4134-b868-b83067c5a78a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '816b96abbaa646ad90d750174c8c6ba5', 'request_id': 'req-661f71a1-277f-4134-b868-b83067c5a78a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:51.642092 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-661f71a1-277f-4134-b868-b83067c5a78a admin admin] The token cache is being invalidate because project 816b96abbaa646ad90d750174c8c6ba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:54:51.643238 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-661f71a1-277f-4134-b868-b83067c5a78a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:51.645712 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-661f71a1-277f-4134-b868-b83067c5a78a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:51.657766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 903/1799] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:54:51 2022] DELETE /identity/v3/projects/816b96abbaa646ad90d750174c8c6ba5 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:51.659515 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05067c1-531a-4db2-b300-bc2465b10b42 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:51.660079 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05067c1-531a-4db2-b300-bc2465b10b42 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:51.660168 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05067c1-531a-4db2-b300-bc2465b10b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:51.720958 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-b05067c1-531a-4db2-b300-bc2465b10b42 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:51.727376 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-b05067c1-531a-4db2-b300-bc2465b10b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:51.912725 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 897/1800] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:51.921027 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b91b4f-e9f9-4db1-ae43-4ce089f97697 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:51.921328 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b91b4f-e9f9-4db1-ae43-4ce089f97697 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:51.921647 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b91b4f-e9f9-4db1-ae43-4ce089f97697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:51.959415 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-41b91b4f-e9f9-4db1-ae43-4ce089f97697 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:51.960733 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-41b91b4f-e9f9-4db1-ae43-4ce089f97697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:51.978022 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 904/1801] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:51.980060 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05067c1-531a-4db2-b300-bc2465b10b42 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:51.993248 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05067c1-531a-4db2-b300-bc2465b10b42 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:52.009510 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b08c8-dc82-4db0-abbe-77840058cd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:52.010221 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b08c8-dc82-4db0-abbe-77840058cd78 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:52.010503 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b08c8-dc82-4db0-abbe-77840058cd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:52.011061 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b08c8-dc82-4db0-abbe-77840058cd78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:52.011857 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b08c8-dc82-4db0-abbe-77840058cd78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:54:52.012232 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b08c8-dc82-4db0-abbe-77840058cd78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:52.016517 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b08c8-dc82-4db0-abbe-77840058cd78 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:52.029946 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 898/1802] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:54:52.034533 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b91b4f-e9f9-4db1-ae43-4ce089f97697 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:52.049769 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b91b4f-e9f9-4db1-ae43-4ce089f97697 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:52.055495 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bafb6-0f49-459c-a430-2afbb2e3401b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:52.055995 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bafb6-0f49-459c-a430-2afbb2e3401b admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:52.056546 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bafb6-0f49-459c-a430-2afbb2e3401b admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:52.057559 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bafb6-0f49-459c-a430-2afbb2e3401b admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:52.058566 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bafb6-0f49-459c-a430-2afbb2e3401b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:52.061110 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bafb6-0f49-459c-a430-2afbb2e3401b admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:52.088759 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:52.107338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 905/1803] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:54:52 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:52.108655 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b08c8-dc82-4db0-abbe-77840058cd78 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:52.136055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b08c8-dc82-4db0-abbe-77840058cd78 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:52.168856 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:52.294769 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9638e-6a00-4e16-9533-4e5ba3fa3f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:52.297105 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9638e-6a00-4e16-9533-4e5ba3fa3f95 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:52.297432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9638e-6a00-4e16-9533-4e5ba3fa3f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:52.297714 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9638e-6a00-4e16-9533-4e5ba3fa3f95 admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:52.298377 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9638e-6a00-4e16-9533-4e5ba3fa3f95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:52.300331 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9638e-6a00-4e16-9533-4e5ba3fa3f95 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:52.371976 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 899/1804] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:54:52 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:52.385096 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bafb6-0f49-459c-a430-2afbb2e3401b admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:52.406820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bafb6-0f49-459c-a430-2afbb2e3401b admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:52.430749 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ad28c-d0d6-47db-8c28-29dc7da1fb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:52.431117 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ad28c-d0d6-47db-8c28-29dc7da1fb6e admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:52.431377 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ad28c-d0d6-47db-8c28-29dc7da1fb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:52.431645 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ad28c-d0d6-47db-8c28-29dc7da1fb6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:52.432459 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ad28c-d0d6-47db-8c28-29dc7da1fb6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:52.433928 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ad28c-d0d6-47db-8c28-29dc7da1fb6e admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:52.466379 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 906/1805] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:52.467939 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9638e-6a00-4e16-9533-4e5ba3fa3f95 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:52.492656 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9638e-6a00-4e16-9533-4e5ba3fa3f95 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:52.514813 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc6d22-8611-4d18-92d9-589ad3d650c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:52.515449 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc6d22-8611-4d18-92d9-589ad3d650c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:52.515733 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc6d22-8611-4d18-92d9-589ad3d650c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:52.516011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc6d22-8611-4d18-92d9-589ad3d650c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:52.516672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc6d22-8611-4d18-92d9-589ad3d650c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:52.518681 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc6d22-8611-4d18-92d9-589ad3d650c3 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:52.556270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 900/1806] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:52.556635 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ad28c-d0d6-47db-8c28-29dc7da1fb6e admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:52.568080 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ad28c-d0d6-47db-8c28-29dc7da1fb6e admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:52.589744 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb0d78-201e-406a-8858-c7b4acd8fc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:52.590401 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb0d78-201e-406a-8858-c7b4acd8fc99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:52.590689 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb0d78-201e-406a-8858-c7b4acd8fc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:52.590950 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb0d78-201e-406a-8858-c7b4acd8fc99 admin admin] PATH_INFO: `/v3/projects/a9e65f48fc0548d2857f8aff25f6c17a/users/1bf4e6d31139417691e12205a6c7b5fe/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:52.646677 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb0d78-201e-406a-8858-c7b4acd8fc99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9e65f48fc0548d2857f8aff25f6c17a, user_id=1bf4e6d31139417691e12205a6c7b5fe, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:52.649689 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb0d78-201e-406a-8858-c7b4acd8fc99 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:52.688975 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 907/1807] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:54:52 2022] PUT /identity/v3/projects/a9e65f48fc0548d2857f8aff25f6c17a/users/1bf4e6d31139417691e12205a6c7b5fe/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:52.699554 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a4395-2203-4dbe-b57b-ac2f7a0bb252 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:52.700093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a4395-2203-4dbe-b57b-ac2f7a0bb252 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:52.700200 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a4395-2203-4dbe-b57b-ac2f7a0bb252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:52.819120 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-e18a4395-2203-4dbe-b57b-ac2f7a0bb252 None None] MFA Rules not processed for user `1bf4e6d31139417691e12205a6c7b5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:52.820438 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-e18a4395-2203-4dbe-b57b-ac2f7a0bb252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:52.886360 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424fad9-b1f4-45da-8a0a-f6563a0abff0 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:52.886683 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424fad9-b1f4-45da-8a0a-f6563a0abff0 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:52.886920 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424fad9-b1f4-45da-8a0a-f6563a0abff0 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:52.888281 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 908/1808] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 7 10:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 10:54:52.923059 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d2326-4904-445e-88a4-57c8b9efa101 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:52.923336 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d2326-4904-445e-88a4-57c8b9efa101 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:52.923613 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d2326-4904-445e-88a4-57c8b9efa101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:52.975003 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-e41d2326-4904-445e-88a4-57c8b9efa101 None None] MFA Rules not processed for user `f98cb7abbb8942cebb71aa98da80a05a`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:52.976326 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-e41d2326-4904-445e-88a4-57c8b9efa101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:52.987870 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 901/1809] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:52.995220 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a4395-2203-4dbe-b57b-ac2f7a0bb252 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:53.167850 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a4395-2203-4dbe-b57b-ac2f7a0bb252 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:53.187546 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4902d-4f66-4f4f-b2d4-de26bf093699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:53.188144 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4902d-4f66-4f4f-b2d4-de26bf093699 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:53.188430 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4902d-4f66-4f4f-b2d4-de26bf093699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:53.188701 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4902d-4f66-4f4f-b2d4-de26bf093699 admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:53.189388 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4902d-4f66-4f4f-b2d4-de26bf093699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:53.191357 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4902d-4f66-4f4f-b2d4-de26bf093699 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:53.303703 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 902/1810] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:54:52 2022] POST /identity/v3/projects => generated 387 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 10:54:53.303914 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 909/1811] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 7 10:54:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:54:53.305192 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4902d-4f66-4f4f-b2d4-de26bf093699 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:53.340173 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:53.342687 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ed658-02c2-47ff-8f04-18e810d1c982 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:53.342985 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ed658-02c2-47ff-8f04-18e810d1c982 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:53.343262 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ed658-02c2-47ff-8f04-18e810d1c982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:53.447782 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-9d0ed658-02c2-47ff-8f04-18e810d1c982 None None] MFA Rules not processed for user `27997821407d4feb81fb07f5a8721bad`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:53.465506 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-9d0ed658-02c2-47ff-8f04-18e810d1c982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:53.596199 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4902d-4f66-4f4f-b2d4-de26bf093699 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:53.614155 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee16f2-3310-4732-94dc-52413a1f0dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:53.615326 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee16f2-3310-4732-94dc-52413a1f0dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:53.615617 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee16f2-3310-4732-94dc-52413a1f0dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:53.615889 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee16f2-3310-4732-94dc-52413a1f0dd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:53.627729 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee16f2-3310-4732-94dc-52413a1f0dd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:53.630160 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee16f2-3310-4732-94dc-52413a1f0dd5 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:53.686189 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 910/1812] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:53 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:54:53.687204 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ed658-02c2-47ff-8f04-18e810d1c982 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:53.691983 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-9d0ed658-02c2-47ff-8f04-18e810d1c982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:53.701826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 903/1813] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:54:53 2022] POST /identity/v3/users => generated 300 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:53.705691 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee16f2-3310-4732-94dc-52413a1f0dd5 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:53.718558 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-5cee16f2-3310-4732-94dc-52413a1f0dd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:53.739164 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ed658-02c2-47ff-8f04-18e810d1c982 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:53.743403 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee16f2-3310-4732-94dc-52413a1f0dd5 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:53.752521 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfcaca-0676-47f3-a3a8-bc0003274f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:53.753490 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed73b6-ba9b-4e6a-b01d-7d3c560336f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:53.753750 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfcaca-0676-47f3-a3a8-bc0003274f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:53.754469 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfcaca-0676-47f3-a3a8-bc0003274f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:53.754639 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed73b6-ba9b-4e6a-b01d-7d3c560336f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:53.755025 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed73b6-ba9b-4e6a-b01d-7d3c560336f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:53.755981 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed73b6-ba9b-4e6a-b01d-7d3c560336f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:53.756342 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfcaca-0676-47f3-a3a8-bc0003274f68 admin admin] PATH_INFO: `/v3/users/854043eadaae4dae89ba48bff0b84f87` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:53.756770 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed73b6-ba9b-4e6a-b01d-7d3c560336f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:53.766510 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dfcaca-0676-47f3-a3a8-bc0003274f68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=854043eadaae4dae89ba48bff0b84f87)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:53.767645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed73b6-ba9b-4e6a-b01d-7d3c560336f9 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:53.769375 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dfcaca-0676-47f3-a3a8-bc0003274f68 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:53.863284 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 904/1814] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:54:53 2022] POST /identity/v3/projects => generated 405 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:53.864735 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:53.865882 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed73b6-ba9b-4e6a-b01d-7d3c560336f9 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:53.898866 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-03dfcaca-0676-47f3-a3a8-bc0003274f68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '854043eadaae4dae89ba48bff0b84f87'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:53.957952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-03dfcaca-0676-47f3-a3a8-bc0003274f68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '854043eadaae4dae89ba48bff0b84f87'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:53.959411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-03dfcaca-0676-47f3-a3a8-bc0003274f68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '854043eadaae4dae89ba48bff0b84f87'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:53.989599 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-03dfcaca-0676-47f3-a3a8-bc0003274f68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '854043eadaae4dae89ba48bff0b84f87'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:54.004839 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-03dfcaca-0676-47f3-a3a8-bc0003274f68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '854043eadaae4dae89ba48bff0b84f87'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:54.029950 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 911/1815] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:54:53 2022] DELETE /identity/v3/users/854043eadaae4dae89ba48bff0b84f87 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:54.032824 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed73b6-ba9b-4e6a-b01d-7d3c560336f9 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:54.037708 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa40c4-a72a-4948-ae94-60265b8f1d64 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:54.038183 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa40c4-a72a-4948-ae94-60265b8f1d64 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:54.038742 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa40c4-a72a-4948-ae94-60265b8f1d64 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:54.047217 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 912/1816] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 7 10:54:54 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:54:54.048373 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa40c4-a72a-4948-ae94-60265b8f1d64 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:54.055147 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-b3aa40c4-a72a-4948-ae94-60265b8f1d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:54.217545 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e045dd8-2dc2-452d-baaf-710fa9517ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:54.218282 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e045dd8-2dc2-452d-baaf-710fa9517ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:54.218673 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e045dd8-2dc2-452d-baaf-710fa9517ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:54.219058 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e045dd8-2dc2-452d-baaf-710fa9517ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:54.219948 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e045dd8-2dc2-452d-baaf-710fa9517ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:54.231120 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e045dd8-2dc2-452d-baaf-710fa9517ee2 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:54.249417 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 905/1817] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:54.251032 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1eba13-325e-4391-a49d-191bc92232c2 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:54.251354 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1eba13-325e-4391-a49d-191bc92232c2 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:54.251738 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1eba13-325e-4391-a49d-191bc92232c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:54.258143 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa40c4-a72a-4948-ae94-60265b8f1d64 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:54.282239 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e7f9d-9146-429a-b64e-682e368b73ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:54.290102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e7f9d-9146-429a-b64e-682e368b73ec admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:54.290407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e7f9d-9146-429a-b64e-682e368b73ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:54.290722 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e7f9d-9146-429a-b64e-682e368b73ec admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:54.291329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e7f9d-9146-429a-b64e-682e368b73ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:54.293751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e7f9d-9146-429a-b64e-682e368b73ec admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:54.294912 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-ad1eba13-325e-4391-a49d-191bc92232c2 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:54.296235 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ad1eba13-325e-4391-a49d-191bc92232c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:54.315676 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 906/1818] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:54.317106 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7985887-7804-4882-98dc-299c2ce404af None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:54.317546 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7985887-7804-4882-98dc-299c2ce404af None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:54.317972 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7985887-7804-4882-98dc-299c2ce404af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:54.358155 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-c7985887-7804-4882-98dc-299c2ce404af None None] MFA Rules not processed for user `f98cb7abbb8942cebb71aa98da80a05a`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:54.359695 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-c7985887-7804-4882-98dc-299c2ce404af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:54.379504 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 913/1819] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:54:54 2022] POST /identity/v3/users => generated 309 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:54.384476 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e7f9d-9146-429a-b64e-682e368b73ec admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:54.385810 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:54.392925 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-2d2e7f9d-9146-429a-b64e-682e368b73ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:54.419218 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e7f9d-9146-429a-b64e-682e368b73ec admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:54.438467 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1c86f-19d7-4db3-8ad1-2bd34fbc19ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:54.439341 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1c86f-19d7-4db3-8ad1-2bd34fbc19ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:54.439636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1c86f-19d7-4db3-8ad1-2bd34fbc19ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:54.440780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1c86f-19d7-4db3-8ad1-2bd34fbc19ac admin admin] PATH_INFO: `/v3/projects/13911c3f9fc24c0ab80188bd82a2f357/users/6cb3087390924fbca7b751ded027b7ff/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:54.464975 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb1c86f-19d7-4db3-8ad1-2bd34fbc19ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=13911c3f9fc24c0ab80188bd82a2f357, user_id=6cb3087390924fbca7b751ded027b7ff, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:54.468862 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb1c86f-19d7-4db3-8ad1-2bd34fbc19ac admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:54.499439 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 914/1820] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:54:54 2022] PUT /identity/v3/projects/13911c3f9fc24c0ab80188bd82a2f357/users/6cb3087390924fbca7b751ded027b7ff/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:54.502447 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1c86f-19d7-4db3-8ad1-2bd34fbc19ac admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:54.509009 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-7fb1c86f-19d7-4db3-8ad1-2bd34fbc19ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:54.577724 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 907/1821] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 7 10:54:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:54.578730 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7985887-7804-4882-98dc-299c2ce404af None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:54.615513 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7985887-7804-4882-98dc-299c2ce404af None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:54.701446 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1c86f-19d7-4db3-8ad1-2bd34fbc19ac admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:54.723475 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5910302-685e-490d-a498-e92a68e2721f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:54.724250 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5910302-685e-490d-a498-e92a68e2721f service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:54.724801 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5910302-685e-490d-a498-e92a68e2721f service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:54.725192 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5910302-685e-490d-a498-e92a68e2721f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:54.756801 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7bfdf-5c9d-4516-9a61-336483668f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:54.757526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7bfdf-5c9d-4516-9a61-336483668f5d admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:54.757883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7bfdf-5c9d-4516-9a61-336483668f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:54.758784 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7bfdf-5c9d-4516-9a61-336483668f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:54.759928 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7bfdf-5c9d-4516-9a61-336483668f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:54.767140 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7bfdf-5c9d-4516-9a61-336483668f5d admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:54.784983 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 908/1822] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:54.790520 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7bfdf-5c9d-4516-9a61-336483668f5d admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:54.813048 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7bfdf-5c9d-4516-9a61-336483668f5d admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:54.823834 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:54.830036 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02b036-0ecf-41b8-889d-c717f9cb0e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:54.830692 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02b036-0ecf-41b8-889d-c717f9cb0e90 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:54.830974 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02b036-0ecf-41b8-889d-c717f9cb0e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:54.831269 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02b036-0ecf-41b8-889d-c717f9cb0e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:54.831963 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02b036-0ecf-41b8-889d-c717f9cb0e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:54.833754 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02b036-0ecf-41b8-889d-c717f9cb0e90 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:54.855629 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 909/1823] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:54.856839 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02b036-0ecf-41b8-889d-c717f9cb0e90 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:54.869062 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ed02b036-0ecf-41b8-889d-c717f9cb0e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:54.883878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5910302-685e-490d-a498-e92a68e2721f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:54.887118 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5910302-685e-490d-a498-e92a68e2721f service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:54.903430 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 915/1824] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:54.904295 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5910302-685e-490d-a498-e92a68e2721f service neutron] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:54.917546 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5910302-685e-490d-a498-e92a68e2721f service neutron] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:54.924565 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e297d5-1493-4b06-8736-02dd0c89a25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:54.925238 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e297d5-1493-4b06-8736-02dd0c89a25a admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:54.926082 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e297d5-1493-4b06-8736-02dd0c89a25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:54.927002 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e297d5-1493-4b06-8736-02dd0c89a25a admin admin] PATH_INFO: `/v3/projects/c46bdb13edae44319db0d0c58082193e/users/a737c43d610f45449163ec6b63126d68/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:54.948837 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e297d5-1493-4b06-8736-02dd0c89a25a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c46bdb13edae44319db0d0c58082193e, user_id=a737c43d610f45449163ec6b63126d68, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:54.952523 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e297d5-1493-4b06-8736-02dd0c89a25a admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:54.983151 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 916/1825] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:54:54 2022] PUT /identity/v3/projects/c46bdb13edae44319db0d0c58082193e/users/a737c43d610f45449163ec6b63126d68/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:54.984999 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e297d5-1493-4b06-8736-02dd0c89a25a admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:55.059136 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02b036-0ecf-41b8-889d-c717f9cb0e90 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:55.136008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e297d5-1493-4b06-8736-02dd0c89a25a admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:55.146940 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:55.151511 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb49c25-1e21-4e3d-a0a6-665aa8948dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:55.153520 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb49c25-1e21-4e3d-a0a6-665aa8948dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:55.155049 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb49c25-1e21-4e3d-a0a6-665aa8948dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:55.156513 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb49c25-1e21-4e3d-a0a6-665aa8948dc7 admin admin] PATH_INFO: `/v3/projects/13911c3f9fc24c0ab80188bd82a2f357/users/6cb3087390924fbca7b751ded027b7ff/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:55.163713 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb49c25-1e21-4e3d-a0a6-665aa8948dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13911c3f9fc24c0ab80188bd82a2f357, user_id=6cb3087390924fbca7b751ded027b7ff, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:55.170691 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb49c25-1e21-4e3d-a0a6-665aa8948dc7 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:55.202819 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 917/1826] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:54:54 2022] PUT /identity/v3/projects/13911c3f9fc24c0ab80188bd82a2f357/users/6cb3087390924fbca7b751ded027b7ff/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:55.209605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb49c25-1e21-4e3d-a0a6-665aa8948dc7 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:55.292932 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b9350-23e7-49ab-ac05-7be0e31ddebe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:55.296142 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b9350-23e7-49ab-ac05-7be0e31ddebe service nova] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:55.296142 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b9350-23e7-49ab-ac05-7be0e31ddebe service nova] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:55.296386 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b9350-23e7-49ab-ac05-7be0e31ddebe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:55.299734 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-7a6b9350-23e7-49ab-ac05-7be0e31ddebe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:55.335707 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b9350-23e7-49ab-ac05-7be0e31ddebe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:55.339035 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b9350-23e7-49ab-ac05-7be0e31ddebe service nova] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:55.396894 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 910/1827] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:55.401218 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3592d-9bc0-42a6-9a34-0786863e8fd5 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:55.401651 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3592d-9bc0-42a6-9a34-0786863e8fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:55.402073 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3592d-9bc0-42a6-9a34-0786863e8fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:55.465288 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb49c25-1e21-4e3d-a0a6-665aa8948dc7 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:55.470338 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-0ff3592d-9bc0-42a6-9a34-0786863e8fd5 None None] MFA Rules not processed for user `6cb3087390924fbca7b751ded027b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:55.474228 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-0ff3592d-9bc0-42a6-9a34-0786863e8fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:55.481197 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016aba9-43fa-4fe1-9d8e-5f3e519a7497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:55.481871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016aba9-43fa-4fe1-9d8e-5f3e519a7497 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:55.482153 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016aba9-43fa-4fe1-9d8e-5f3e519a7497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:55.482430 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016aba9-43fa-4fe1-9d8e-5f3e519a7497 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:55.483115 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016aba9-43fa-4fe1-9d8e-5f3e519a7497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:55.490770 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016aba9-43fa-4fe1-9d8e-5f3e519a7497 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:55.556353 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 918/1828] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:55.557073 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016aba9-43fa-4fe1-9d8e-5f3e519a7497 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:55.582462 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016aba9-43fa-4fe1-9d8e-5f3e519a7497 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:55.610649 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36ba05-d781-49c1-a733-c8e6b45a476c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:55.611332 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36ba05-d781-49c1-a733-c8e6b45a476c admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:55.611613 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36ba05-d781-49c1-a733-c8e6b45a476c admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:55.611898 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36ba05-d781-49c1-a733-c8e6b45a476c admin admin] PATH_INFO: `/v3/projects/c46bdb13edae44319db0d0c58082193e/users/a737c43d610f45449163ec6b63126d68/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:55.615848 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36ba05-d781-49c1-a733-c8e6b45a476c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c46bdb13edae44319db0d0c58082193e, user_id=a737c43d610f45449163ec6b63126d68, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:55.619334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36ba05-d781-49c1-a733-c8e6b45a476c admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:55.657826 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 919/1829] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:54:55 2022] PUT /identity/v3/projects/c46bdb13edae44319db0d0c58082193e/users/a737c43d610f45449163ec6b63126d68/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:55.702861 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 911/1830] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:55 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:55.711671 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36ba05-d781-49c1-a733-c8e6b45a476c admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:55.713447 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-df36ba05-d781-49c1-a733-c8e6b45a476c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:55.773869 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:55.869051 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36ba05-d781-49c1-a733-c8e6b45a476c admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:55.875918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006111bd-1f29-4b7e-b0bf-e96c22194cbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:55.876572 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006111bd-1f29-4b7e-b0bf-e96c22194cbc service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:55.876852 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006111bd-1f29-4b7e-b0bf-e96c22194cbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:55.877117 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006111bd-1f29-4b7e-b0bf-e96c22194cbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:56.015958 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006111bd-1f29-4b7e-b0bf-e96c22194cbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:56.017880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006111bd-1f29-4b7e-b0bf-e96c22194cbc service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:56.035213 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 920/1831] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:55 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 10:54:56.082151 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3592d-9bc0-42a6-9a34-0786863e8fd5 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:56.110691 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3592d-9bc0-42a6-9a34-0786863e8fd5 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:56.274409 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006111bd-1f29-4b7e-b0bf-e96c22194cbc service cinder] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:56.275915 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-006111bd-1f29-4b7e-b0bf-e96c22194cbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:56.391067 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e828f-2c46-4a19-834d-a1d9cb5ccce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:56.392779 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e828f-2c46-4a19-834d-a1d9cb5ccce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:56.394329 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e828f-2c46-4a19-834d-a1d9cb5ccce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:56.395367 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e828f-2c46-4a19-834d-a1d9cb5ccce4 admin admin] PATH_INFO: `/v3/users/1bf4e6d31139417691e12205a6c7b5fe` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:56.417227 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e828f-2c46-4a19-834d-a1d9cb5ccce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bf4e6d31139417691e12205a6c7b5fe)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:56.422617 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e828f-2c46-4a19-834d-a1d9cb5ccce4 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:56.439638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006111bd-1f29-4b7e-b0bf-e96c22194cbc service cinder] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:56.449196 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0a9ee-77fa-4c56-822f-9b2b493f154f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:56.449901 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0a9ee-77fa-4c56-822f-9b2b493f154f service nova] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:56.450230 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0a9ee-77fa-4c56-822f-9b2b493f154f service nova] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:56.450658 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0a9ee-77fa-4c56-822f-9b2b493f154f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:56.465476 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0a9ee-77fa-4c56-822f-9b2b493f154f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:56.467165 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0a9ee-77fa-4c56-822f-9b2b493f154f service nova] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:56.495809 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 921/1832] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 10:54:56.556537 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:56.576500 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0b4e828f-2c46-4a19-834d-a1d9cb5ccce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bf4e6d31139417691e12205a6c7b5fe'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:56.633060 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0b4e828f-2c46-4a19-834d-a1d9cb5ccce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bf4e6d31139417691e12205a6c7b5fe'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:56.633852 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0b4e828f-2c46-4a19-834d-a1d9cb5ccce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bf4e6d31139417691e12205a6c7b5fe'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:56.655949 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0b4e828f-2c46-4a19-834d-a1d9cb5ccce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bf4e6d31139417691e12205a6c7b5fe'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:56.691845 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0b4e828f-2c46-4a19-834d-a1d9cb5ccce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bf4e6d31139417691e12205a6c7b5fe'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:56.741451 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 912/1833] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:54:56 2022] DELETE /identity/v3/users/1bf4e6d31139417691e12205a6c7b5fe => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:56.746160 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051b029-bcfc-484e-9e54-df38cb99d14e None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:56.746517 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051b029-bcfc-484e-9e54-df38cb99d14e None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:56.746817 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051b029-bcfc-484e-9e54-df38cb99d14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:56.791786 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-d051b029-bcfc-484e-9e54-df38cb99d14e None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:56.793861 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-d051b029-bcfc-484e-9e54-df38cb99d14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:56.886541 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:56.900370 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 922/1834] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:54:56.962900 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e828f-2c46-4a19-834d-a1d9cb5ccce4 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:56.965766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-0b4e828f-2c46-4a19-834d-a1d9cb5ccce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:57.091452 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e828f-2c46-4a19-834d-a1d9cb5ccce4 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:57.096534 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ca3cd-59d0-483d-961f-4b3d2cd11084 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:57.097184 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ca3cd-59d0-483d-961f-4b3d2cd11084 service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:57.097767 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ca3cd-59d0-483d-961f-4b3d2cd11084 service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:57.098036 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ca3cd-59d0-483d-961f-4b3d2cd11084 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:57.108550 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ca3cd-59d0-483d-961f-4b3d2cd11084 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:57.110822 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ca3cd-59d0-483d-961f-4b3d2cd11084 service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:57.124041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 913/1835] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:57.677852 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbe63d-73dc-4ac5-beb2-e2ba90494660 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:57.681186 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbe63d-73dc-4ac5-beb2-e2ba90494660 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:57.681712 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbe63d-73dc-4ac5-beb2-e2ba90494660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:57.734943 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-e5cbe63d-73dc-4ac5-beb2-e2ba90494660 None None] MFA Rules not processed for user `a737c43d610f45449163ec6b63126d68`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:57.736419 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-e5cbe63d-73dc-4ac5-beb2-e2ba90494660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:57.743577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ca3cd-59d0-483d-961f-4b3d2cd11084 service neutron] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:57.745980 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a72ca3cd-59d0-483d-961f-4b3d2cd11084 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:57.781511 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ca3cd-59d0-483d-961f-4b3d2cd11084 service neutron] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:57.801431 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aff7d9-894b-4d5d-bb50-6ec97bc4b27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:57.803221 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aff7d9-894b-4d5d-bb50-6ec97bc4b27d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:57.805212 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aff7d9-894b-4d5d-bb50-6ec97bc4b27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:57.805738 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aff7d9-894b-4d5d-bb50-6ec97bc4b27d admin admin] PATH_INFO: `/v3/projects/a9e65f48fc0548d2857f8aff25f6c17a` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:57.810305 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aff7d9-894b-4d5d-bb50-6ec97bc4b27d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9e65f48fc0548d2857f8aff25f6c17a)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:57.814306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aff7d9-894b-4d5d-bb50-6ec97bc4b27d admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:57.879161 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 923/1836] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:57 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:57.881348 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbe63d-73dc-4ac5-beb2-e2ba90494660 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:57.890194 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-e5cbe63d-73dc-4ac5-beb2-e2ba90494660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:57.923266 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbe63d-73dc-4ac5-beb2-e2ba90494660 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:57.930154 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-d2aff7d9-894b-4d5d-bb50-6ec97bc4b27d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9e65f48fc0548d2857f8aff25f6c17a', 'request_id': 'req-d2aff7d9-894b-4d5d-bb50-6ec97bc4b27d'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:57.940302 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-d2aff7d9-894b-4d5d-bb50-6ec97bc4b27d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9e65f48fc0548d2857f8aff25f6c17a', 'request_id': 'req-d2aff7d9-894b-4d5d-bb50-6ec97bc4b27d'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:57.950436 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-d2aff7d9-894b-4d5d-bb50-6ec97bc4b27d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9e65f48fc0548d2857f8aff25f6c17a', 'request_id': 'req-d2aff7d9-894b-4d5d-bb50-6ec97bc4b27d'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:57.974652 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-d2aff7d9-894b-4d5d-bb50-6ec97bc4b27d admin admin] The token cache is being invalidate because project a9e65f48fc0548d2857f8aff25f6c17a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:54:57.975101 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-d2aff7d9-894b-4d5d-bb50-6ec97bc4b27d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:57.977308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-d2aff7d9-894b-4d5d-bb50-6ec97bc4b27d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:57.982447 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 914/1837] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:54:57 2022] DELETE /identity/v3/projects/a9e65f48fc0548d2857f8aff25f6c17a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:57.983906 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aff7d9-894b-4d5d-bb50-6ec97bc4b27d admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:57.986043 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-d2aff7d9-894b-4d5d-bb50-6ec97bc4b27d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:58.048102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5173b-b213-4c8e-9bf1-f6182da9de35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:58.049100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5173b-b213-4c8e-9bf1-f6182da9de35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:58.049502 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5173b-b213-4c8e-9bf1-f6182da9de35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:58.050138 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5173b-b213-4c8e-9bf1-f6182da9de35 admin admin] PATH_INFO: `/v3/projects/4d5a0bcf78eb44c5b498a023ce06a8ea` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:58.052145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5173b-b213-4c8e-9bf1-f6182da9de35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d5a0bcf78eb44c5b498a023ce06a8ea)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:58.054766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5173b-b213-4c8e-9bf1-f6182da9de35 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:58.077145 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:58.104544 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aff7d9-894b-4d5d-bb50-6ec97bc4b27d admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:58.116201 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-a6d5173b-b213-4c8e-9bf1-f6182da9de35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d5a0bcf78eb44c5b498a023ce06a8ea', 'request_id': 'req-a6d5173b-b213-4c8e-9bf1-f6182da9de35'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:58.123934 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-a6d5173b-b213-4c8e-9bf1-f6182da9de35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d5a0bcf78eb44c5b498a023ce06a8ea', 'request_id': 'req-a6d5173b-b213-4c8e-9bf1-f6182da9de35'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:58.133511 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-a6d5173b-b213-4c8e-9bf1-f6182da9de35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d5a0bcf78eb44c5b498a023ce06a8ea', 'request_id': 'req-a6d5173b-b213-4c8e-9bf1-f6182da9de35'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:58.146793 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-a6d5173b-b213-4c8e-9bf1-f6182da9de35 admin admin] The token cache is being invalidate because project 4d5a0bcf78eb44c5b498a023ce06a8ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:54:58.147172 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-a6d5173b-b213-4c8e-9bf1-f6182da9de35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:58.147919 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-a6d5173b-b213-4c8e-9bf1-f6182da9de35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:58.149761 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 924/1838] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:54:57 2022] DELETE /identity/v3/projects/4d5a0bcf78eb44c5b498a023ce06a8ea => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:58.153742 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5173b-b213-4c8e-9bf1-f6182da9de35 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:58.155328 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-a6d5173b-b213-4c8e-9bf1-f6182da9de35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:58.169673 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520ec9c-b0e2-4a28-8d64-722fc06ff336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:58.170320 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520ec9c-b0e2-4a28-8d64-722fc06ff336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:58.170598 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520ec9c-b0e2-4a28-8d64-722fc06ff336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:58.170869 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520ec9c-b0e2-4a28-8d64-722fc06ff336 admin admin] PATH_INFO: `/v3/users/6cb3087390924fbca7b751ded027b7ff` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:58.172045 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520ec9c-b0e2-4a28-8d64-722fc06ff336 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cb3087390924fbca7b751ded027b7ff)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:58.174071 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520ec9c-b0e2-4a28-8d64-722fc06ff336 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:58.176248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:58.226101 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-b520ec9c-b0e2-4a28-8d64-722fc06ff336 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cb3087390924fbca7b751ded027b7ff'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:58.232769 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5173b-b213-4c8e-9bf1-f6182da9de35 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:58.237977 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16b11b-e985-404f-a5cd-560ad84d8219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:58.238611 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16b11b-e985-404f-a5cd-560ad84d8219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:58.238892 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16b11b-e985-404f-a5cd-560ad84d8219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:58.239161 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16b11b-e985-404f-a5cd-560ad84d8219 admin admin] PATH_INFO: `/v3/users/3ffbe88cb6114c39b08be9b4d5df0c52` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:58.239268 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-b520ec9c-b0e2-4a28-8d64-722fc06ff336 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cb3087390924fbca7b751ded027b7ff'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:58.240613 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-b520ec9c-b0e2-4a28-8d64-722fc06ff336 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cb3087390924fbca7b751ded027b7ff'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:58.241008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16b11b-e985-404f-a5cd-560ad84d8219 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ffbe88cb6114c39b08be9b4d5df0c52)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:58.243198 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16b11b-e985-404f-a5cd-560ad84d8219 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:58.247774 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-b520ec9c-b0e2-4a28-8d64-722fc06ff336 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cb3087390924fbca7b751ded027b7ff'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:58.258271 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-b520ec9c-b0e2-4a28-8d64-722fc06ff336 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cb3087390924fbca7b751ded027b7ff'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:58.265091 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 915/1839] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:54:57 2022] DELETE /identity/v3/users/6cb3087390924fbca7b751ded027b7ff => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:58.299056 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-4f16b11b-e985-404f-a5cd-560ad84d8219 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ffbe88cb6114c39b08be9b4d5df0c52'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:58.315913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-4f16b11b-e985-404f-a5cd-560ad84d8219 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ffbe88cb6114c39b08be9b4d5df0c52'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:58.316641 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-4f16b11b-e985-404f-a5cd-560ad84d8219 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ffbe88cb6114c39b08be9b4d5df0c52'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:58.324619 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-4f16b11b-e985-404f-a5cd-560ad84d8219 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ffbe88cb6114c39b08be9b4d5df0c52'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:58.339866 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-4f16b11b-e985-404f-a5cd-560ad84d8219 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ffbe88cb6114c39b08be9b4d5df0c52'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:58.358222 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 925/1840] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:54:58 2022] DELETE /identity/v3/users/3ffbe88cb6114c39b08be9b4d5df0c52 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 10:54:58.807704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5e78a-968c-478a-b6c6-cc821a4cbeda None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:58.808247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5e78a-968c-478a-b6c6-cc821a4cbeda None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:58.809053 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5e78a-968c-478a-b6c6-cc821a4cbeda None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:58.811539 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 916/1841] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 7 10:54:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:54:58.850844 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16b11b-e985-404f-a5cd-560ad84d8219 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:58.852411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-4f16b11b-e985-404f-a5cd-560ad84d8219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:58.864856 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58cfe9-1c4c-455a-aa01-3a0bde2e4924 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:58.865372 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58cfe9-1c4c-455a-aa01-3a0bde2e4924 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:58.865647 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58cfe9-1c4c-455a-aa01-3a0bde2e4924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:58.899400 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-fa58cfe9-1c4c-455a-aa01-3a0bde2e4924 None None] MFA Rules not processed for user `b33f797a9af946a4b296d973388891be`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:58.901601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-fa58cfe9-1c4c-455a-aa01-3a0bde2e4924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:58.987096 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16b11b-e985-404f-a5cd-560ad84d8219 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:58.997963 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e59fc-3bf2-4aa6-8e56-6cf582b518f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:58.998946 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e59fc-3bf2-4aa6-8e56-6cf582b518f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:58.999367 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e59fc-3bf2-4aa6-8e56-6cf582b518f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:59.000079 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e59fc-3bf2-4aa6-8e56-6cf582b518f0 admin admin] PATH_INFO: `/v3/projects/13911c3f9fc24c0ab80188bd82a2f357` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:59.001340 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e59fc-3bf2-4aa6-8e56-6cf582b518f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13911c3f9fc24c0ab80188bd82a2f357)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:59.003560 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e59fc-3bf2-4aa6-8e56-6cf582b518f0 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:59.011474 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 917/1842] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 7 10:54:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:59.066315 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:59.082630 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-106e59fc-3bf2-4aa6-8e56-6cf582b518f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13911c3f9fc24c0ab80188bd82a2f357', 'request_id': 'req-106e59fc-3bf2-4aa6-8e56-6cf582b518f0'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:59.098044 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-106e59fc-3bf2-4aa6-8e56-6cf582b518f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13911c3f9fc24c0ab80188bd82a2f357', 'request_id': 'req-106e59fc-3bf2-4aa6-8e56-6cf582b518f0'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:59.111043 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-106e59fc-3bf2-4aa6-8e56-6cf582b518f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13911c3f9fc24c0ab80188bd82a2f357', 'request_id': 'req-106e59fc-3bf2-4aa6-8e56-6cf582b518f0'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:59.131519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-106e59fc-3bf2-4aa6-8e56-6cf582b518f0 admin admin] The token cache is being invalidate because project 13911c3f9fc24c0ab80188bd82a2f357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:54:59.131867 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-106e59fc-3bf2-4aa6-8e56-6cf582b518f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:59.132557 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-106e59fc-3bf2-4aa6-8e56-6cf582b518f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:59.134877 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 926/1843] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:54:58 2022] DELETE /identity/v3/projects/13911c3f9fc24c0ab80188bd82a2f357 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:59.139603 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c5465-7d08-4c30-b300-5195f49ae92f None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:59.140097 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c5465-7d08-4c30-b300-5195f49ae92f None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:59.140299 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c5465-7d08-4c30-b300-5195f49ae92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:59.163297 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e59fc-3bf2-4aa6-8e56-6cf582b518f0 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:59.167032 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:59.181751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-106e59fc-3bf2-4aa6-8e56-6cf582b518f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:59.210382 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-650c5465-7d08-4c30-b300-5195f49ae92f None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:59.214930 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-650c5465-7d08-4c30-b300-5195f49ae92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:59.325739 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e59fc-3bf2-4aa6-8e56-6cf582b518f0 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:59.326851 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 918/1844] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:54:59.330987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edabc3b7-1844-48f8-be7c-da254d9d368e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b33f797a9af946a4b296d973388891be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:59.331604 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabc3b7-1844-48f8-be7c-da254d9d368e service placement] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:59.331880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabc3b7-1844-48f8-be7c-da254d9d368e service placement] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:59.332151 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabc3b7-1844-48f8-be7c-da254d9d368e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:59.335118 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511fe8c-1d93-4cb6-b978-79816927a57c None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:59.335395 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-edabc3b7-1844-48f8-be7c-da254d9d368e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:59.335602 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511fe8c-1d93-4cb6-b978-79816927a57c None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:59.335985 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511fe8c-1d93-4cb6-b978-79816927a57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:59.354311 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edabc3b7-1844-48f8-be7c-da254d9d368e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:59.356003 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edabc3b7-1844-48f8-be7c-da254d9d368e service placement] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:59.367532 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 927/1845] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:54:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:54:59.398433 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-f511fe8c-1d93-4cb6-b978-79816927a57c None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:59.400097 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-f511fe8c-1d93-4cb6-b978-79816927a57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:59.413402 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 919/1846] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:54:59.418350 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edabc3b7-1844-48f8-be7c-da254d9d368e service placement] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:59.431029 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edabc3b7-1844-48f8-be7c-da254d9d368e service placement] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:59.436365 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8fb85c-e700-454b-a52f-8f52370234bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:59.436965 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fb85c-e700-454b-a52f-8f52370234bc admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:59.437239 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fb85c-e700-454b-a52f-8f52370234bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:59.437546 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fb85c-e700-454b-a52f-8f52370234bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:59.438198 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8fb85c-e700-454b-a52f-8f52370234bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:54:59.438496 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8fb85c-e700-454b-a52f-8f52370234bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:59.440063 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8fb85c-e700-454b-a52f-8f52370234bc admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:59.456898 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 928/1847] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:54:59.457968 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511fe8c-1d93-4cb6-b978-79816927a57c None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:59.470467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511fe8c-1d93-4cb6-b978-79816927a57c None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:59.471278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8fb85c-e700-454b-a52f-8f52370234bc admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:59.472638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-5a8fb85c-e700-454b-a52f-8f52370234bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:59.475681 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c33b3a-5723-4a1e-af3b-67c2e2f97ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:59.476288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c33b3a-5723-4a1e-af3b-67c2e2f97ba8 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:59.476592 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c33b3a-5723-4a1e-af3b-67c2e2f97ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:59.476823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c33b3a-5723-4a1e-af3b-67c2e2f97ba8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:59.477657 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c33b3a-5723-4a1e-af3b-67c2e2f97ba8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:59.479626 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c33b3a-5723-4a1e-af3b-67c2e2f97ba8 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:59.494712 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8fb85c-e700-454b-a52f-8f52370234bc admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:59.506593 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd318c13-4008-4458-a4cd-f6c68a4b2ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:59.507559 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd318c13-4008-4458-a4cd-f6c68a4b2ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:59.508091 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd318c13-4008-4458-a4cd-f6c68a4b2ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:59.508588 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd318c13-4008-4458-a4cd-f6c68a4b2ef1 admin admin] PATH_INFO: `/v3/projects/e3d54ecd8c3a455c8fb934f89f3ac630` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:59.511086 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd318c13-4008-4458-a4cd-f6c68a4b2ef1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3d54ecd8c3a455c8fb934f89f3ac630)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:59.515670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd318c13-4008-4458-a4cd-f6c68a4b2ef1 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:59.527429 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 920/1848] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:54:59 2022] POST /identity/v3/projects => generated 381 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 10:54:59.540704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c33b3a-5723-4a1e-af3b-67c2e2f97ba8 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:59.594857 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-cd318c13-4008-4458-a4cd-f6c68a4b2ef1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3d54ecd8c3a455c8fb934f89f3ac630', 'request_id': 'req-cd318c13-4008-4458-a4cd-f6c68a4b2ef1'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:59.602711 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-cd318c13-4008-4458-a4cd-f6c68a4b2ef1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3d54ecd8c3a455c8fb934f89f3ac630', 'request_id': 'req-cd318c13-4008-4458-a4cd-f6c68a4b2ef1'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:59.611572 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-cd318c13-4008-4458-a4cd-f6c68a4b2ef1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3d54ecd8c3a455c8fb934f89f3ac630', 'request_id': 'req-cd318c13-4008-4458-a4cd-f6c68a4b2ef1'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:59.621570 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c33b3a-5723-4a1e-af3b-67c2e2f97ba8 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:59.628045 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-cd318c13-4008-4458-a4cd-f6c68a4b2ef1 admin admin] The token cache is being invalidate because project e3d54ecd8c3a455c8fb934f89f3ac630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:54:59.628380 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-cd318c13-4008-4458-a4cd-f6c68a4b2ef1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:59.629416 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-cd318c13-4008-4458-a4cd-f6c68a4b2ef1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:54:59.631385 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 929/1849] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:54:59 2022] DELETE /identity/v3/projects/e3d54ecd8c3a455c8fb934f89f3ac630 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 10:54:59.636662 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdeb6d-ad1e-4c2b-bd7b-ade693cf88c9 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:59.637395 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdeb6d-ad1e-4c2b-bd7b-ade693cf88c9 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:59.637972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdeb6d-ad1e-4c2b-bd7b-ade693cf88c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:59.663240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-dbbdeb6d-ad1e-4c2b-bd7b-ade693cf88c9 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:59.666007 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-dbbdeb6d-ad1e-4c2b-bd7b-ade693cf88c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:59.691212 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd5764-4398-47ba-b16d-2cd286f919ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:59.691467 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:59.692527 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd5764-4398-47ba-b16d-2cd286f919ac admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:59.693462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd5764-4398-47ba-b16d-2cd286f919ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:59.693805 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd5764-4398-47ba-b16d-2cd286f919ac admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:59.694799 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd5764-4398-47ba-b16d-2cd286f919ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:59.696503 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd5764-4398-47ba-b16d-2cd286f919ac admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:59.726546 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 921/1850] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:54:59 2022] POST /identity/v3/users => generated 291 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 10:54:59.728308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd5764-4398-47ba-b16d-2cd286f919ac admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:59.730704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-55bd5764-4398-47ba-b16d-2cd286f919ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:59.742625 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 930/1851] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:54:59.743068 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd5764-4398-47ba-b16d-2cd286f919ac admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:59.747692 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae97ae-9582-4893-93d0-a3d8ff4eaf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:59.748285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae97ae-9582-4893-93d0-a3d8ff4eaf7b admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:59.748786 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae97ae-9582-4893-93d0-a3d8ff4eaf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:59.748891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae97ae-9582-4893-93d0-a3d8ff4eaf7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:59.749546 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae97ae-9582-4893-93d0-a3d8ff4eaf7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:59.750181 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fab5f-cd4c-46ad-9d8b-ff2d810a97c3 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:59.750471 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fab5f-cd4c-46ad-9d8b-ff2d810a97c3 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:59.750747 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fab5f-cd4c-46ad-9d8b-ff2d810a97c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:59.751343 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae97ae-9582-4893-93d0-a3d8ff4eaf7b admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:59.766971 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 922/1852] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:54:59.771089 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae97ae-9582-4893-93d0-a3d8ff4eaf7b admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:59.776570 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-a78fab5f-cd4c-46ad-9d8b-ff2d810a97c3 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:59.777937 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-a78fab5f-cd4c-46ad-9d8b-ff2d810a97c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:59.778111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:54:59.786465 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae97ae-9582-4893-93d0-a3d8ff4eaf7b admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:59.787981 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 931/1853] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:54:59.792223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78fab5f-cd4c-46ad-9d8b-ff2d810a97c3 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:59.793376 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48af63e-4969-471e-9d5a-789119ac2e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:59.794192 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48af63e-4969-471e-9d5a-789119ac2e50 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:59.794522 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48af63e-4969-471e-9d5a-789119ac2e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:59.794898 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48af63e-4969-471e-9d5a-789119ac2e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:59.795842 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48af63e-4969-471e-9d5a-789119ac2e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:59.797722 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48af63e-4969-471e-9d5a-789119ac2e50 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:59.806268 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78fab5f-cd4c-46ad-9d8b-ff2d810a97c3 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:59.812583 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973ed22-3f1f-4163-9e36-cbaf22b7bd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:59.813278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973ed22-3f1f-4163-9e36-cbaf22b7bd41 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:59.813621 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973ed22-3f1f-4163-9e36-cbaf22b7bd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:59.813928 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973ed22-3f1f-4163-9e36-cbaf22b7bd41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:59.817623 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 923/1854] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 10:54:59.817795 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973ed22-3f1f-4163-9e36-cbaf22b7bd41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:54:59.817795 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973ed22-3f1f-4163-9e36-cbaf22b7bd41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:59.817795 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973ed22-3f1f-4163-9e36-cbaf22b7bd41 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:59.819243 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48af63e-4969-471e-9d5a-789119ac2e50 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:59.830812 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48af63e-4969-471e-9d5a-789119ac2e50 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:59.835719 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a065dfc-9a2e-40e0-88a5-422ab2891a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:59.836371 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a065dfc-9a2e-40e0-88a5-422ab2891a09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:59.836648 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a065dfc-9a2e-40e0-88a5-422ab2891a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:59.837138 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 932/1855] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:54:59.837433 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a065dfc-9a2e-40e0-88a5-422ab2891a09 admin admin] PATH_INFO: `/v3/projects/8c282cb4a2374c5b90b70a642f08237d/users/a155559d4a1c45a6abb9609902595e37/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:59.838168 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973ed22-3f1f-4163-9e36-cbaf22b7bd41 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:59.848960 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973ed22-3f1f-4163-9e36-cbaf22b7bd41 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:59.854866 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95a0a6-0ca0-4be8-bcb1-b547d4fcc245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:59.855418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a065dfc-9a2e-40e0-88a5-422ab2891a09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c282cb4a2374c5b90b70a642f08237d, user_id=a155559d4a1c45a6abb9609902595e37, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:59.855603 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95a0a6-0ca0-4be8-bcb1-b547d4fcc245 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:59.856349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95a0a6-0ca0-4be8-bcb1-b547d4fcc245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:59.856349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95a0a6-0ca0-4be8-bcb1-b547d4fcc245 admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:59.857158 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95a0a6-0ca0-4be8-bcb1-b547d4fcc245 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:59.859440 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95a0a6-0ca0-4be8-bcb1-b547d4fcc245 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:59.863350 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a065dfc-9a2e-40e0-88a5-422ab2891a09 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:54:59.889615 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 924/1856] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:54:59 2022] PUT /identity/v3/projects/8c282cb4a2374c5b90b70a642f08237d/users/a155559d4a1c45a6abb9609902595e37/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:54:59.900705 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7985ee8-b3bf-4541-b351-5afaf51ebc02 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:59.901060 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7985ee8-b3bf-4541-b351-5afaf51ebc02 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:59.901422 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7985ee8-b3bf-4541-b351-5afaf51ebc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:59.903513 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 933/1857] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:54:59 2022] POST /identity/v3/projects => generated 391 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:54:59.907906 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95a0a6-0ca0-4be8-bcb1-b547d4fcc245 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:54:59.933348 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-d7985ee8-b3bf-4541-b351-5afaf51ebc02 None None] MFA Rules not processed for user `a155559d4a1c45a6abb9609902595e37`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:54:59.934874 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-d7985ee8-b3bf-4541-b351-5afaf51ebc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:54:59.987951 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95a0a6-0ca0-4be8-bcb1-b547d4fcc245 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:54:59.993473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ae291-7959-42c5-98ea-b076dcd2fd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:54:59.994174 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ae291-7959-42c5-98ea-b076dcd2fd5f admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:54:59.994455 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ae291-7959-42c5-98ea-b076dcd2fd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:54:59.994820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ae291-7959-42c5-98ea-b076dcd2fd5f admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:54:59.995442 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ae291-7959-42c5-98ea-b076dcd2fd5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:54:59.997446 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ae291-7959-42c5-98ea-b076dcd2fd5f admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:00.012224 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 925/1858] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:54:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:00.016246 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7985ee8-b3bf-4541-b351-5afaf51ebc02 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:00.029527 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 934/1859] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:54:59 2022] POST /identity/v3/users => generated 296 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:00.030410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ae291-7959-42c5-98ea-b076dcd2fd5f admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:00.033516 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7985ee8-b3bf-4541-b351-5afaf51ebc02 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:00.038791 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b0e76-865a-4a26-b2b2-5d3f8f1db1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:00.039527 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b0e76-865a-4a26-b2b2-5d3f8f1db1ff admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:00.039807 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b0e76-865a-4a26-b2b2-5d3f8f1db1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:00.040082 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b0e76-865a-4a26-b2b2-5d3f8f1db1ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:00.040706 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b0e76-865a-4a26-b2b2-5d3f8f1db1ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:00.040834 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ae291-7959-42c5-98ea-b076dcd2fd5f admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:00.042614 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b0e76-865a-4a26-b2b2-5d3f8f1db1ff admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:00.045481 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6a0fd-b791-4119-ba24-58e35cb46fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:00.046455 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6a0fd-b791-4119-ba24-58e35cb46fea admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:00.046455 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6a0fd-b791-4119-ba24-58e35cb46fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:00.046654 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6a0fd-b791-4119-ba24-58e35cb46fea admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:00.047248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6a0fd-b791-4119-ba24-58e35cb46fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:00.048795 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6a0fd-b791-4119-ba24-58e35cb46fea admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:00.064545 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 935/1860] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 10:55:00.065641 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6a0fd-b791-4119-ba24-58e35cb46fea admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:00.077411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6a0fd-b791-4119-ba24-58e35cb46fea admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:00.082589 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0ec47-1109-410f-acde-dad1949cb3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:00.083228 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0ec47-1109-410f-acde-dad1949cb3cd admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:00.084065 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0ec47-1109-410f-acde-dad1949cb3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:00.084350 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0ec47-1109-410f-acde-dad1949cb3cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:00.084998 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0ec47-1109-410f-acde-dad1949cb3cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:00.086158 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 926/1861] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:55:00 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 10:55:00.089001 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b0e76-865a-4a26-b2b2-5d3f8f1db1ff admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:00.089553 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0ec47-1109-410f-acde-dad1949cb3cd admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:00.101236 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 936/1862] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:00.105023 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0ec47-1109-410f-acde-dad1949cb3cd admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:00.117519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0ec47-1109-410f-acde-dad1949cb3cd admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:00.173043 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:00.174671 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b0e76-865a-4a26-b2b2-5d3f8f1db1ff admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:00.180337 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8cf16-edb9-4ff9-a3fd-b21b3abf2800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:00.180998 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8cf16-edb9-4ff9-a3fd-b21b3abf2800 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:00.181280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8cf16-edb9-4ff9-a3fd-b21b3abf2800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:00.181577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8cf16-edb9-4ff9-a3fd-b21b3abf2800 admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:00.182362 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8cf16-edb9-4ff9-a3fd-b21b3abf2800 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:00.184595 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8cf16-edb9-4ff9-a3fd-b21b3abf2800 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:00.189815 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94e853-b1ee-4ff5-a72c-0b7771d8a3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:00.190721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94e853-b1ee-4ff5-a72c-0b7771d8a3a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:00.191172 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94e853-b1ee-4ff5-a72c-0b7771d8a3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:00.191650 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94e853-b1ee-4ff5-a72c-0b7771d8a3a3 admin admin] PATH_INFO: `/v3/projects/d29c2f95eebe460c854308f3e28d7040/users/fcc5c73f0ed54068994d0923610565e5/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:00.212494 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef94e853-b1ee-4ff5-a72c-0b7771d8a3a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d29c2f95eebe460c854308f3e28d7040, user_id=fcc5c73f0ed54068994d0923610565e5, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:00.217755 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 927/1863] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:55:00 2022] POST /identity/v3/users => generated 298 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 10:55:00.217898 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef94e853-b1ee-4ff5-a72c-0b7771d8a3a3 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:00.218003 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2094b0a-9b04-42a0-a65b-8e3c5620dd83 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:00.218003 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2094b0a-9b04-42a0-a65b-8e3c5620dd83 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:00.218003 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2094b0a-9b04-42a0-a65b-8e3c5620dd83 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:00.218233 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 928/1864] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 7 10:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:55:00.218958 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2094b0a-9b04-42a0-a65b-8e3c5620dd83 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:00.220721 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a2094b0a-9b04-42a0-a65b-8e3c5620dd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:00.232156 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 937/1865] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:55:00 2022] PUT /identity/v3/projects/d29c2f95eebe460c854308f3e28d7040/users/fcc5c73f0ed54068994d0923610565e5/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:00.233379 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94e853-b1ee-4ff5-a72c-0b7771d8a3a3 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:00.242645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2094b0a-9b04-42a0-a65b-8e3c5620dd83 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:00.297169 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:00.330123 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94e853-b1ee-4ff5-a72c-0b7771d8a3a3 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:00.335131 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c044713-20fe-4a8c-8472-dbbb1e615ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:00.335910 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c044713-20fe-4a8c-8472-dbbb1e615ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:00.336340 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c044713-20fe-4a8c-8472-dbbb1e615ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:00.336778 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c044713-20fe-4a8c-8472-dbbb1e615ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:00.337455 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c044713-20fe-4a8c-8472-dbbb1e615ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:00.339039 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c044713-20fe-4a8c-8472-dbbb1e615ec6 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:00.341005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9197a-a634-4e79-b4cd-89e9ae644394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:00.341680 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9197a-a634-4e79-b4cd-89e9ae644394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:00.341957 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9197a-a634-4e79-b4cd-89e9ae644394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:00.342227 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9197a-a634-4e79-b4cd-89e9ae644394 admin admin] PATH_INFO: `/v3/users/9b8876d3eb9243baab46bd652271b726` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:00.343405 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c9197a-a634-4e79-b4cd-89e9ae644394 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b8876d3eb9243baab46bd652271b726)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:00.345371 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c9197a-a634-4e79-b4cd-89e9ae644394 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:00.352455 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 938/1866] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:00.353858 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed242a-67aa-4638-846a-824f65480d45 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:00.354205 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed242a-67aa-4638-846a-824f65480d45 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:00.354541 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed242a-67aa-4638-846a-824f65480d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:00.375491 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-7bed242a-67aa-4638-846a-824f65480d45 None None] MFA Rules not processed for user `b33f797a9af946a4b296d973388891be`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:00.376822 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-7bed242a-67aa-4638-846a-824f65480d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:00.397468 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-b3c9197a-a634-4e79-b4cd-89e9ae644394 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b8876d3eb9243baab46bd652271b726'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:00.410733 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-b3c9197a-a634-4e79-b4cd-89e9ae644394 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b8876d3eb9243baab46bd652271b726'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:00.411455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-b3c9197a-a634-4e79-b4cd-89e9ae644394 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b8876d3eb9243baab46bd652271b726'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:00.420348 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-b3c9197a-a634-4e79-b4cd-89e9ae644394 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b8876d3eb9243baab46bd652271b726'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:00.428055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-b3c9197a-a634-4e79-b4cd-89e9ae644394 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b8876d3eb9243baab46bd652271b726'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:00.434025 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 929/1867] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:55:00 2022] DELETE /identity/v3/users/9b8876d3eb9243baab46bd652271b726 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:00.435285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd8096-0386-4ac6-9881-947f34e2b459 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:00.435516 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd8096-0386-4ac6-9881-947f34e2b459 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:00.435779 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd8096-0386-4ac6-9881-947f34e2b459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:00.444820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 939/1868] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 7 10:55:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:00.445607 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed242a-67aa-4638-846a-824f65480d45 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:00.446898 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-7bed242a-67aa-4638-846a-824f65480d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:00.460667 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed242a-67aa-4638-846a-824f65480d45 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:00.464706 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-61fd8096-0386-4ac6-9881-947f34e2b459 None None] MFA Rules not processed for user `fcc5c73f0ed54068994d0923610565e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:00.465926 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-61fd8096-0386-4ac6-9881-947f34e2b459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:00.519999 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41c48e-591f-46ec-b371-42bf3811215e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:00.520614 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41c48e-591f-46ec-b371-42bf3811215e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:00.520906 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41c48e-591f-46ec-b371-42bf3811215e admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:00.521176 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41c48e-591f-46ec-b371-42bf3811215e admin admin] PATH_INFO: `/v3/users/27997821407d4feb81fb07f5a8721bad` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:00.522329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41c48e-591f-46ec-b371-42bf3811215e admin admin] RBAC: Authorizing `identity:delete_user(user_id=27997821407d4feb81fb07f5a8721bad)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:00.524201 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41c48e-591f-46ec-b371-42bf3811215e admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:00.529291 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:00.530127 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 930/1869] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:00.530969 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd8096-0386-4ac6-9881-947f34e2b459 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:00.532432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-61fd8096-0386-4ac6-9881-947f34e2b459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:00.558649 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd8096-0386-4ac6-9881-947f34e2b459 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:00.565386 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331150b3-2cf9-4e1f-86f0-070cfcb51e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:00.566353 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331150b3-2cf9-4e1f-86f0-070cfcb51e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:00.566798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331150b3-2cf9-4e1f-86f0-070cfcb51e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:00.567353 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331150b3-2cf9-4e1f-86f0-070cfcb51e1e admin admin] PATH_INFO: `/v3/projects/480236b590e543a3a8bcaa63b821268d/users/fe885abcecf2431ca1c6d00311d1cae3/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:00.579350 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-1d41c48e-591f-46ec-b371-42bf3811215e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27997821407d4feb81fb07f5a8721bad'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:00.591966 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331150b3-2cf9-4e1f-86f0-070cfcb51e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=480236b590e543a3a8bcaa63b821268d, user_id=fe885abcecf2431ca1c6d00311d1cae3, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:00.596172 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331150b3-2cf9-4e1f-86f0-070cfcb51e1e admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:00.596525 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-1d41c48e-591f-46ec-b371-42bf3811215e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27997821407d4feb81fb07f5a8721bad'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:00.597775 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-1d41c48e-591f-46ec-b371-42bf3811215e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27997821407d4feb81fb07f5a8721bad'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:00.610431 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-1d41c48e-591f-46ec-b371-42bf3811215e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27997821407d4feb81fb07f5a8721bad'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:00.613052 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 931/1870] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:55:00 2022] PUT /identity/v3/projects/480236b590e543a3a8bcaa63b821268d/users/fe885abcecf2431ca1c6d00311d1cae3/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:00.614120 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ae73c-f01a-4fd9-9370-dbfc36f30c59 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:00.614398 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ae73c-f01a-4fd9-9370-dbfc36f30c59 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:00.614696 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ae73c-f01a-4fd9-9370-dbfc36f30c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:00.623459 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-1d41c48e-591f-46ec-b371-42bf3811215e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27997821407d4feb81fb07f5a8721bad'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:00.631170 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 940/1871] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:55:00 2022] DELETE /identity/v3/users/27997821407d4feb81fb07f5a8721bad => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:00.631983 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41c48e-591f-46ec-b371-42bf3811215e admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:00.633364 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-1d41c48e-591f-46ec-b371-42bf3811215e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:00.642823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-515ae73c-f01a-4fd9-9370-dbfc36f30c59 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:00.647494 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-515ae73c-f01a-4fd9-9370-dbfc36f30c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:00.652696 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:00.731475 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 932/1872] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:00.732324 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ae73c-f01a-4fd9-9370-dbfc36f30c59 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:00.734346 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-515ae73c-f01a-4fd9-9370-dbfc36f30c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:00.737942 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41c48e-591f-46ec-b371-42bf3811215e admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:00.744594 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49074342-8020-4798-9ca0-421650e6970c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b33f797a9af946a4b296d973388891be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:00.745886 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49074342-8020-4798-9ca0-421650e6970c service placement] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:00.746162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49074342-8020-4798-9ca0-421650e6970c service placement] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:00.746434 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49074342-8020-4798-9ca0-421650e6970c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:00.748840 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-49074342-8020-4798-9ca0-421650e6970c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:00.749539 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ae73c-f01a-4fd9-9370-dbfc36f30c59 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:00.757128 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382cd8d-7cc4-4895-98c8-2a9c1dc3e799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:00.758340 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382cd8d-7cc4-4895-98c8-2a9c1dc3e799 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:00.758681 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382cd8d-7cc4-4895-98c8-2a9c1dc3e799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:00.758963 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382cd8d-7cc4-4895-98c8-2a9c1dc3e799 admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:00.759608 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382cd8d-7cc4-4895-98c8-2a9c1dc3e799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:00.762328 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382cd8d-7cc4-4895-98c8-2a9c1dc3e799 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:00.763142 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49074342-8020-4798-9ca0-421650e6970c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:00.764991 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49074342-8020-4798-9ca0-421650e6970c service placement] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:00.777381 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 941/1873] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:55:00.778425 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49074342-8020-4798-9ca0-421650e6970c service placement] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:00.780151 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-49074342-8020-4798-9ca0-421650e6970c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:00.796966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49074342-8020-4798-9ca0-421650e6970c service placement] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:00.801206 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 933/1874] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:55:00 2022] POST /identity/v3/projects => generated 391 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:00.801206 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382cd8d-7cc4-4895-98c8-2a9c1dc3e799 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:00.805357 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-6382cd8d-7cc4-4895-98c8-2a9c1dc3e799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:00.886840 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382cd8d-7cc4-4895-98c8-2a9c1dc3e799 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:00.890577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad60ab9-023c-474f-b8ae-88efd873587e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:00.891247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad60ab9-023c-474f-b8ae-88efd873587e service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:00.891594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad60ab9-023c-474f-b8ae-88efd873587e service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:00.891934 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad60ab9-023c-474f-b8ae-88efd873587e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:00.899697 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381089b5-65bd-4be2-b1f9-0be15ec492e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:00.900349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381089b5-65bd-4be2-b1f9-0be15ec492e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:00.900661 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381089b5-65bd-4be2-b1f9-0be15ec492e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:00.900894 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381089b5-65bd-4be2-b1f9-0be15ec492e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:00.901583 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381089b5-65bd-4be2-b1f9-0be15ec492e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:00.903305 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381089b5-65bd-4be2-b1f9-0be15ec492e0 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:00.915157 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 942/1875] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:00.915927 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381089b5-65bd-4be2-b1f9-0be15ec492e0 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:00.925664 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381089b5-65bd-4be2-b1f9-0be15ec492e0 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:00.930343 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a8d14-6aff-48fa-8866-6ab15cea63cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:00.930920 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a8d14-6aff-48fa-8866-6ab15cea63cf admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:00.931203 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a8d14-6aff-48fa-8866-6ab15cea63cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:00.931466 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a8d14-6aff-48fa-8866-6ab15cea63cf admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:00.932077 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a8d14-6aff-48fa-8866-6ab15cea63cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:00.933995 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a8d14-6aff-48fa-8866-6ab15cea63cf admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:00.943945 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:00.957278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 943/1876] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:55:00 2022] POST /identity/v3/users => generated 302 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:00.958259 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a8d14-6aff-48fa-8866-6ab15cea63cf admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:00.961078 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-665a8d14-6aff-48fa-8866-6ab15cea63cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:00.962021 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad60ab9-023c-474f-b8ae-88efd873587e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:00.963454 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad60ab9-023c-474f-b8ae-88efd873587e service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:00.974860 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 934/1877] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:55:00.975010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a8d14-6aff-48fa-8866-6ab15cea63cf admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:00.975985 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad60ab9-023c-474f-b8ae-88efd873587e service neutron] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:00.979893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ab89c-416d-498c-a958-ba37d5a741ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:00.980588 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ab89c-416d-498c-a958-ba37d5a741ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:00.980938 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ab89c-416d-498c-a958-ba37d5a741ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:00.981281 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ab89c-416d-498c-a958-ba37d5a741ae admin admin] PATH_INFO: `/v3/projects/33ecbb774d064105b3180117e143efe3` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:00.983074 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ab89c-416d-498c-a958-ba37d5a741ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=33ecbb774d064105b3180117e143efe3)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:00.985040 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ab89c-416d-498c-a958-ba37d5a741ae admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:00.985812 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad60ab9-023c-474f-b8ae-88efd873587e service neutron] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:00.991227 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0eee8-2caa-4d59-ab97-715747bdca6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:00.991879 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0eee8-2caa-4d59-ab97-715747bdca6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:00.992156 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0eee8-2caa-4d59-ab97-715747bdca6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:00.992423 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0eee8-2caa-4d59-ab97-715747bdca6d admin admin] PATH_INFO: `/v3/projects/480236b590e543a3a8bcaa63b821268d/users/fe885abcecf2431ca1c6d00311d1cae3/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:00.995237 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0eee8-2caa-4d59-ab97-715747bdca6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=480236b590e543a3a8bcaa63b821268d, user_id=fe885abcecf2431ca1c6d00311d1cae3, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:00.998070 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0eee8-2caa-4d59-ab97-715747bdca6d admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:01.008939 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 935/1878] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:55:00 2022] PUT /identity/v3/projects/480236b590e543a3a8bcaa63b821268d/users/fe885abcecf2431ca1c6d00311d1cae3/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:01.009795 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0eee8-2caa-4d59-ab97-715747bdca6d admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:01.046884 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-c80ab89c-416d-498c-a958-ba37d5a741ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33ecbb774d064105b3180117e143efe3', 'request_id': 'req-c80ab89c-416d-498c-a958-ba37d5a741ae'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:01.057443 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-c80ab89c-416d-498c-a958-ba37d5a741ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33ecbb774d064105b3180117e143efe3', 'request_id': 'req-c80ab89c-416d-498c-a958-ba37d5a741ae'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:01.066026 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-c80ab89c-416d-498c-a958-ba37d5a741ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33ecbb774d064105b3180117e143efe3', 'request_id': 'req-c80ab89c-416d-498c-a958-ba37d5a741ae'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:01.069247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:01.080294 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-c80ab89c-416d-498c-a958-ba37d5a741ae admin admin] The token cache is being invalidate because project 33ecbb774d064105b3180117e143efe3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:55:01.080587 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-c80ab89c-416d-498c-a958-ba37d5a741ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:01.081272 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-c80ab89c-416d-498c-a958-ba37d5a741ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:01.086509 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 944/1879] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:55:00 2022] DELETE /identity/v3/projects/33ecbb774d064105b3180117e143efe3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:01.086509 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2f5e1-5506-46d6-b893-e35b04791528 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:01.086509 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2f5e1-5506-46d6-b893-e35b04791528 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:01.086509 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2f5e1-5506-46d6-b893-e35b04791528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:01.112002 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-d9a2f5e1-5506-46d6-b893-e35b04791528 None None] MFA Rules not processed for user `fe885abcecf2431ca1c6d00311d1cae3`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:01.112495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0eee8-2caa-4d59-ab97-715747bdca6d admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:01.113205 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-d9a2f5e1-5506-46d6-b893-e35b04791528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:01.178319 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea951e84-4633-4af6-97cc-76e98bc8421a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:01.178987 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea951e84-4633-4af6-97cc-76e98bc8421a admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:01.179266 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea951e84-4633-4af6-97cc-76e98bc8421a admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:01.179543 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea951e84-4633-4af6-97cc-76e98bc8421a admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:01.180254 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea951e84-4633-4af6-97cc-76e98bc8421a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:01.181893 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea951e84-4633-4af6-97cc-76e98bc8421a admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:01.196439 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 936/1880] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:01.196439 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea951e84-4633-4af6-97cc-76e98bc8421a admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:01.196439 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ea951e84-4633-4af6-97cc-76e98bc8421a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:01.209112 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea951e84-4633-4af6-97cc-76e98bc8421a admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:01.215139 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692991b-17d1-426e-a7bd-d03fb25f2198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:01.218915 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 945/1881] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:01 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:01.218915 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2f5e1-5506-46d6-b893-e35b04791528 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:01.218915 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-d9a2f5e1-5506-46d6-b893-e35b04791528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:01.220175 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692991b-17d1-426e-a7bd-d03fb25f2198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:01.221103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692991b-17d1-426e-a7bd-d03fb25f2198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:01.221557 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692991b-17d1-426e-a7bd-d03fb25f2198 admin admin] PATH_INFO: `/v3/users/a737c43d610f45449163ec6b63126d68` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:01.222943 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692991b-17d1-426e-a7bd-d03fb25f2198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a737c43d610f45449163ec6b63126d68)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:01.225777 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692991b-17d1-426e-a7bd-d03fb25f2198 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:01.233673 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2f5e1-5506-46d6-b893-e35b04791528 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:01.238405 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f71e28-24d3-462a-b7a2-d5202faf8b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:01.239065 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f71e28-24d3-462a-b7a2-d5202faf8b78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:01.239334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f71e28-24d3-462a-b7a2-d5202faf8b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:01.239784 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f71e28-24d3-462a-b7a2-d5202faf8b78 admin admin] PATH_INFO: `/v3/projects/ce3b1813fa534c2ea5fd74cb369488b5/users/6263a914f174461cb0372f3932750aa7/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:01.258289 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f71e28-24d3-462a-b7a2-d5202faf8b78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce3b1813fa534c2ea5fd74cb369488b5, user_id=6263a914f174461cb0372f3932750aa7, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:01.261277 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f71e28-24d3-462a-b7a2-d5202faf8b78 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:01.275900 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 946/1882] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:55:01 2022] PUT /identity/v3/projects/ce3b1813fa534c2ea5fd74cb369488b5/users/6263a914f174461cb0372f3932750aa7/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:01.276803 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f71e28-24d3-462a-b7a2-d5202faf8b78 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:01.279856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-97f71e28-24d3-462a-b7a2-d5202faf8b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:01.283293 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-3692991b-17d1-426e-a7bd-d03fb25f2198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a737c43d610f45449163ec6b63126d68'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:01.304191 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-3692991b-17d1-426e-a7bd-d03fb25f2198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a737c43d610f45449163ec6b63126d68'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:01.305653 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-3692991b-17d1-426e-a7bd-d03fb25f2198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a737c43d610f45449163ec6b63126d68'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:01.316326 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-3692991b-17d1-426e-a7bd-d03fb25f2198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a737c43d610f45449163ec6b63126d68'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:01.329496 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-3692991b-17d1-426e-a7bd-d03fb25f2198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a737c43d610f45449163ec6b63126d68'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:01.338682 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 937/1883] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:55:01 2022] DELETE /identity/v3/users/a737c43d610f45449163ec6b63126d68 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:01.339584 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692991b-17d1-426e-a7bd-d03fb25f2198 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:01.342178 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-3692991b-17d1-426e-a7bd-d03fb25f2198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:01.358061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:01.398815 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f71e28-24d3-462a-b7a2-d5202faf8b78 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:01.399546 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:01.429868 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692991b-17d1-426e-a7bd-d03fb25f2198 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:01.435263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad14224-0c48-4560-a2b4-860c67b84e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:01.435885 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad14224-0c48-4560-a2b4-860c67b84e79 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:01.436162 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad14224-0c48-4560-a2b4-860c67b84e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:01.436432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad14224-0c48-4560-a2b4-860c67b84e79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:01.437091 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad14224-0c48-4560-a2b4-860c67b84e79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:01.438765 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad14224-0c48-4560-a2b4-860c67b84e79 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:01.450818 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 938/1884] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:01.451615 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad14224-0c48-4560-a2b4-860c67b84e79 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:01.453395 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-fad14224-0c48-4560-a2b4-860c67b84e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:01.459804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32f0c2-50cd-415c-ad57-5d2275e53364 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:01.460418 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32f0c2-50cd-415c-ad57-5d2275e53364 service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:01.460698 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32f0c2-50cd-415c-ad57-5d2275e53364 service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:01.460971 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32f0c2-50cd-415c-ad57-5d2275e53364 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:01.462780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-8a32f0c2-50cd-415c-ad57-5d2275e53364 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:01.466399 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad14224-0c48-4560-a2b4-860c67b84e79 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:01.471855 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f3b16-580c-4831-a750-e24f438f9ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:01.472626 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f3b16-580c-4831-a750-e24f438f9ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:01.473010 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f3b16-580c-4831-a750-e24f438f9ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:01.473427 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f3b16-580c-4831-a750-e24f438f9ed0 admin admin] PATH_INFO: `/v3/projects/84abdba45e474aa7981fbae91aae7bd2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:01.475355 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f3b16-580c-4831-a750-e24f438f9ed0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84abdba45e474aa7981fbae91aae7bd2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:01.477414 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f3b16-580c-4831-a750-e24f438f9ed0 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:01.530778 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-321f3b16-580c-4831-a750-e24f438f9ed0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84abdba45e474aa7981fbae91aae7bd2', 'request_id': 'req-321f3b16-580c-4831-a750-e24f438f9ed0'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:01.536032 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32f0c2-50cd-415c-ad57-5d2275e53364 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:01.538153 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-321f3b16-580c-4831-a750-e24f438f9ed0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84abdba45e474aa7981fbae91aae7bd2', 'request_id': 'req-321f3b16-580c-4831-a750-e24f438f9ed0'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:01.538344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32f0c2-50cd-415c-ad57-5d2275e53364 service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:01.548085 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-321f3b16-580c-4831-a750-e24f438f9ed0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84abdba45e474aa7981fbae91aae7bd2', 'request_id': 'req-321f3b16-580c-4831-a750-e24f438f9ed0'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:01.550008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 947/1885] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:01 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:55:01.550951 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32f0c2-50cd-415c-ad57-5d2275e53364 service cinder] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:01.563661 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32f0c2-50cd-415c-ad57-5d2275e53364 service cinder] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:01.592651 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-321f3b16-580c-4831-a750-e24f438f9ed0 admin admin] The token cache is being invalidate because project 84abdba45e474aa7981fbae91aae7bd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:55:01.593202 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-321f3b16-580c-4831-a750-e24f438f9ed0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:01.594093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-321f3b16-580c-4831-a750-e24f438f9ed0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:01.601537 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 939/1886] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:55:01 2022] DELETE /identity/v3/projects/84abdba45e474aa7981fbae91aae7bd2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:01.603908 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f3b16-580c-4831-a750-e24f438f9ed0 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:01.607309 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-321f3b16-580c-4831-a750-e24f438f9ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:01.671484 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89e49f-6d00-4603-ad12-9c495c371199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:01.672157 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89e49f-6d00-4603-ad12-9c495c371199 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:01.672435 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89e49f-6d00-4603-ad12-9c495c371199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:01.672704 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89e49f-6d00-4603-ad12-9c495c371199 admin admin] PATH_INFO: `/v3/projects/ce3b1813fa534c2ea5fd74cb369488b5/users/6263a914f174461cb0372f3932750aa7/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:01.676990 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89e49f-6d00-4603-ad12-9c495c371199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce3b1813fa534c2ea5fd74cb369488b5, user_id=6263a914f174461cb0372f3932750aa7, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:01.684269 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89e49f-6d00-4603-ad12-9c495c371199 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:01.717017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 948/1887] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:55:01 2022] PUT /identity/v3/projects/ce3b1813fa534c2ea5fd74cb369488b5/users/6263a914f174461cb0372f3932750aa7/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:01.718689 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8594f-3e61-43a7-bec6-ba3e247eee3e None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:01.718966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8594f-3e61-43a7-bec6-ba3e247eee3e None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:01.719236 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8594f-3e61-43a7-bec6-ba3e247eee3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:01.743680 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f3b16-580c-4831-a750-e24f438f9ed0 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:01.753909 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-01d8594f-3e61-43a7-bec6-ba3e247eee3e None None] MFA Rules not processed for user `6263a914f174461cb0372f3932750aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:01.755700 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-01d8594f-3e61-43a7-bec6-ba3e247eee3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:01.789121 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:01.806620 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b799d73-7c4b-4bc5-b6f5-b64a38d61903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:01.807249 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b799d73-7c4b-4bc5-b6f5-b64a38d61903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:01.807525 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b799d73-7c4b-4bc5-b6f5-b64a38d61903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:01.807789 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b799d73-7c4b-4bc5-b6f5-b64a38d61903 admin admin] PATH_INFO: `/v3/users/2868b33b980e430eb8a0517cac7dad9b` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:01.808920 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b799d73-7c4b-4bc5-b6f5-b64a38d61903 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2868b33b980e430eb8a0517cac7dad9b)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:01.810850 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b799d73-7c4b-4bc5-b6f5-b64a38d61903 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:01.816754 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:01.857488 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 949/1888] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:01 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:55:01.858638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8594f-3e61-43a7-bec6-ba3e247eee3e None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:01.860214 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-01d8594f-3e61-43a7-bec6-ba3e247eee3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:01.873777 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-9b799d73-7c4b-4bc5-b6f5-b64a38d61903 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2868b33b980e430eb8a0517cac7dad9b'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:01.888532 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-9b799d73-7c4b-4bc5-b6f5-b64a38d61903 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2868b33b980e430eb8a0517cac7dad9b'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:01.889339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-9b799d73-7c4b-4bc5-b6f5-b64a38d61903 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2868b33b980e430eb8a0517cac7dad9b'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:01.899023 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-9b799d73-7c4b-4bc5-b6f5-b64a38d61903 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2868b33b980e430eb8a0517cac7dad9b'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:01.910577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-9b799d73-7c4b-4bc5-b6f5-b64a38d61903 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2868b33b980e430eb8a0517cac7dad9b'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:01.922549 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 940/1889] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:55:01 2022] DELETE /identity/v3/users/2868b33b980e430eb8a0517cac7dad9b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:01.923919 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b799d73-7c4b-4bc5-b6f5-b64a38d61903 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:01.925536 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-9b799d73-7c4b-4bc5-b6f5-b64a38d61903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:01.934204 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8594f-3e61-43a7-bec6-ba3e247eee3e None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:02.024310 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b799d73-7c4b-4bc5-b6f5-b64a38d61903 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:02.031772 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7af825-6569-4667-aac5-24e98895a601 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:02.032435 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7af825-6569-4667-aac5-24e98895a601 service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:02.032715 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7af825-6569-4667-aac5-24e98895a601 service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:02.032987 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7af825-6569-4667-aac5-24e98895a601 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:02.039200 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-bf7af825-6569-4667-aac5-24e98895a601 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:02.060202 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5cc2a-b972-4f02-b01a-857c7acd4940 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:02.060783 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5cc2a-b972-4f02-b01a-857c7acd4940 service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:02.061059 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5cc2a-b972-4f02-b01a-857c7acd4940 service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:02.061357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5cc2a-b972-4f02-b01a-857c7acd4940 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:02.063296 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-56c5cc2a-b972-4f02-b01a-857c7acd4940 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:02.150111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7af825-6569-4667-aac5-24e98895a601 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:02.151776 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7af825-6569-4667-aac5-24e98895a601 service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:02.152424 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5cc2a-b972-4f02-b01a-857c7acd4940 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:02.154508 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5cc2a-b972-4f02-b01a-857c7acd4940 service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:02.166255 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 941/1890] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:01 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:55:02.177147 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 950/1891] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:55:02.205164 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7af825-6569-4667-aac5-24e98895a601 service cinder] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:02.206877 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-bf7af825-6569-4667-aac5-24e98895a601 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:02.270614 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5cc2a-b972-4f02-b01a-857c7acd4940 service cinder] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:02.282977 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5cc2a-b972-4f02-b01a-857c7acd4940 service cinder] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:02.294379 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39ebbb-1344-41b1-bdb1-d51986999def service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:02.296127 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39ebbb-1344-41b1-bdb1-d51986999def service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:02.296522 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39ebbb-1344-41b1-bdb1-d51986999def service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:02.297487 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39ebbb-1344-41b1-bdb1-d51986999def service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:02.299669 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-4e39ebbb-1344-41b1-bdb1-d51986999def service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:02.314450 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:02.382963 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:02.393533 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7af825-6569-4667-aac5-24e98895a601 service cinder] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:02.405031 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf095ad1-cd56-44c8-9d3b-ba1146915347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:02.405725 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf095ad1-cd56-44c8-9d3b-ba1146915347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:02.406024 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf095ad1-cd56-44c8-9d3b-ba1146915347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:02.406304 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf095ad1-cd56-44c8-9d3b-ba1146915347 admin admin] PATH_INFO: `/v3/projects/c46bdb13edae44319db0d0c58082193e` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:02.407502 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf095ad1-cd56-44c8-9d3b-ba1146915347 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c46bdb13edae44319db0d0c58082193e)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:02.409635 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf095ad1-cd56-44c8-9d3b-ba1146915347 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:02.432189 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39ebbb-1344-41b1-bdb1-d51986999def service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:02.434044 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e39ebbb-1344-41b1-bdb1-d51986999def service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:02.446735 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 951/1892] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:02 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 10:55:02.448051 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39ebbb-1344-41b1-bdb1-d51986999def service cinder] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:02.450220 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-4e39ebbb-1344-41b1-bdb1-d51986999def service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:02.468070 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39ebbb-1344-41b1-bdb1-d51986999def service cinder] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:02.472766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-cf095ad1-cd56-44c8-9d3b-ba1146915347 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c46bdb13edae44319db0d0c58082193e', 'request_id': 'req-cf095ad1-cd56-44c8-9d3b-ba1146915347'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:02.480290 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-cf095ad1-cd56-44c8-9d3b-ba1146915347 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c46bdb13edae44319db0d0c58082193e', 'request_id': 'req-cf095ad1-cd56-44c8-9d3b-ba1146915347'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:02.488588 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-cf095ad1-cd56-44c8-9d3b-ba1146915347 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c46bdb13edae44319db0d0c58082193e', 'request_id': 'req-cf095ad1-cd56-44c8-9d3b-ba1146915347'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:02.506455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-cf095ad1-cd56-44c8-9d3b-ba1146915347 admin admin] The token cache is being invalidate because project c46bdb13edae44319db0d0c58082193e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:55:02.507046 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-cf095ad1-cd56-44c8-9d3b-ba1146915347 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:02.507732 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-cf095ad1-cd56-44c8-9d3b-ba1146915347 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:02.509257 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 942/1893] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:55:02 2022] DELETE /identity/v3/projects/c46bdb13edae44319db0d0c58082193e => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:02.514595 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97b82f-fbd6-4710-ad7c-d8866da825f8 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:02.517760 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97b82f-fbd6-4710-ad7c-d8866da825f8 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:02.518053 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97b82f-fbd6-4710-ad7c-d8866da825f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:02.542126 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec7023-90cc-4b21-895e-2e9ea65d14d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:02.543140 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec7023-90cc-4b21-895e-2e9ea65d14d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:02.543584 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec7023-90cc-4b21-895e-2e9ea65d14d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:02.543869 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec7023-90cc-4b21-895e-2e9ea65d14d1 admin admin] PATH_INFO: `/v3/projects/9760e238c7d645cc9aa5169fade9b77b` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:02.545156 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec7023-90cc-4b21-895e-2e9ea65d14d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9760e238c7d645cc9aa5169fade9b77b)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:02.547583 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec7023-90cc-4b21-895e-2e9ea65d14d1 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:02.549036 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-de97b82f-fbd6-4710-ad7c-d8866da825f8 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:02.550335 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-de97b82f-fbd6-4710-ad7c-d8866da825f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:02.568113 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 943/1894] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:55:02.569700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f30a8f-4226-42e6-8f42-c97cfa5a5388 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:02.570113 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f30a8f-4226-42e6-8f42-c97cfa5a5388 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:02.570295 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f30a8f-4226-42e6-8f42-c97cfa5a5388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:02.601177 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-f3f30a8f-4226-42e6-8f42-c97cfa5a5388 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:02.602658 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-f3f30a8f-4226-42e6-8f42-c97cfa5a5388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:02.620733 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-e3ec7023-90cc-4b21-895e-2e9ea65d14d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9760e238c7d645cc9aa5169fade9b77b', 'request_id': 'req-e3ec7023-90cc-4b21-895e-2e9ea65d14d1'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:02.627741 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-e3ec7023-90cc-4b21-895e-2e9ea65d14d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9760e238c7d645cc9aa5169fade9b77b', 'request_id': 'req-e3ec7023-90cc-4b21-895e-2e9ea65d14d1'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:02.636609 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-e3ec7023-90cc-4b21-895e-2e9ea65d14d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9760e238c7d645cc9aa5169fade9b77b', 'request_id': 'req-e3ec7023-90cc-4b21-895e-2e9ea65d14d1'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:02.652015 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-e3ec7023-90cc-4b21-895e-2e9ea65d14d1 admin admin] The token cache is being invalidate because project 9760e238c7d645cc9aa5169fade9b77b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:55:02.652409 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-e3ec7023-90cc-4b21-895e-2e9ea65d14d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:02.658638 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-e3ec7023-90cc-4b21-895e-2e9ea65d14d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:02.666984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 952/1895] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:55:02 2022] DELETE /identity/v3/projects/9760e238c7d645cc9aa5169fade9b77b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:02.669999 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b79817-7706-4417-95aa-5ae159e9741a None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:02.670743 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b79817-7706-4417-95aa-5ae159e9741a None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:02.672382 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b79817-7706-4417-95aa-5ae159e9741a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:02.705801 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 944/1896] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:02.706210 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f30a8f-4226-42e6-8f42-c97cfa5a5388 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:02.721695 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-44b79817-7706-4417-95aa-5ae159e9741a None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:02.724436 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f30a8f-4226-42e6-8f42-c97cfa5a5388 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:02.725641 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-44b79817-7706-4417-95aa-5ae159e9741a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:02.733377 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca3f75-a5c6-4b89-92c5-c31db033a539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:02.733979 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca3f75-a5c6-4b89-92c5-c31db033a539 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:02.734253 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca3f75-a5c6-4b89-92c5-c31db033a539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:02.734524 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca3f75-a5c6-4b89-92c5-c31db033a539 admin admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:02.735236 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca3f75-a5c6-4b89-92c5-c31db033a539 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:55:02.735467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca3f75-a5c6-4b89-92c5-c31db033a539 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:02.737834 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca3f75-a5c6-4b89-92c5-c31db033a539 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:02.744631 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 953/1897] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:02.755003 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e94c0-e2f8-498d-a30f-2b4cc21fe03f None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:02.755866 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e94c0-e2f8-498d-a30f-2b4cc21fe03f None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:02.756146 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e94c0-e2f8-498d-a30f-2b4cc21fe03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:02.774758 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 945/1898] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:55:02.775910 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca3f75-a5c6-4b89-92c5-c31db033a539 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:02.784321 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-f62e94c0-e2f8-498d-a30f-2b4cc21fe03f None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:02.786231 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-f62e94c0-e2f8-498d-a30f-2b4cc21fe03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:02.788390 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca3f75-a5c6-4b89-92c5-c31db033a539 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:02.793592 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4010aa-233a-4a9f-b5dd-42b0df29b6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:02.794357 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4010aa-233a-4a9f-b5dd-42b0df29b6da admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:02.794721 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4010aa-233a-4a9f-b5dd-42b0df29b6da admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:02.795177 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4010aa-233a-4a9f-b5dd-42b0df29b6da admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:02.796034 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4010aa-233a-4a9f-b5dd-42b0df29b6da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:02.800052 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4010aa-233a-4a9f-b5dd-42b0df29b6da admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:02.800634 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 954/1899] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:02.801715 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e94c0-e2f8-498d-a30f-2b4cc21fe03f None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:02.812973 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e94c0-e2f8-498d-a30f-2b4cc21fe03f None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:02.819403 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0b118-f2c7-46cd-b304-8305bc5601a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:02.820651 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0b118-f2c7-46cd-b304-8305bc5601a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:02.820651 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0b118-f2c7-46cd-b304-8305bc5601a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:02.820651 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0b118-f2c7-46cd-b304-8305bc5601a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:02.821897 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0b118-f2c7-46cd-b304-8305bc5601a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:55:02.822251 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0b118-f2c7-46cd-b304-8305bc5601a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:02.823701 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf0b118-f2c7-46cd-b304-8305bc5601a8 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:02.837928 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 946/1900] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:55:02 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:02.838908 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 955/1901] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:55:02.843473 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4010aa-233a-4a9f-b5dd-42b0df29b6da admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:02.844462 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0b118-f2c7-46cd-b304-8305bc5601a8 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:02.865726 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0b118-f2c7-46cd-b304-8305bc5601a8 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:02.909408 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:02.919730 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:02.951680 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d21158-e91e-4586-babd-b37bff9f1e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:02.952304 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d21158-e91e-4586-babd-b37bff9f1e1b admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:02.952581 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d21158-e91e-4586-babd-b37bff9f1e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:02.952850 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d21158-e91e-4586-babd-b37bff9f1e1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:02.953702 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d21158-e91e-4586-babd-b37bff9f1e1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:02.955636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d21158-e91e-4586-babd-b37bff9f1e1b admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:02.989411 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4010aa-233a-4a9f-b5dd-42b0df29b6da admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:02.994993 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff55df-7c55-4eea-90e8-9bd66aef0fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:02.995931 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff55df-7c55-4eea-90e8-9bd66aef0fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:02.996313 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff55df-7c55-4eea-90e8-9bd66aef0fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:02.997969 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff55df-7c55-4eea-90e8-9bd66aef0fa7 admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:02.997969 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff55df-7c55-4eea-90e8-9bd66aef0fa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:02.999019 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 956/1902] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:55:02 2022] POST /identity/v3/projects => generated 381 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:02.999325 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d21158-e91e-4586-babd-b37bff9f1e1b admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:03.001274 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff55df-7c55-4eea-90e8-9bd66aef0fa7 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:03.029307 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 947/1903] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:55:02 2022] POST /identity/v3/users => generated 290 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:03.033109 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff55df-7c55-4eea-90e8-9bd66aef0fa7 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:03.046323 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff55df-7c55-4eea-90e8-9bd66aef0fa7 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:03.071038 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d21158-e91e-4586-babd-b37bff9f1e1b admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:03.076570 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54604705-186c-44fc-a6b4-aa7e3246e646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:03.077781 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54604705-186c-44fc-a6b4-aa7e3246e646 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:03.077781 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54604705-186c-44fc-a6b4-aa7e3246e646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:03.077781 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54604705-186c-44fc-a6b4-aa7e3246e646 admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:03.078339 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54604705-186c-44fc-a6b4-aa7e3246e646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:03.080531 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54604705-186c-44fc-a6b4-aa7e3246e646 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:03.111345 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 957/1904] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:55:02 2022] POST /identity/v3/users => generated 291 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:03.112534 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54604705-186c-44fc-a6b4-aa7e3246e646 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:03.124837 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54604705-186c-44fc-a6b4-aa7e3246e646 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:03.132046 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b02f3-e78c-487a-89d0-0e63983d3875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:03.132795 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b02f3-e78c-487a-89d0-0e63983d3875 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:03.132906 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364fd6ce-86d9-4405-bdf6-80a309897a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:03.133198 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b02f3-e78c-487a-89d0-0e63983d3875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:03.133578 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b02f3-e78c-487a-89d0-0e63983d3875 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:03.134146 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fd6ce-86d9-4405-bdf6-80a309897a62 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:03.134334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b02f3-e78c-487a-89d0-0e63983d3875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:03.134871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fd6ce-86d9-4405-bdf6-80a309897a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:03.135342 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364fd6ce-86d9-4405-bdf6-80a309897a62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:03.136173 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364fd6ce-86d9-4405-bdf6-80a309897a62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:03.136628 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b02f3-e78c-487a-89d0-0e63983d3875 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:03.138240 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364fd6ce-86d9-4405-bdf6-80a309897a62 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:03.152453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 958/1905] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:03.153378 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b02f3-e78c-487a-89d0-0e63983d3875 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:03.156063 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 948/1906] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 10:55:03.159873 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364fd6ce-86d9-4405-bdf6-80a309897a62 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:03.164168 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b02f3-e78c-487a-89d0-0e63983d3875 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:03.169270 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef5171-f40c-4bd7-821b-5dad81521368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:03.169895 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef5171-f40c-4bd7-821b-5dad81521368 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:03.170217 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef5171-f40c-4bd7-821b-5dad81521368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:03.170426 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef5171-f40c-4bd7-821b-5dad81521368 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:03.171065 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edef5171-f40c-4bd7-821b-5dad81521368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:03.172665 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edef5171-f40c-4bd7-821b-5dad81521368 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:03.173750 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364fd6ce-86d9-4405-bdf6-80a309897a62 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:03.182487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992e75a-d190-47da-b0f5-b6da733eda6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:03.183120 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992e75a-d190-47da-b0f5-b6da733eda6b admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:03.183566 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992e75a-d190-47da-b0f5-b6da733eda6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:03.183995 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992e75a-d190-47da-b0f5-b6da733eda6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:03.185394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b992e75a-d190-47da-b0f5-b6da733eda6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:03.187060 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 959/1907] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:03.187171 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b992e75a-d190-47da-b0f5-b6da733eda6b admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:03.190891 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef5171-f40c-4bd7-821b-5dad81521368 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:03.201173 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef5171-f40c-4bd7-821b-5dad81521368 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:03.204001 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 949/1908] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:03.204749 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992e75a-d190-47da-b0f5-b6da733eda6b admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:03.206967 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96910d27-a46f-4396-acda-49efa08b29fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:03.207938 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96910d27-a46f-4396-acda-49efa08b29fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:03.207938 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96910d27-a46f-4396-acda-49efa08b29fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:03.208209 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96910d27-a46f-4396-acda-49efa08b29fa admin admin] PATH_INFO: `/v3/projects/35e2e8612492410586f903f2c5993b44/users/bd802c5adf0c47afbf50e65e246329fd/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:03.216794 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992e75a-d190-47da-b0f5-b6da733eda6b admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:03.222118 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c25e57-0d43-44c1-a1f8-7a9048a2f220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:03.222957 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c25e57-0d43-44c1-a1f8-7a9048a2f220 admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:03.223241 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c25e57-0d43-44c1-a1f8-7a9048a2f220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:03.223612 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c25e57-0d43-44c1-a1f8-7a9048a2f220 admin admin] PATH_INFO: `/v3/projects/f2acfbf97fdc4f24a36b78305e1eee54/users/311231dc752e454c98d59dc1a7d9b708/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:03.224871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96910d27-a46f-4396-acda-49efa08b29fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=35e2e8612492410586f903f2c5993b44, user_id=bd802c5adf0c47afbf50e65e246329fd, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:03.227810 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96910d27-a46f-4396-acda-49efa08b29fa admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:03.242205 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c25e57-0d43-44c1-a1f8-7a9048a2f220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2acfbf97fdc4f24a36b78305e1eee54, user_id=311231dc752e454c98d59dc1a7d9b708, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:03.245096 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c25e57-0d43-44c1-a1f8-7a9048a2f220 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:03.245658 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 960/1909] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:55:03 2022] PUT /identity/v3/projects/35e2e8612492410586f903f2c5993b44/users/bd802c5adf0c47afbf50e65e246329fd/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 10:55:03.259067 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7190604-092b-4e46-9cb9-efa3dab8ae43 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:03.259353 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7190604-092b-4e46-9cb9-efa3dab8ae43 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:03.259659 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7190604-092b-4e46-9cb9-efa3dab8ae43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:03.272387 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 950/1910] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:55:03 2022] PUT /identity/v3/projects/f2acfbf97fdc4f24a36b78305e1eee54/users/311231dc752e454c98d59dc1a7d9b708/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:03.286959 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f695a90-1384-44ae-ae60-09b0206fa4e1 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:03.287320 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f695a90-1384-44ae-ae60-09b0206fa4e1 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:03.287664 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f695a90-1384-44ae-ae60-09b0206fa4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:03.298837 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-f7190604-092b-4e46-9cb9-efa3dab8ae43 None None] MFA Rules not processed for user `bd802c5adf0c47afbf50e65e246329fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:03.300358 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-f7190604-092b-4e46-9cb9-efa3dab8ae43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:03.326336 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-3f695a90-1384-44ae-ae60-09b0206fa4e1 None None] MFA Rules not processed for user `311231dc752e454c98d59dc1a7d9b708`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:03.328391 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-3f695a90-1384-44ae-ae60-09b0206fa4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:03.375449 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:03.390594 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 961/1911] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:03.395694 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7190604-092b-4e46-9cb9-efa3dab8ae43 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:03.417546 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 951/1912] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:03.421916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f695a90-1384-44ae-ae60-09b0206fa4e1 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:03.428518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:03.485078 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7190604-092b-4e46-9cb9-efa3dab8ae43 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:03.491073 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a78382-e646-49ec-aa5b-2f7e5676c732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:03.491706 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a78382-e646-49ec-aa5b-2f7e5676c732 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:03.491981 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a78382-e646-49ec-aa5b-2f7e5676c732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:03.492252 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a78382-e646-49ec-aa5b-2f7e5676c732 admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:03.492908 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a78382-e646-49ec-aa5b-2f7e5676c732 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:03.495058 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a78382-e646-49ec-aa5b-2f7e5676c732 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:03.524853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f695a90-1384-44ae-ae60-09b0206fa4e1 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:03.529749 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98181a90-94f5-43cb-a90f-e7f4b71fc076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:03.530491 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98181a90-94f5-43cb-a90f-e7f4b71fc076 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:03.530935 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 962/1913] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:55:03 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 10:55:03.531078 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98181a90-94f5-43cb-a90f-e7f4b71fc076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:03.531078 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98181a90-94f5-43cb-a90f-e7f4b71fc076 admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:03.531941 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98181a90-94f5-43cb-a90f-e7f4b71fc076 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:03.534866 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a78382-e646-49ec-aa5b-2f7e5676c732 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:03.535004 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98181a90-94f5-43cb-a90f-e7f4b71fc076 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:03.575259 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 952/1914] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:55:03 2022] POST /identity/v3/projects => generated 379 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 10:55:03.576302 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98181a90-94f5-43cb-a90f-e7f4b71fc076 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:03.624582 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a78382-e646-49ec-aa5b-2f7e5676c732 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:03.688834 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98181a90-94f5-43cb-a90f-e7f4b71fc076 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:03.693915 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1e761-c6d2-4eb6-a6a0-5a6fe068b56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:03.694862 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1e761-c6d2-4eb6-a6a0-5a6fe068b56a admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:03.695148 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1e761-c6d2-4eb6-a6a0-5a6fe068b56a admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:03.695421 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1e761-c6d2-4eb6-a6a0-5a6fe068b56a admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:03.696195 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1e761-c6d2-4eb6-a6a0-5a6fe068b56a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:03.698551 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1e761-c6d2-4eb6-a6a0-5a6fe068b56a admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:03.722449 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8aeaa-f6c3-4e2e-905c-de603505c9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:03.723382 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8aeaa-f6c3-4e2e-905c-de603505c9e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:03.723712 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8aeaa-f6c3-4e2e-905c-de603505c9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:03.724631 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8aeaa-f6c3-4e2e-905c-de603505c9e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:03.725472 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8aeaa-f6c3-4e2e-905c-de603505c9e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:03.727530 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8aeaa-f6c3-4e2e-905c-de603505c9e9 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:03.729154 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 953/1915] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:55:03 2022] POST /identity/v3/users => generated 296 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:03.736532 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1e761-c6d2-4eb6-a6a0-5a6fe068b56a admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:03.761017 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1e761-c6d2-4eb6-a6a0-5a6fe068b56a admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:03.775798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5f174-63a7-4f74-aebe-287fd942e279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:03.776128 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 963/1916] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:55:03 2022] POST /identity/v3/users => generated 296 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 10:55:03.776477 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5f174-63a7-4f74-aebe-287fd942e279 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:03.776992 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5f174-63a7-4f74-aebe-287fd942e279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:03.777260 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8aeaa-f6c3-4e2e-905c-de603505c9e9 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:03.777485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5f174-63a7-4f74-aebe-287fd942e279 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:03.778090 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5f174-63a7-4f74-aebe-287fd942e279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:03.779797 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5f174-63a7-4f74-aebe-287fd942e279 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:03.799280 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8aeaa-f6c3-4e2e-905c-de603505c9e9 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:03.813517 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 954/1917] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:03.814447 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5f174-63a7-4f74-aebe-287fd942e279 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:03.818279 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eae87a-1596-432c-a8ea-3f1262e24d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:03.818901 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eae87a-1596-432c-a8ea-3f1262e24d55 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:03.819195 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eae87a-1596-432c-a8ea-3f1262e24d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:03.819453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eae87a-1596-432c-a8ea-3f1262e24d55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:03.820106 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eae87a-1596-432c-a8ea-3f1262e24d55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:03.823289 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eae87a-1596-432c-a8ea-3f1262e24d55 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:03.830043 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5f174-63a7-4f74-aebe-287fd942e279 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:03.841537 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e289a-ba5a-4177-8e77-2ee43adab07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:03.842335 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e289a-ba5a-4177-8e77-2ee43adab07b admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:03.842826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e289a-ba5a-4177-8e77-2ee43adab07b admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:03.843227 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e289a-ba5a-4177-8e77-2ee43adab07b admin admin] PATH_INFO: `/v3/projects/3e1c2ad3b44949e5922e5132f82dad79/users/7f69f80eb0544487bb4492dd6a4b3c31/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:03.852463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 964/1918] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:03.853483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eae87a-1596-432c-a8ea-3f1262e24d55 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:03.861678 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:03.863583 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e289a-ba5a-4177-8e77-2ee43adab07b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e1c2ad3b44949e5922e5132f82dad79, user_id=7f69f80eb0544487bb4492dd6a4b3c31, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:03.866818 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eae87a-1596-432c-a8ea-3f1262e24d55 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:03.867213 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e289a-ba5a-4177-8e77-2ee43adab07b admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:03.875647 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e30d1-126e-4afd-8b6f-f57647c476a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:03.876601 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e30d1-126e-4afd-8b6f-f57647c476a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:03.877699 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e30d1-126e-4afd-8b6f-f57647c476a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:03.878878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e30d1-126e-4afd-8b6f-f57647c476a4 admin admin] PATH_INFO: `/v3/projects/74eff46c3698443aa91e2c07b5be9f13/users/0324eecc35fb4bf290a01c7f41830e09/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:03.888305 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 955/1919] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:55:03 2022] PUT /identity/v3/projects/3e1c2ad3b44949e5922e5132f82dad79/users/7f69f80eb0544487bb4492dd6a4b3c31/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:03.892100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e289a-ba5a-4177-8e77-2ee43adab07b admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:03.898767 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e30d1-126e-4afd-8b6f-f57647c476a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74eff46c3698443aa91e2c07b5be9f13, user_id=0324eecc35fb4bf290a01c7f41830e09, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:03.902045 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e30d1-126e-4afd-8b6f-f57647c476a4 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:03.926266 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 965/1920] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:55:03 2022] PUT /identity/v3/projects/74eff46c3698443aa91e2c07b5be9f13/users/0324eecc35fb4bf290a01c7f41830e09/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:03.931077 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e30d1-126e-4afd-8b6f-f57647c476a4 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:03.945014 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:03.971161 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e289a-ba5a-4177-8e77-2ee43adab07b admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:04.041790 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e30d1-126e-4afd-8b6f-f57647c476a4 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:04.054206 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869bfcc6-77bd-4998-8b00-a1a0fc7ad107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:04.054823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bfcc6-77bd-4998-8b00-a1a0fc7ad107 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:04.055100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bfcc6-77bd-4998-8b00-a1a0fc7ad107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:04.055416 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bfcc6-77bd-4998-8b00-a1a0fc7ad107 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:04.056416 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869bfcc6-77bd-4998-8b00-a1a0fc7ad107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:04.059460 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869bfcc6-77bd-4998-8b00-a1a0fc7ad107 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:04.071906 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbbfbb1-90ce-4f39-b35e-0d93d6fe93c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:04.072448 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbfbb1-90ce-4f39-b35e-0d93d6fe93c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:04.072729 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbfbb1-90ce-4f39-b35e-0d93d6fe93c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:04.073502 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbfbb1-90ce-4f39-b35e-0d93d6fe93c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:04.074190 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbbfbb1-90ce-4f39-b35e-0d93d6fe93c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:04.074653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 966/1921] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:04.076402 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbbfbb1-90ce-4f39-b35e-0d93d6fe93c5 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:04.078894 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869bfcc6-77bd-4998-8b00-a1a0fc7ad107 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:04.094462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 956/1922] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:04.098529 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbbfbb1-90ce-4f39-b35e-0d93d6fe93c5 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:04.101774 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869bfcc6-77bd-4998-8b00-a1a0fc7ad107 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:04.108281 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401cd7a-fc67-4499-b8e5-2dc164e93d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:04.108753 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401cd7a-fc67-4499-b8e5-2dc164e93d52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:04.108990 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401cd7a-fc67-4499-b8e5-2dc164e93d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:04.109261 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401cd7a-fc67-4499-b8e5-2dc164e93d52 admin admin] PATH_INFO: `/v3/projects/74eff46c3698443aa91e2c07b5be9f13/users/0324eecc35fb4bf290a01c7f41830e09/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:04.109425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbbfbb1-90ce-4f39-b35e-0d93d6fe93c5 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:04.111492 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401cd7a-fc67-4499-b8e5-2dc164e93d52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74eff46c3698443aa91e2c07b5be9f13, user_id=0324eecc35fb4bf290a01c7f41830e09, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:04.114520 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401cd7a-fc67-4499-b8e5-2dc164e93d52 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:04.115208 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558430c-471c-48c6-901d-13a0e72d4ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:04.115840 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558430c-471c-48c6-901d-13a0e72d4ec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:04.116103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558430c-471c-48c6-901d-13a0e72d4ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:04.116391 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558430c-471c-48c6-901d-13a0e72d4ec3 admin admin] PATH_INFO: `/v3/projects/3e1c2ad3b44949e5922e5132f82dad79/users/7f69f80eb0544487bb4492dd6a4b3c31/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:04.118634 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558430c-471c-48c6-901d-13a0e72d4ec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e1c2ad3b44949e5922e5132f82dad79, user_id=7f69f80eb0544487bb4492dd6a4b3c31, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:04.121742 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558430c-471c-48c6-901d-13a0e72d4ec3 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:04.127275 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 967/1923] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:55:04 2022] PUT /identity/v3/projects/74eff46c3698443aa91e2c07b5be9f13/users/0324eecc35fb4bf290a01c7f41830e09/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:04.136218 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 957/1924] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:55:04 2022] PUT /identity/v3/projects/3e1c2ad3b44949e5922e5132f82dad79/users/7f69f80eb0544487bb4492dd6a4b3c31/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:04.140077 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749980de-285d-4f8a-8898-dbee87678e8a None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:04.140417 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749980de-285d-4f8a-8898-dbee87678e8a None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:04.140722 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749980de-285d-4f8a-8898-dbee87678e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:04.145469 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202701a0-3a35-415a-8a06-0401f162468f None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:04.145909 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202701a0-3a35-415a-8a06-0401f162468f None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:04.146354 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202701a0-3a35-415a-8a06-0401f162468f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:04.176798 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-749980de-285d-4f8a-8898-dbee87678e8a None None] MFA Rules not processed for user `0324eecc35fb4bf290a01c7f41830e09`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:04.178914 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-749980de-285d-4f8a-8898-dbee87678e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:04.189794 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-202701a0-3a35-415a-8a06-0401f162468f None None] MFA Rules not processed for user `7f69f80eb0544487bb4492dd6a4b3c31`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:04.191430 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-202701a0-3a35-415a-8a06-0401f162468f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:04.264057 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 968/1925] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:04 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:55:04.279071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749980de-285d-4f8a-8898-dbee87678e8a None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:04.282830 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 958/1926] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:04 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:04.283634 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-749980de-285d-4f8a-8898-dbee87678e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:04.351636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:04.356680 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749980de-285d-4f8a-8898-dbee87678e8a None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:04.365634 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9a259-768a-4343-8557-77258da43dce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:04.366375 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9a259-768a-4343-8557-77258da43dce service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:04.366661 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9a259-768a-4343-8557-77258da43dce service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:04.366935 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9a259-768a-4343-8557-77258da43dce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:04.385097 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c9a259-768a-4343-8557-77258da43dce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:04.387272 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202701a0-3a35-415a-8a06-0401f162468f None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:04.387422 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c9a259-768a-4343-8557-77258da43dce service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:04.389378 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-202701a0-3a35-415a-8a06-0401f162468f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:04.399779 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 969/1927] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:04 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:55:04.406459 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202701a0-3a35-415a-8a06-0401f162468f None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:04.411159 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc0146-155c-498a-a58c-390958fe88b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:04.412444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc0146-155c-498a-a58c-390958fe88b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:04.412656 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc0146-155c-498a-a58c-390958fe88b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:04.412877 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc0146-155c-498a-a58c-390958fe88b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:04.494709 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc0146-155c-498a-a58c-390958fe88b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:04.496826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc0146-155c-498a-a58c-390958fe88b3 service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:04.503693 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:04.514000 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 959/1928] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 10:55:05.163237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9a259-768a-4343-8557-77258da43dce service cinder] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:05.166258 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-e4c9a259-768a-4343-8557-77258da43dce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:05.194171 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc0146-155c-498a-a58c-390958fe88b3 service cinder] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:05.206809 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc0146-155c-498a-a58c-390958fe88b3 service cinder] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:05.211597 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c1ea1-4e7f-4f8b-a55d-f4e3df5882b8 tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0324eecc35fb4bf290a01c7f41830e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74eff46c3698443aa91e2c07b5be9f13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:05.212266 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c1ea1-4e7f-4f8b-a55d-f4e3df5882b8 tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:05.212739 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c1ea1-4e7f-4f8b-a55d-f4e3df5882b8 tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:05.213083 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c1ea1-4e7f-4f8b-a55d-f4e3df5882b8 tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:05.213852 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c1ea1-4e7f-4f8b-a55d-f4e3df5882b8 tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:55:05.214217 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c1ea1-4e7f-4f8b-a55d-f4e3df5882b8 tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:05.215998 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c1ea1-4e7f-4f8b-a55d-f4e3df5882b8 tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:05.230857 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 960/1929] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:55:05.232458 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871fa55-d67e-4a48-a748-12153836e30f None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:05.232961 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871fa55-d67e-4a48-a748-12153836e30f None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:05.233597 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871fa55-d67e-4a48-a748-12153836e30f None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:05.235523 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 961/1930] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 7 10:55:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:55:05.236407 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871fa55-d67e-4a48-a748-12153836e30f None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:05.254487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871fa55-d67e-4a48-a748-12153836e30f None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:05.259810 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60174286-dc01-4e63-881b-fa07a9e829d5 tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0324eecc35fb4bf290a01c7f41830e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74eff46c3698443aa91e2c07b5be9f13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:05.260780 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60174286-dc01-4e63-881b-fa07a9e829d5 tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:05.261060 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60174286-dc01-4e63-881b-fa07a9e829d5 tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:05.262246 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60174286-dc01-4e63-881b-fa07a9e829d5 tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:05.262415 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60174286-dc01-4e63-881b-fa07a9e829d5 tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:05.264481 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60174286-dc01-4e63-881b-fa07a9e829d5 tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:05.276464 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9a259-768a-4343-8557-77258da43dce service cinder] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:05.284157 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03b9cb-3b5b-49c2-95ef-19d45e1d968d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:05.284157 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03b9cb-3b5b-49c2-95ef-19d45e1d968d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:05.284157 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03b9cb-3b5b-49c2-95ef-19d45e1d968d admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:05.284157 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03b9cb-3b5b-49c2-95ef-19d45e1d968d admin admin] PATH_INFO: `/v3/users/a155559d4a1c45a6abb9609902595e37` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:05.285614 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03b9cb-3b5b-49c2-95ef-19d45e1d968d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a155559d4a1c45a6abb9609902595e37)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:05.288721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03b9cb-3b5b-49c2-95ef-19d45e1d968d admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:05.306114 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 962/1931] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:55:05 2022] POST /identity/v3/projects => generated 353 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:05.307423 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a338a7c-46d4-456c-ae11-7c30d504db47 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:05.307770 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a338a7c-46d4-456c-ae11-7c30d504db47 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:05.308147 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a338a7c-46d4-456c-ae11-7c30d504db47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:05.338879 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-8a338a7c-46d4-456c-ae11-7c30d504db47 None None] MFA Rules not processed for user `f98cb7abbb8942cebb71aa98da80a05a`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:05.340255 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-8a338a7c-46d4-456c-ae11-7c30d504db47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:05.363637 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-5a03b9cb-3b5b-49c2-95ef-19d45e1d968d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a155559d4a1c45a6abb9609902595e37'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:05.382344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-5a03b9cb-3b5b-49c2-95ef-19d45e1d968d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a155559d4a1c45a6abb9609902595e37'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:05.383421 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-5a03b9cb-3b5b-49c2-95ef-19d45e1d968d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a155559d4a1c45a6abb9609902595e37'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:05.393150 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-5a03b9cb-3b5b-49c2-95ef-19d45e1d968d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a155559d4a1c45a6abb9609902595e37'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:05.402415 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-5a03b9cb-3b5b-49c2-95ef-19d45e1d968d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a155559d4a1c45a6abb9609902595e37'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:05.408990 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 970/1932] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:55:05 2022] DELETE /identity/v3/users/a155559d4a1c45a6abb9609902595e37 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:05.413613 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03b9cb-3b5b-49c2-95ef-19d45e1d968d admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:05.415044 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-5a03b9cb-3b5b-49c2-95ef-19d45e1d968d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:05.429914 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 963/1933] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 7 10:55:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:05.431955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecbd74-510e-4622-abbe-50978168f0e4 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:05.432243 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecbd74-510e-4622-abbe-50978168f0e4 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:05.432512 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecbd74-510e-4622-abbe-50978168f0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:05.454721 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-5aecbd74-510e-4622-abbe-50978168f0e4 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:05.456083 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-5aecbd74-510e-4622-abbe-50978168f0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:05.493866 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03b9cb-3b5b-49c2-95ef-19d45e1d968d admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:05.498536 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652b4fd-7bad-45aa-b0d8-28c78767937c tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0324eecc35fb4bf290a01c7f41830e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74eff46c3698443aa91e2c07b5be9f13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:05.499141 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652b4fd-7bad-45aa-b0d8-28c78767937c tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:05.499513 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652b4fd-7bad-45aa-b0d8-28c78767937c tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:05.499787 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652b4fd-7bad-45aa-b0d8-28c78767937c tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:05.500432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652b4fd-7bad-45aa-b0d8-28c78767937c tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:55:05.500736 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652b4fd-7bad-45aa-b0d8-28c78767937c tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:05.502347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652b4fd-7bad-45aa-b0d8-28c78767937c tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:05.515503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 971/1934] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:55:05.516333 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652b4fd-7bad-45aa-b0d8-28c78767937c tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:05.519905 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-5652b4fd-7bad-45aa-b0d8-28c78767937c tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:05.527225 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:05.528632 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 964/1935] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:05.540893 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aecbd74-510e-4622-abbe-50978168f0e4 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:05.543163 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-5aecbd74-510e-4622-abbe-50978168f0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:05.611509 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652b4fd-7bad-45aa-b0d8-28c78767937c tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:05.617530 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c82ed-6daf-4f0e-b510-3a4fa10c130c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:05.618245 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c82ed-6daf-4f0e-b510-3a4fa10c130c service nova] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:05.618431 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c82ed-6daf-4f0e-b510-3a4fa10c130c service nova] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:05.618669 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c82ed-6daf-4f0e-b510-3a4fa10c130c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:05.631008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c82ed-6daf-4f0e-b510-3a4fa10c130c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:05.632590 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c82ed-6daf-4f0e-b510-3a4fa10c130c service nova] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:05.632997 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aecbd74-510e-4622-abbe-50978168f0e4 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:05.637929 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83ca34-f331-426f-88c9-7c5748a45f3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:05.638828 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83ca34-f331-426f-88c9-7c5748a45f3a service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:05.639110 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83ca34-f331-426f-88c9-7c5748a45f3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:05.640086 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83ca34-f331-426f-88c9-7c5748a45f3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:05.646341 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 972/1936] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:55:05.647206 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c82ed-6daf-4f0e-b510-3a4fa10c130c service nova] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:05.652461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83ca34-f331-426f-88c9-7c5748a45f3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:05.654677 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83ca34-f331-426f-88c9-7c5748a45f3a service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:05.657636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c82ed-6daf-4f0e-b510-3a4fa10c130c service nova] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:05.662204 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:05.665599 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea298304-2100-40ac-83ce-8c8731ce0894 tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0324eecc35fb4bf290a01c7f41830e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74eff46c3698443aa91e2c07b5be9f13', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:05.666839 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea298304-2100-40ac-83ce-8c8731ce0894 tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:05.667132 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea298304-2100-40ac-83ce-8c8731ce0894 tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:05.667453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea298304-2100-40ac-83ce-8c8731ce0894 tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] PATH_INFO: `/v3/projects/b2b116c1a26b43fea5bee659a371bb44` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:05.668687 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea298304-2100-40ac-83ce-8c8731ce0894 tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b2b116c1a26b43fea5bee659a371bb44)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:05.671249 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea298304-2100-40ac-83ce-8c8731ce0894 tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:05.676519 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 965/1937] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:55:05.727018 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-ea298304-2100-40ac-83ce-8c8731ce0894 tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2b116c1a26b43fea5bee659a371bb44', 'request_id': 'req-ea298304-2100-40ac-83ce-8c8731ce0894'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:05.734242 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-ea298304-2100-40ac-83ce-8c8731ce0894 tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2b116c1a26b43fea5bee659a371bb44', 'request_id': 'req-ea298304-2100-40ac-83ce-8c8731ce0894'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:05.743729 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-ea298304-2100-40ac-83ce-8c8731ce0894 tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2b116c1a26b43fea5bee659a371bb44', 'request_id': 'req-ea298304-2100-40ac-83ce-8c8731ce0894'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:05.770971 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-ea298304-2100-40ac-83ce-8c8731ce0894 tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] The token cache is being invalidate because project b2b116c1a26b43fea5bee659a371bb44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:55:05.771328 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-ea298304-2100-40ac-83ce-8c8731ce0894 tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:05.772012 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-ea298304-2100-40ac-83ce-8c8731ce0894 tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:05.775140 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 973/1938] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:55:05 2022] DELETE /identity/v3/projects/b2b116c1a26b43fea5bee659a371bb44 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:05.982399 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83ca34-f331-426f-88c9-7c5748a45f3a service neutron] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:05.984347 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-1c83ca34-f331-426f-88c9-7c5748a45f3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:06.003796 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83ca34-f331-426f-88c9-7c5748a45f3a service neutron] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:06.038281 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea298304-2100-40ac-83ce-8c8731ce0894 tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:06.039788 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-ea298304-2100-40ac-83ce-8c8731ce0894 tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:06.083991 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d7e3d-76c9-4ae3-866f-0964adb6a451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:06.084681 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d7e3d-76c9-4ae3-866f-0964adb6a451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:06.084967 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d7e3d-76c9-4ae3-866f-0964adb6a451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:06.085240 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d7e3d-76c9-4ae3-866f-0964adb6a451 admin admin] PATH_INFO: `/v3/users/bd802c5adf0c47afbf50e65e246329fd` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:06.086461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d7e3d-76c9-4ae3-866f-0964adb6a451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd802c5adf0c47afbf50e65e246329fd)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:06.088993 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d7e3d-76c9-4ae3-866f-0964adb6a451 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:06.111138 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea298304-2100-40ac-83ce-8c8731ce0894 tempest-VolumeQuotaClassesTest-640023729 tempest-VolumeQuotaClassesTest-640023729-project-admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:06.117253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6606ea1-5f37-489b-88b1-09e6dc4051e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:06.117909 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6606ea1-5f37-489b-88b1-09e6dc4051e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:06.118211 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6606ea1-5f37-489b-88b1-09e6dc4051e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:06.118467 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6606ea1-5f37-489b-88b1-09e6dc4051e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:06.120293 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-d6606ea1-5f37-489b-88b1-09e6dc4051e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:06.145078 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-464d7e3d-76c9-4ae3-866f-0964adb6a451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd802c5adf0c47afbf50e65e246329fd'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:06.158163 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:06.162219 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-464d7e3d-76c9-4ae3-866f-0964adb6a451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd802c5adf0c47afbf50e65e246329fd'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:06.163213 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-464d7e3d-76c9-4ae3-866f-0964adb6a451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd802c5adf0c47afbf50e65e246329fd'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:06.172332 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-464d7e3d-76c9-4ae3-866f-0964adb6a451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd802c5adf0c47afbf50e65e246329fd'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:06.182292 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-464d7e3d-76c9-4ae3-866f-0964adb6a451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd802c5adf0c47afbf50e65e246329fd'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:06.189916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 966/1939] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:55:05 2022] DELETE /identity/v3/users/bd802c5adf0c47afbf50e65e246329fd => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:06.195864 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd5339-4ccc-4a3c-9b50-3c27b156c12b None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:06.196230 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd5339-4ccc-4a3c-9b50-3c27b156c12b None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:06.196583 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd5339-4ccc-4a3c-9b50-3c27b156c12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:06.208514 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6606ea1-5f37-489b-88b1-09e6dc4051e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:06.210093 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6606ea1-5f37-489b-88b1-09e6dc4051e3 service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:06.226349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 974/1940] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:06 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:55:06.235601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-10dd5339-4ccc-4a3c-9b50-3c27b156c12b None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:06.237484 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-10dd5339-4ccc-4a3c-9b50-3c27b156c12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:06.321603 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 967/1941] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:06.335467 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6606ea1-5f37-489b-88b1-09e6dc4051e3 service cinder] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:06.338316 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-d6606ea1-5f37-489b-88b1-09e6dc4051e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:06.404628 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6606ea1-5f37-489b-88b1-09e6dc4051e3 service cinder] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:06.452951 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd5339-4ccc-4a3c-9b50-3c27b156c12b None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:06.466807 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-10dd5339-4ccc-4a3c-9b50-3c27b156c12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:06.484980 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd5339-4ccc-4a3c-9b50-3c27b156c12b None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:06.492860 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd6e26-a87d-4553-92ac-fd70ba4c3e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:06.493549 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd6e26-a87d-4553-92ac-fd70ba4c3e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:06.493842 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd6e26-a87d-4553-92ac-fd70ba4c3e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:06.494114 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd6e26-a87d-4553-92ac-fd70ba4c3e71 admin admin] PATH_INFO: `/v3/projects/8c282cb4a2374c5b90b70a642f08237d` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:06.495489 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd6e26-a87d-4553-92ac-fd70ba4c3e71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c282cb4a2374c5b90b70a642f08237d)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:06.497591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd6e26-a87d-4553-92ac-fd70ba4c3e71 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:06.506032 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe6c81-2607-4950-90d6-26fddb16e644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:06.507084 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe6c81-2607-4950-90d6-26fddb16e644 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:06.507850 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe6c81-2607-4950-90d6-26fddb16e644 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:06.508253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe6c81-2607-4950-90d6-26fddb16e644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:06.513255 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:06.521810 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe6c81-2607-4950-90d6-26fddb16e644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:06.524236 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe6c81-2607-4950-90d6-26fddb16e644 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:06.537808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 975/1942] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:55:06.538935 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe6c81-2607-4950-90d6-26fddb16e644 service neutron] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:06.540338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-7ebe6c81-2607-4950-90d6-26fddb16e644 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:06.553883 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe6c81-2607-4950-90d6-26fddb16e644 service neutron] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:06.559441 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea4bea-5d57-4c56-a359-1694d76ea019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:06.560216 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea4bea-5d57-4c56-a359-1694d76ea019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:06.560487 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea4bea-5d57-4c56-a359-1694d76ea019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:06.560752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea4bea-5d57-4c56-a359-1694d76ea019 admin admin] PATH_INFO: `/v3/users/fcc5c73f0ed54068994d0923610565e5` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:06.561948 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea4bea-5d57-4c56-a359-1694d76ea019 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcc5c73f0ed54068994d0923610565e5)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:06.563856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea4bea-5d57-4c56-a359-1694d76ea019 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:06.580868 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-30dd6e26-a87d-4553-92ac-fd70ba4c3e71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c282cb4a2374c5b90b70a642f08237d', 'request_id': 'req-30dd6e26-a87d-4553-92ac-fd70ba4c3e71'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:06.590069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-30dd6e26-a87d-4553-92ac-fd70ba4c3e71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c282cb4a2374c5b90b70a642f08237d', 'request_id': 'req-30dd6e26-a87d-4553-92ac-fd70ba4c3e71'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:06.602146 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-30dd6e26-a87d-4553-92ac-fd70ba4c3e71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c282cb4a2374c5b90b70a642f08237d', 'request_id': 'req-30dd6e26-a87d-4553-92ac-fd70ba4c3e71'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:06.619935 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-30dd6e26-a87d-4553-92ac-fd70ba4c3e71 admin admin] The token cache is being invalidate because project 8c282cb4a2374c5b90b70a642f08237d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:55:06.620468 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-30dd6e26-a87d-4553-92ac-fd70ba4c3e71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:06.621625 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-30dd6e26-a87d-4553-92ac-fd70ba4c3e71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:06.624028 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-1eea4bea-5d57-4c56-a359-1694d76ea019 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcc5c73f0ed54068994d0923610565e5'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:06.625620 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 968/1943] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:55:06 2022] DELETE /identity/v3/projects/8c282cb4a2374c5b90b70a642f08237d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:06.628862 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd6e26-a87d-4553-92ac-fd70ba4c3e71 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:06.631264 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-30dd6e26-a87d-4553-92ac-fd70ba4c3e71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:06.643949 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-1eea4bea-5d57-4c56-a359-1694d76ea019 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcc5c73f0ed54068994d0923610565e5'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:06.644682 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-1eea4bea-5d57-4c56-a359-1694d76ea019 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcc5c73f0ed54068994d0923610565e5'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:06.656428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-1eea4bea-5d57-4c56-a359-1694d76ea019 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcc5c73f0ed54068994d0923610565e5'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:06.659853 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:06.669015 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-1eea4bea-5d57-4c56-a359-1694d76ea019 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcc5c73f0ed54068994d0923610565e5'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:06.677038 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 976/1944] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:55:06 2022] DELETE /identity/v3/users/fcc5c73f0ed54068994d0923610565e5 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:06.682023 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166fc95-a194-4e11-9cb9-ddc4a5f45f6c None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:06.682307 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166fc95-a194-4e11-9cb9-ddc4a5f45f6c None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:06.682744 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166fc95-a194-4e11-9cb9-ddc4a5f45f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:06.702711 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-e166fc95-a194-4e11-9cb9-ddc4a5f45f6c None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:06.706993 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-e166fc95-a194-4e11-9cb9-ddc4a5f45f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:06.712895 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd6e26-a87d-4553-92ac-fd70ba4c3e71 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:06.776254 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442da6dc-431a-4b47-873d-3fa1e2ca61ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:06.777068 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442da6dc-431a-4b47-873d-3fa1e2ca61ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:06.777424 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442da6dc-431a-4b47-873d-3fa1e2ca61ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:06.777768 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442da6dc-431a-4b47-873d-3fa1e2ca61ba admin admin] PATH_INFO: `/v3/users/fe885abcecf2431ca1c6d00311d1cae3` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:06.779041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442da6dc-431a-4b47-873d-3fa1e2ca61ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe885abcecf2431ca1c6d00311d1cae3)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:06.781225 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442da6dc-431a-4b47-873d-3fa1e2ca61ba admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:06.785276 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 977/1945] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:55:06.793145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166fc95-a194-4e11-9cb9-ddc4a5f45f6c None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:06.796142 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-e166fc95-a194-4e11-9cb9-ddc4a5f45f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:06.878687 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166fc95-a194-4e11-9cb9-ddc4a5f45f6c None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:06.883752 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-442da6dc-431a-4b47-873d-3fa1e2ca61ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe885abcecf2431ca1c6d00311d1cae3'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:06.886765 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:06.889936 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2312fe4-4cd1-4c42-a4ea-9f029e3aaf98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:06.890606 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2312fe4-4cd1-4c42-a4ea-9f029e3aaf98 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:06.890883 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2312fe4-4cd1-4c42-a4ea-9f029e3aaf98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:06.892272 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2312fe4-4cd1-4c42-a4ea-9f029e3aaf98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:06.907296 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-442da6dc-431a-4b47-873d-3fa1e2ca61ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe885abcecf2431ca1c6d00311d1cae3'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:06.908369 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-442da6dc-431a-4b47-873d-3fa1e2ca61ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe885abcecf2431ca1c6d00311d1cae3'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:06.910004 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2312fe4-4cd1-4c42-a4ea-9f029e3aaf98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:06.912171 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2312fe4-4cd1-4c42-a4ea-9f029e3aaf98 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:06.917981 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-442da6dc-431a-4b47-873d-3fa1e2ca61ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe885abcecf2431ca1c6d00311d1cae3'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:06.929717 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-442da6dc-431a-4b47-873d-3fa1e2ca61ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe885abcecf2431ca1c6d00311d1cae3'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:06.934164 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 978/1946] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 10:55:06.935046 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2312fe4-4cd1-4c42-a4ea-9f029e3aaf98 service neutron] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:06.936547 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-b2312fe4-4cd1-4c42-a4ea-9f029e3aaf98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:06.943713 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 969/1947] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:55:06 2022] DELETE /identity/v3/users/fe885abcecf2431ca1c6d00311d1cae3 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:06.952906 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2312fe4-4cd1-4c42-a4ea-9f029e3aaf98 service neutron] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:07.057259 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc66c6b-e3dd-49e1-8e75-e823d5cf9301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:07.061027 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc66c6b-e3dd-49e1-8e75-e823d5cf9301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:07.061382 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc66c6b-e3dd-49e1-8e75-e823d5cf9301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:07.062810 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc66c6b-e3dd-49e1-8e75-e823d5cf9301 admin admin] PATH_INFO: `/v3/projects/35e2e8612492410586f903f2c5993b44` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:07.066410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc66c6b-e3dd-49e1-8e75-e823d5cf9301 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35e2e8612492410586f903f2c5993b44)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:07.070951 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc66c6b-e3dd-49e1-8e75-e823d5cf9301 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:07.135721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:DELETE=4,keystone:SELECT=96 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:07.148888 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-1bc66c6b-e3dd-49e1-8e75-e823d5cf9301 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35e2e8612492410586f903f2c5993b44', 'request_id': 'req-1bc66c6b-e3dd-49e1-8e75-e823d5cf9301'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:07.156919 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-1bc66c6b-e3dd-49e1-8e75-e823d5cf9301 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35e2e8612492410586f903f2c5993b44', 'request_id': 'req-1bc66c6b-e3dd-49e1-8e75-e823d5cf9301'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:07.171403 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-1bc66c6b-e3dd-49e1-8e75-e823d5cf9301 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35e2e8612492410586f903f2c5993b44', 'request_id': 'req-1bc66c6b-e3dd-49e1-8e75-e823d5cf9301'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:07.191922 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-1bc66c6b-e3dd-49e1-8e75-e823d5cf9301 admin admin] The token cache is being invalidate because project 35e2e8612492410586f903f2c5993b44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:55:07.192223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-1bc66c6b-e3dd-49e1-8e75-e823d5cf9301 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:07.193238 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-1bc66c6b-e3dd-49e1-8e75-e823d5cf9301 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:07.194936 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 979/1948] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:55:06 2022] DELETE /identity/v3/projects/35e2e8612492410586f903f2c5993b44 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:07.199339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442da6dc-431a-4b47-873d-3fa1e2ca61ba admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:07.200766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-442da6dc-431a-4b47-873d-3fa1e2ca61ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:07.227080 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442da6dc-431a-4b47-873d-3fa1e2ca61ba admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:07.301436 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e43cd-bd1a-4d3c-ba5a-ab3e4dfcc4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:07.302505 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e43cd-bd1a-4d3c-ba5a-ab3e4dfcc4ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:07.302505 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e43cd-bd1a-4d3c-ba5a-ab3e4dfcc4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:07.302746 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e43cd-bd1a-4d3c-ba5a-ab3e4dfcc4ba admin admin] PATH_INFO: `/v3/users/0324eecc35fb4bf290a01c7f41830e09` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:07.304325 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e43cd-bd1a-4d3c-ba5a-ab3e4dfcc4ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=0324eecc35fb4bf290a01c7f41830e09)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:07.306447 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e43cd-bd1a-4d3c-ba5a-ab3e4dfcc4ba admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:07.386139 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-440e43cd-bd1a-4d3c-ba5a-ab3e4dfcc4ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0324eecc35fb4bf290a01c7f41830e09'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:07.402934 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-440e43cd-bd1a-4d3c-ba5a-ab3e4dfcc4ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0324eecc35fb4bf290a01c7f41830e09'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:07.403719 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-440e43cd-bd1a-4d3c-ba5a-ab3e4dfcc4ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0324eecc35fb4bf290a01c7f41830e09'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:07.414258 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-440e43cd-bd1a-4d3c-ba5a-ab3e4dfcc4ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0324eecc35fb4bf290a01c7f41830e09'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:07.424257 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-440e43cd-bd1a-4d3c-ba5a-ab3e4dfcc4ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0324eecc35fb4bf290a01c7f41830e09'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:07.433265 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 970/1949] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:55:07 2022] DELETE /identity/v3/users/0324eecc35fb4bf290a01c7f41830e09 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:07.469847 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc66c6b-e3dd-49e1-8e75-e823d5cf9301 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:07.471327 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-1bc66c6b-e3dd-49e1-8e75-e823d5cf9301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:07.499075 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e43cd-bd1a-4d3c-ba5a-ab3e4dfcc4ba admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:07.501171 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-440e43cd-bd1a-4d3c-ba5a-ab3e4dfcc4ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:07.516988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc66c6b-e3dd-49e1-8e75-e823d5cf9301 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:07.576930 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:07.619261 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e43cd-bd1a-4d3c-ba5a-ab3e4dfcc4ba admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:07.626840 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb88b95-eb91-4eaf-84df-6786302cc123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:07.627871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb88b95-eb91-4eaf-84df-6786302cc123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:07.633644 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb88b95-eb91-4eaf-84df-6786302cc123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:07.634067 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb88b95-eb91-4eaf-84df-6786302cc123 admin admin] PATH_INFO: `/v3/projects/d29c2f95eebe460c854308f3e28d7040` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:07.635294 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb88b95-eb91-4eaf-84df-6786302cc123 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d29c2f95eebe460c854308f3e28d7040)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:07.637459 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb88b95-eb91-4eaf-84df-6786302cc123 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:07.642699 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88de55-d905-4281-8710-18370e6df0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:07.642956 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88de55-d905-4281-8710-18370e6df0e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:07.643236 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88de55-d905-4281-8710-18370e6df0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:07.643794 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88de55-d905-4281-8710-18370e6df0e5 admin admin] PATH_INFO: `/v3/projects/480236b590e543a3a8bcaa63b821268d` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:07.645041 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88de55-d905-4281-8710-18370e6df0e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=480236b590e543a3a8bcaa63b821268d)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:07.647023 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88de55-d905-4281-8710-18370e6df0e5 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:07.717674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5eb88b95-eb91-4eaf-84df-6786302cc123 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd29c2f95eebe460c854308f3e28d7040', 'request_id': 'req-5eb88b95-eb91-4eaf-84df-6786302cc123'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:07.724121 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5eb88b95-eb91-4eaf-84df-6786302cc123 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd29c2f95eebe460c854308f3e28d7040', 'request_id': 'req-5eb88b95-eb91-4eaf-84df-6786302cc123'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:07.724328 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-4b88de55-d905-4281-8710-18370e6df0e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '480236b590e543a3a8bcaa63b821268d', 'request_id': 'req-4b88de55-d905-4281-8710-18370e6df0e5'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:07.731728 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5eb88b95-eb91-4eaf-84df-6786302cc123 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd29c2f95eebe460c854308f3e28d7040', 'request_id': 'req-5eb88b95-eb91-4eaf-84df-6786302cc123'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:07.734428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-4b88de55-d905-4281-8710-18370e6df0e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '480236b590e543a3a8bcaa63b821268d', 'request_id': 'req-4b88de55-d905-4281-8710-18370e6df0e5'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:07.748605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-4b88de55-d905-4281-8710-18370e6df0e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '480236b590e543a3a8bcaa63b821268d', 'request_id': 'req-4b88de55-d905-4281-8710-18370e6df0e5'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:07.753567 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5eb88b95-eb91-4eaf-84df-6786302cc123 admin admin] The token cache is being invalidate because project d29c2f95eebe460c854308f3e28d7040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:55:07.753923 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5eb88b95-eb91-4eaf-84df-6786302cc123 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:07.754896 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5eb88b95-eb91-4eaf-84df-6786302cc123 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:07.759642 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 971/1950] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:55:07 2022] DELETE /identity/v3/projects/d29c2f95eebe460c854308f3e28d7040 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 10:55:07.761445 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb88b95-eb91-4eaf-84df-6786302cc123 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:07.764153 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-5eb88b95-eb91-4eaf-84df-6786302cc123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:07.764394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-4b88de55-d905-4281-8710-18370e6df0e5 admin admin] The token cache is being invalidate because project 480236b590e543a3a8bcaa63b821268d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:55:07.764793 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-4b88de55-d905-4281-8710-18370e6df0e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:07.765829 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-4b88de55-d905-4281-8710-18370e6df0e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:07.767594 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 980/1951] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:55:07 2022] DELETE /identity/v3/projects/480236b590e543a3a8bcaa63b821268d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:07.773269 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d01c4-4a40-4196-b5e9-f85d82c6e082 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:07.773412 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d01c4-4a40-4196-b5e9-f85d82c6e082 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:07.773635 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d01c4-4a40-4196-b5e9-f85d82c6e082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:07.812301 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-fb2d01c4-4a40-4196-b5e9-f85d82c6e082 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:07.813628 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-fb2d01c4-4a40-4196-b5e9-f85d82c6e082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:07.855341 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb88b95-eb91-4eaf-84df-6786302cc123 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:07.881732 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:07.905648 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 981/1952] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:55:07.905648 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d01c4-4a40-4196-b5e9-f85d82c6e082 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:07.905648 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-fb2d01c4-4a40-4196-b5e9-f85d82c6e082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:07.914571 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d01c4-4a40-4196-b5e9-f85d82c6e082 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:07.921263 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9057e1-de0d-44c9-9998-10bf41cdbde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:07.921917 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9057e1-de0d-44c9-9998-10bf41cdbde2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:07.922197 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9057e1-de0d-44c9-9998-10bf41cdbde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:07.922464 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9057e1-de0d-44c9-9998-10bf41cdbde2 admin admin] PATH_INFO: `/v3/projects/74eff46c3698443aa91e2c07b5be9f13` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:07.923778 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9057e1-de0d-44c9-9998-10bf41cdbde2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74eff46c3698443aa91e2c07b5be9f13)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:07.925968 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9057e1-de0d-44c9-9998-10bf41cdbde2 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:07.940613 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641beaba-376a-4dc3-910c-1efdf346997d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:07.941343 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641beaba-376a-4dc3-910c-1efdf346997d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:07.941712 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641beaba-376a-4dc3-910c-1efdf346997d admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:07.942057 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641beaba-376a-4dc3-910c-1efdf346997d admin admin] PATH_INFO: `/v3/users/6263a914f174461cb0372f3932750aa7` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:07.943401 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641beaba-376a-4dc3-910c-1efdf346997d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6263a914f174461cb0372f3932750aa7)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:07.945546 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641beaba-376a-4dc3-910c-1efdf346997d admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:07.978684 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:07.995355 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-7d9057e1-de0d-44c9-9998-10bf41cdbde2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74eff46c3698443aa91e2c07b5be9f13', 'request_id': 'req-7d9057e1-de0d-44c9-9998-10bf41cdbde2'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:08.001836 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-7d9057e1-de0d-44c9-9998-10bf41cdbde2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74eff46c3698443aa91e2c07b5be9f13', 'request_id': 'req-7d9057e1-de0d-44c9-9998-10bf41cdbde2'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:08.003132 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-641beaba-376a-4dc3-910c-1efdf346997d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6263a914f174461cb0372f3932750aa7'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:08.022794 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-7d9057e1-de0d-44c9-9998-10bf41cdbde2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74eff46c3698443aa91e2c07b5be9f13', 'request_id': 'req-7d9057e1-de0d-44c9-9998-10bf41cdbde2'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:08.027892 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-641beaba-376a-4dc3-910c-1efdf346997d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6263a914f174461cb0372f3932750aa7'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:08.028720 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-641beaba-376a-4dc3-910c-1efdf346997d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6263a914f174461cb0372f3932750aa7'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:08.037073 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-641beaba-376a-4dc3-910c-1efdf346997d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6263a914f174461cb0372f3932750aa7'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:08.038921 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-7d9057e1-de0d-44c9-9998-10bf41cdbde2 admin admin] The token cache is being invalidate because project 74eff46c3698443aa91e2c07b5be9f13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:55:08.039360 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-7d9057e1-de0d-44c9-9998-10bf41cdbde2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:08.040078 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-7d9057e1-de0d-44c9-9998-10bf41cdbde2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:08.045035 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 982/1953] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:55:07 2022] DELETE /identity/v3/projects/74eff46c3698443aa91e2c07b5be9f13 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:08.047720 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-641beaba-376a-4dc3-910c-1efdf346997d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6263a914f174461cb0372f3932750aa7'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:08.048089 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf95040-69c4-4f4c-95a2-88693c01f775 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:08.048089 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf95040-69c4-4f4c-95a2-88693c01f775 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:08.048362 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf95040-69c4-4f4c-95a2-88693c01f775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:08.060303 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 972/1954] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:55:07 2022] DELETE /identity/v3/users/6263a914f174461cb0372f3932750aa7 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:08.060303 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db902ea-c06d-48f4-8ebb-32105bbe1ede None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:08.060303 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db902ea-c06d-48f4-8ebb-32105bbe1ede None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:08.060303 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db902ea-c06d-48f4-8ebb-32105bbe1ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:08.076537 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-2bf95040-69c4-4f4c-95a2-88693c01f775 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:08.077934 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-2bf95040-69c4-4f4c-95a2-88693c01f775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:08.079214 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-6db902ea-c06d-48f4-8ebb-32105bbe1ede None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:08.080380 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-6db902ea-c06d-48f4-8ebb-32105bbe1ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:08.151782 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 973/1955] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:08.159173 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab071e-c696-4005-9b25-18fe1c9a26d0 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:08.159477 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab071e-c696-4005-9b25-18fe1c9a26d0 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:08.159713 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab071e-c696-4005-9b25-18fe1c9a26d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:08.164986 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 983/1956] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:08.166049 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf95040-69c4-4f4c-95a2-88693c01f775 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:08.178062 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf95040-69c4-4f4c-95a2-88693c01f775 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:08.183532 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb564a0a-f959-4491-af3b-84b2c797dc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:08.184315 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-91ab071e-c696-4005-9b25-18fe1c9a26d0 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:08.184458 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb564a0a-f959-4491-af3b-84b2c797dc70 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:08.184803 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb564a0a-f959-4491-af3b-84b2c797dc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:08.185126 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-91ab071e-c696-4005-9b25-18fe1c9a26d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:08.185245 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb564a0a-f959-4491-af3b-84b2c797dc70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:08.186060 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb564a0a-f959-4491-af3b-84b2c797dc70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:55:08.186385 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb564a0a-f959-4491-af3b-84b2c797dc70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:08.188141 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb564a0a-f959-4491-af3b-84b2c797dc70 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:08.194839 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 974/1957] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:08.199696 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab071e-c696-4005-9b25-18fe1c9a26d0 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:08.209834 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 984/1958] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:55:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:55:08.210120 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab071e-c696-4005-9b25-18fe1c9a26d0 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:08.213637 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb564a0a-f959-4491-af3b-84b2c797dc70 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:08.215917 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501bb198-c437-479b-bf94-9a280028b355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:08.216597 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bb198-c437-479b-bf94-9a280028b355 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:08.216876 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bb198-c437-479b-bf94-9a280028b355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:08.217144 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bb198-c437-479b-bf94-9a280028b355 admin admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:08.217904 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501bb198-c437-479b-bf94-9a280028b355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:55:08.218205 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501bb198-c437-479b-bf94-9a280028b355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:08.219800 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501bb198-c437-479b-bf94-9a280028b355 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:08.227163 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb564a0a-f959-4491-af3b-84b2c797dc70 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:08.235490 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 975/1959] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:55:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:55:08.235670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48587ec-6208-4767-9a1a-73e20e74db2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:08.235670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48587ec-6208-4767-9a1a-73e20e74db2c admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:08.235670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48587ec-6208-4767-9a1a-73e20e74db2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:08.235670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48587ec-6208-4767-9a1a-73e20e74db2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:08.235966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48587ec-6208-4767-9a1a-73e20e74db2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:08.237627 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48587ec-6208-4767-9a1a-73e20e74db2c admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:08.240979 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501bb198-c437-479b-bf94-9a280028b355 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:08.251601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501bb198-c437-479b-bf94-9a280028b355 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:08.257516 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fb9d8-3276-4c0b-83b6-4ef71944e507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:08.258134 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fb9d8-3276-4c0b-83b6-4ef71944e507 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:08.258422 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fb9d8-3276-4c0b-83b6-4ef71944e507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:08.258691 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fb9d8-3276-4c0b-83b6-4ef71944e507 admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:08.259344 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fb9d8-3276-4c0b-83b6-4ef71944e507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:08.261201 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fb9d8-3276-4c0b-83b6-4ef71944e507 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:08.270388 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 985/1960] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:55:08 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 10:55:08.274954 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48587ec-6208-4767-9a1a-73e20e74db2c admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:08.328019 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 976/1961] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:55:08 2022] POST /identity/v3/projects => generated 381 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:08.332539 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fb9d8-3276-4c0b-83b6-4ef71944e507 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:08.381341 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:08.400090 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48587ec-6208-4767-9a1a-73e20e74db2c admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:08.437765 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fb9d8-3276-4c0b-83b6-4ef71944e507 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:08.445433 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd65c83-fdb8-4c38-aa75-7494fa65cdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:08.446143 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd65c83-fdb8-4c38-aa75-7494fa65cdd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:08.446571 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd65c83-fdb8-4c38-aa75-7494fa65cdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:08.446844 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd65c83-fdb8-4c38-aa75-7494fa65cdd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:08.447480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd65c83-fdb8-4c38-aa75-7494fa65cdd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:08.449987 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd65c83-fdb8-4c38-aa75-7494fa65cdd4 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:08.460390 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:08.512113 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 977/1962] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:55:08 2022] POST /identity/v3/users => generated 291 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:08.519186 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd65c83-fdb8-4c38-aa75-7494fa65cdd4 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:08.528973 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcac536-a767-4202-beb8-3d032df2c49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:08.529929 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcac536-a767-4202-beb8-3d032df2c49c admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:08.530813 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcac536-a767-4202-beb8-3d032df2c49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:08.531618 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcac536-a767-4202-beb8-3d032df2c49c admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:08.532455 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcac536-a767-4202-beb8-3d032df2c49c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:08.537865 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcac536-a767-4202-beb8-3d032df2c49c admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:08.565140 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd65c83-fdb8-4c38-aa75-7494fa65cdd4 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:08.573825 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb29b5-8704-4635-a624-0ec6111f5ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:08.575115 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb29b5-8704-4635-a624-0ec6111f5ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:08.575633 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb29b5-8704-4635-a624-0ec6111f5ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:08.576102 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb29b5-8704-4635-a624-0ec6111f5ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:08.576977 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb29b5-8704-4635-a624-0ec6111f5ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:08.579434 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb29b5-8704-4635-a624-0ec6111f5ba7 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:08.594487 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 986/1963] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:55:08 2022] POST /identity/v3/users => generated 291 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:08.599711 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcac536-a767-4202-beb8-3d032df2c49c admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:08.613967 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 978/1964] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:08.617932 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb29b5-8704-4635-a624-0ec6111f5ba7 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:08.625611 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcac536-a767-4202-beb8-3d032df2c49c admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:08.636178 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca9b77-c22a-462e-8c3a-7f558395bb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:08.636812 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca9b77-c22a-462e-8c3a-7f558395bb00 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:08.637095 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca9b77-c22a-462e-8c3a-7f558395bb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:08.637394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca9b77-c22a-462e-8c3a-7f558395bb00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:08.638066 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca9b77-c22a-462e-8c3a-7f558395bb00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:08.639684 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca9b77-c22a-462e-8c3a-7f558395bb00 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:08.649620 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb29b5-8704-4635-a624-0ec6111f5ba7 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:08.657967 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fb707-f737-4cec-9b8a-3e6d9a0c1e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:08.659068 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fb707-f737-4cec-9b8a-3e6d9a0c1e53 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:08.659642 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fb707-f737-4cec-9b8a-3e6d9a0c1e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:08.660737 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fb707-f737-4cec-9b8a-3e6d9a0c1e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:08.662315 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3fb707-f737-4cec-9b8a-3e6d9a0c1e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:08.664440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3fb707-f737-4cec-9b8a-3e6d9a0c1e53 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:08.668972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 987/1965] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:08.672906 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca9b77-c22a-462e-8c3a-7f558395bb00 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:08.694045 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca9b77-c22a-462e-8c3a-7f558395bb00 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:08.698245 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 979/1966] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:08.699626 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fb707-f737-4cec-9b8a-3e6d9a0c1e53 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:08.714848 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b142c-8977-47cf-a28b-6d4ecd55b3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:08.715819 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b142c-8977-47cf-a28b-6d4ecd55b3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:08.716607 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b142c-8977-47cf-a28b-6d4ecd55b3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:08.716607 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b142c-8977-47cf-a28b-6d4ecd55b3e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:08.718079 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b142c-8977-47cf-a28b-6d4ecd55b3e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:08.721993 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fb707-f737-4cec-9b8a-3e6d9a0c1e53 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:08.725005 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b142c-8977-47cf-a28b-6d4ecd55b3e7 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:08.734279 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cad6d6-282c-4ef4-a1f3-dd05490ba5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:08.735017 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cad6d6-282c-4ef4-a1f3-dd05490ba5fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:08.737538 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cad6d6-282c-4ef4-a1f3-dd05490ba5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:08.737825 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cad6d6-282c-4ef4-a1f3-dd05490ba5fb admin admin] PATH_INFO: `/v3/projects/b977e0511e944569b97554d9b669d76a/users/04f97dec43454e6c9e4d2471dc8e5d71/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:08.754735 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 988/1967] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 10:55:08.763203 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b142c-8977-47cf-a28b-6d4ecd55b3e7 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:08.775415 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cad6d6-282c-4ef4-a1f3-dd05490ba5fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b977e0511e944569b97554d9b669d76a, user_id=04f97dec43454e6c9e4d2471dc8e5d71, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:08.785907 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b142c-8977-47cf-a28b-6d4ecd55b3e7 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:08.793600 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cad6d6-282c-4ef4-a1f3-dd05490ba5fb admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:08.795049 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3591f9-50e7-4f69-9e07-86c0cf0eceef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:08.796161 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3591f9-50e7-4f69-9e07-86c0cf0eceef admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:08.796773 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3591f9-50e7-4f69-9e07-86c0cf0eceef admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:08.798396 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3591f9-50e7-4f69-9e07-86c0cf0eceef admin admin] PATH_INFO: `/v3/projects/2b7c9e701ebb4656acbfb597679919de/users/43733de991464324a4fa640e6e10f466/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:08.825398 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 980/1968] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:55:08 2022] PUT /identity/v3/projects/b977e0511e944569b97554d9b669d76a/users/04f97dec43454e6c9e4d2471dc8e5d71/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 10:55:08.836379 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9920dc4-79ff-4098-bdcf-49fe76989758 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:08.836666 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9920dc4-79ff-4098-bdcf-49fe76989758 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:08.836937 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9920dc4-79ff-4098-bdcf-49fe76989758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:08.838754 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3591f9-50e7-4f69-9e07-86c0cf0eceef admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b7c9e701ebb4656acbfb597679919de, user_id=43733de991464324a4fa640e6e10f466, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:08.842091 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3591f9-50e7-4f69-9e07-86c0cf0eceef admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:08.876888 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 989/1969] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:55:08 2022] PUT /identity/v3/projects/2b7c9e701ebb4656acbfb597679919de/users/43733de991464324a4fa640e6e10f466/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:08.890928 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767575b-a616-45b0-b958-442e03c02e92 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:08.891467 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767575b-a616-45b0-b958-442e03c02e92 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:08.891467 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767575b-a616-45b0-b958-442e03c02e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:08.914398 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-f9920dc4-79ff-4098-bdcf-49fe76989758 None None] MFA Rules not processed for user `04f97dec43454e6c9e4d2471dc8e5d71`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:08.915938 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-f9920dc4-79ff-4098-bdcf-49fe76989758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:08.942294 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-3767575b-a616-45b0-b958-442e03c02e92 None None] MFA Rules not processed for user `43733de991464324a4fa640e6e10f466`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:08.944148 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-3767575b-a616-45b0-b958-442e03c02e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:09.061202 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 981/1970] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:55:09.063984 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9920dc4-79ff-4098-bdcf-49fe76989758 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:09.065507 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-f9920dc4-79ff-4098-bdcf-49fe76989758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:09.099872 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 990/1971] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:55:09.099872 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767575b-a616-45b0-b958-442e03c02e92 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:09.149791 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9920dc4-79ff-4098-bdcf-49fe76989758 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:09.155041 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:09.157644 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0dfb8-9748-45dc-a8dc-587bb41e61ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:09.158286 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0dfb8-9748-45dc-a8dc-587bb41e61ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:09.158286 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0dfb8-9748-45dc-a8dc-587bb41e61ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:09.158583 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0dfb8-9748-45dc-a8dc-587bb41e61ac admin admin] PATH_INFO: `/v3/projects/ce3b1813fa534c2ea5fd74cb369488b5` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:09.163151 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d0dfb8-9748-45dc-a8dc-587bb41e61ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce3b1813fa534c2ea5fd74cb369488b5)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:09.167263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d0dfb8-9748-45dc-a8dc-587bb41e61ac admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:09.249870 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767575b-a616-45b0-b958-442e03c02e92 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:09.280462 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e8ec8-2fed-4231-990e-8f7779edbc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:09.281449 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e8ec8-2fed-4231-990e-8f7779edbc08 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:09.281902 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e8ec8-2fed-4231-990e-8f7779edbc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:09.282324 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e8ec8-2fed-4231-990e-8f7779edbc08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:09.282585 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:INSERT=3,keystone:SELECT=94,keystone:DELETE=3 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:09.283538 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e8ec8-2fed-4231-990e-8f7779edbc08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:09.285264 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e8ec8-2fed-4231-990e-8f7779edbc08 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:09.313887 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-15d0dfb8-9748-45dc-a8dc-587bb41e61ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce3b1813fa534c2ea5fd74cb369488b5', 'request_id': 'req-15d0dfb8-9748-45dc-a8dc-587bb41e61ac'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:09.331919 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-15d0dfb8-9748-45dc-a8dc-587bb41e61ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce3b1813fa534c2ea5fd74cb369488b5', 'request_id': 'req-15d0dfb8-9748-45dc-a8dc-587bb41e61ac'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:09.358085 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-15d0dfb8-9748-45dc-a8dc-587bb41e61ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce3b1813fa534c2ea5fd74cb369488b5', 'request_id': 'req-15d0dfb8-9748-45dc-a8dc-587bb41e61ac'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:09.361543 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 991/1972] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:55:09 2022] POST /identity/v3/projects => generated 383 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:09.365154 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e8ec8-2fed-4231-990e-8f7779edbc08 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:09.393788 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-15d0dfb8-9748-45dc-a8dc-587bb41e61ac admin admin] The token cache is being invalidate because project ce3b1813fa534c2ea5fd74cb369488b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:55:09.394022 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-15d0dfb8-9748-45dc-a8dc-587bb41e61ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:09.397938 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-15d0dfb8-9748-45dc-a8dc-587bb41e61ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:09.406777 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 982/1973] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:55:09 2022] DELETE /identity/v3/projects/ce3b1813fa534c2ea5fd74cb369488b5 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:09.411042 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0dfb8-9748-45dc-a8dc-587bb41e61ac admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:09.416476 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-15d0dfb8-9748-45dc-a8dc-587bb41e61ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:09.507106 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e8ec8-2fed-4231-990e-8f7779edbc08 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:09.516830 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65644ed2-3296-421f-a7be-f87b7a585cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:09.518069 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65644ed2-3296-421f-a7be-f87b7a585cfb admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:09.518959 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65644ed2-3296-421f-a7be-f87b7a585cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:09.519475 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65644ed2-3296-421f-a7be-f87b7a585cfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:09.520565 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65644ed2-3296-421f-a7be-f87b7a585cfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:09.524217 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65644ed2-3296-421f-a7be-f87b7a585cfb admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:09.552268 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0dfb8-9748-45dc-a8dc-587bb41e61ac admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:09.565819 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 992/1974] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:55:09 2022] POST /identity/v3/projects => generated 381 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:09.569033 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929b7e1-b6c6-4c5f-9ee2-defa8f600797 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:09.569537 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929b7e1-b6c6-4c5f-9ee2-defa8f600797 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:09.570127 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929b7e1-b6c6-4c5f-9ee2-defa8f600797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:09.570939 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a81db0-a0b8-45b6-97e2-695542484148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:09.572285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a81db0-a0b8-45b6-97e2-695542484148 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:09.573718 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a81db0-a0b8-45b6-97e2-695542484148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:09.574344 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a81db0-a0b8-45b6-97e2-695542484148 admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:09.575478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a81db0-a0b8-45b6-97e2-695542484148 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:09.583039 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a81db0-a0b8-45b6-97e2-695542484148 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:09.599857 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-c929b7e1-b6c6-4c5f-9ee2-defa8f600797 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:09.602104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-c929b7e1-b6c6-4c5f-9ee2-defa8f600797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:09.621782 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 983/1975] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:55:09 2022] POST /identity/v3/users => generated 298 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:09.623260 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a81db0-a0b8-45b6-97e2-695542484148 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:09.625867 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-48a81db0-a0b8-45b6-97e2-695542484148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:09.652658 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a81db0-a0b8-45b6-97e2-695542484148 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:09.716212 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 993/1976] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:09.721187 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929b7e1-b6c6-4c5f-9ee2-defa8f600797 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:09.745241 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929b7e1-b6c6-4c5f-9ee2-defa8f600797 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:09.752766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831553e7-bdfc-4ff2-9d5c-d50f0068ca52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:09.753709 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831553e7-bdfc-4ff2-9d5c-d50f0068ca52 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:09.754390 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831553e7-bdfc-4ff2-9d5c-d50f0068ca52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:09.754765 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831553e7-bdfc-4ff2-9d5c-d50f0068ca52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:09.755693 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831553e7-bdfc-4ff2-9d5c-d50f0068ca52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:09.758926 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831553e7-bdfc-4ff2-9d5c-d50f0068ca52 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:09.781906 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 994/1977] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:09.781906 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccdcf0-30a3-49d2-aae7-685cdd4c64c7 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:09.781906 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccdcf0-30a3-49d2-aae7-685cdd4c64c7 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:09.781906 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccdcf0-30a3-49d2-aae7-685cdd4c64c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:09.793733 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866519f-df9a-4ea7-9897-5091424e9a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:09.794809 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866519f-df9a-4ea7-9897-5091424e9a92 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:09.795098 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866519f-df9a-4ea7-9897-5091424e9a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:09.795373 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866519f-df9a-4ea7-9897-5091424e9a92 admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:09.796012 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d866519f-df9a-4ea7-9897-5091424e9a92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:09.798149 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d866519f-df9a-4ea7-9897-5091424e9a92 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:09.804276 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-e5ccdcf0-30a3-49d2-aae7-685cdd4c64c7 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:09.805710 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-e5ccdcf0-30a3-49d2-aae7-685cdd4c64c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:09.815413 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 995/1978] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:09.816311 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccdcf0-30a3-49d2-aae7-685cdd4c64c7 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:09.826814 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccdcf0-30a3-49d2-aae7-685cdd4c64c7 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:09.827648 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 984/1979] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:55:09 2022] POST /identity/v3/users => generated 297 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:09.828617 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866519f-df9a-4ea7-9897-5091424e9a92 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:09.832173 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427aec8-20ee-469d-ad98-6da600430a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:09.833017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427aec8-20ee-469d-ad98-6da600430a98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:09.833943 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427aec8-20ee-469d-ad98-6da600430a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:09.834298 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427aec8-20ee-469d-ad98-6da600430a98 admin admin] PATH_INFO: `/v3/projects/81c45fe0ef484f7b9837ec09a696bf35/users/6da947aa42124c3c93fd68dd8867f69c/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:09.839486 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866519f-df9a-4ea7-9897-5091424e9a92 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:09.844432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ac39e-471f-4f29-b813-7655b9dbe577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:09.845019 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ac39e-471f-4f29-b813-7655b9dbe577 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:09.845296 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ac39e-471f-4f29-b813-7655b9dbe577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:09.845594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ac39e-471f-4f29-b813-7655b9dbe577 admin admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:09.846250 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ac39e-471f-4f29-b813-7655b9dbe577 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:55:09.846541 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ac39e-471f-4f29-b813-7655b9dbe577 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:09.848125 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ac39e-471f-4f29-b813-7655b9dbe577 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:09.850951 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427aec8-20ee-469d-ad98-6da600430a98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81c45fe0ef484f7b9837ec09a696bf35, user_id=6da947aa42124c3c93fd68dd8867f69c, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:09.853939 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427aec8-20ee-469d-ad98-6da600430a98 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:09.857250 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:09.869580 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 985/1980] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:55:09.869580 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ac39e-471f-4f29-b813-7655b9dbe577 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:09.876847 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 996/1981] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:55:09 2022] PUT /identity/v3/projects/81c45fe0ef484f7b9837ec09a696bf35/users/6da947aa42124c3c93fd68dd8867f69c/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:09.882114 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427aec8-20ee-469d-ad98-6da600430a98 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:09.882376 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ac39e-471f-4f29-b813-7655b9dbe577 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:09.918612 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=89,keystone:DELETE=4,keystone:INSERT=7 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:09.964754 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539a460-0d8e-4c9c-bf7d-156c4388901c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:09.965252 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539a460-0d8e-4c9c-bf7d-156c4388901c admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:09.965555 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539a460-0d8e-4c9c-bf7d-156c4388901c admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:09.966761 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539a460-0d8e-4c9c-bf7d-156c4388901c admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:09.967423 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539a460-0d8e-4c9c-bf7d-156c4388901c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:09.969038 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539a460-0d8e-4c9c-bf7d-156c4388901c admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:09.984823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 986/1982] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:09.985792 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539a460-0d8e-4c9c-bf7d-156c4388901c admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:09.994863 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427aec8-20ee-469d-ad98-6da600430a98 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:09.998888 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539a460-0d8e-4c9c-bf7d-156c4388901c admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:10.001644 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86dcc1-b6e3-43b6-8a7b-54f08d726f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:10.002355 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86dcc1-b6e3-43b6-8a7b-54f08d726f29 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:10.002857 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86dcc1-b6e3-43b6-8a7b-54f08d726f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:10.003806 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86dcc1-b6e3-43b6-8a7b-54f08d726f29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:10.005052 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86dcc1-b6e3-43b6-8a7b-54f08d726f29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:10.006068 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8aefcd-93c6-45c1-93b7-d906fe4c5845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:10.006987 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8aefcd-93c6-45c1-93b7-d906fe4c5845 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:10.007425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8aefcd-93c6-45c1-93b7-d906fe4c5845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:10.007701 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86dcc1-b6e3-43b6-8a7b-54f08d726f29 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:10.007998 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8aefcd-93c6-45c1-93b7-d906fe4c5845 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:10.009087 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8aefcd-93c6-45c1-93b7-d906fe4c5845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:10.011036 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8aefcd-93c6-45c1-93b7-d906fe4c5845 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:10.027343 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 987/1983] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:10.027343 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8aefcd-93c6-45c1-93b7-d906fe4c5845 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:10.045340 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8aefcd-93c6-45c1-93b7-d906fe4c5845 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:10.045519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 997/1984] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:55:09 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:10.045519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86dcc1-b6e3-43b6-8a7b-54f08d726f29 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:10.047616 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50af320-deae-4d06-af1b-b43ef989e35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:10.047616 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50af320-deae-4d06-af1b-b43ef989e35c admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:10.047616 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50af320-deae-4d06-af1b-b43ef989e35c admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:10.047930 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50af320-deae-4d06-af1b-b43ef989e35c admin admin] PATH_INFO: `/v3/projects/9e9d3732b6da4ff4a36f43f607744c88/users/cd6a36a1e62d45c79af2936942cb39c8/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:10.070398 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50af320-deae-4d06-af1b-b43ef989e35c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e9d3732b6da4ff4a36f43f607744c88, user_id=cd6a36a1e62d45c79af2936942cb39c8, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:10.073090 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50af320-deae-4d06-af1b-b43ef989e35c admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:10.086992 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 988/1985] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:55:10 2022] PUT /identity/v3/projects/9e9d3732b6da4ff4a36f43f607744c88/users/cd6a36a1e62d45c79af2936942cb39c8/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:10.088054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50af320-deae-4d06-af1b-b43ef989e35c admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:10.123756 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86dcc1-b6e3-43b6-8a7b-54f08d726f29 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:10.155152 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50af320-deae-4d06-af1b-b43ef989e35c admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:10.160029 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323553a-bdf7-4d6d-a171-6894e905b9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:10.160621 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323553a-bdf7-4d6d-a171-6894e905b9ef admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:10.160895 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323553a-bdf7-4d6d-a171-6894e905b9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:10.161161 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9323553a-bdf7-4d6d-a171-6894e905b9ef admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:10.161812 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9323553a-bdf7-4d6d-a171-6894e905b9ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:10.163702 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9323553a-bdf7-4d6d-a171-6894e905b9ef admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:10.180737 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64344fe0-f538-41f6-be3c-a713f91ee702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:10.181429 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64344fe0-f538-41f6-be3c-a713f91ee702 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:10.181708 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64344fe0-f538-41f6-be3c-a713f91ee702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:10.181977 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64344fe0-f538-41f6-be3c-a713f91ee702 admin admin] PATH_INFO: `/v3/projects/81c45fe0ef484f7b9837ec09a696bf35/users/6da947aa42124c3c93fd68dd8867f69c/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:10.183895 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64344fe0-f538-41f6-be3c-a713f91ee702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81c45fe0ef484f7b9837ec09a696bf35, user_id=6da947aa42124c3c93fd68dd8867f69c, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:10.188126 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 989/1986] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:55:10 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:10.188126 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323553a-bdf7-4d6d-a171-6894e905b9ef admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:10.188360 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64344fe0-f538-41f6-be3c-a713f91ee702 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:10.195881 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9323553a-bdf7-4d6d-a171-6894e905b9ef admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:10.198223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 998/1987] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:55:10 2022] PUT /identity/v3/projects/81c45fe0ef484f7b9837ec09a696bf35/users/6da947aa42124c3c93fd68dd8867f69c/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:10.199030 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64344fe0-f538-41f6-be3c-a713f91ee702 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:10.224595 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:10.259489 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803ff1d-7350-407e-b2af-9edbd984f63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:10.260078 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803ff1d-7350-407e-b2af-9edbd984f63d admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:10.260354 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803ff1d-7350-407e-b2af-9edbd984f63d admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:10.260620 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803ff1d-7350-407e-b2af-9edbd984f63d admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:10.261259 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803ff1d-7350-407e-b2af-9edbd984f63d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:10.262872 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803ff1d-7350-407e-b2af-9edbd984f63d admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:10.264827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64344fe0-f538-41f6-be3c-a713f91ee702 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:10.269482 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49776628-f806-40d3-b7bd-7d8cb1c6c37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:10.270098 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49776628-f806-40d3-b7bd-7d8cb1c6c37e admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:10.270371 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49776628-f806-40d3-b7bd-7d8cb1c6c37e admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:10.270655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49776628-f806-40d3-b7bd-7d8cb1c6c37e admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:10.271376 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49776628-f806-40d3-b7bd-7d8cb1c6c37e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:10.272611 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 990/1988] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:10.272931 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49776628-f806-40d3-b7bd-7d8cb1c6c37e admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:10.273826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc0c81-eec1-4d8a-8062-adabd0595963 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:10.274114 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc0c81-eec1-4d8a-8062-adabd0595963 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:10.274386 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc0c81-eec1-4d8a-8062-adabd0595963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:10.285819 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 999/1989] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:10.287465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49776628-f806-40d3-b7bd-7d8cb1c6c37e admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:10.298307 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49776628-f806-40d3-b7bd-7d8cb1c6c37e admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:10.303787 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ecbc99-7dad-4dd1-b462-33cf8a87e786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:10.304433 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecbc99-7dad-4dd1-b462-33cf8a87e786 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:10.304907 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecbc99-7dad-4dd1-b462-33cf8a87e786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:10.305196 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecbc99-7dad-4dd1-b462-33cf8a87e786 admin admin] PATH_INFO: `/v3/projects/9e9d3732b6da4ff4a36f43f607744c88/users/cd6a36a1e62d45c79af2936942cb39c8/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:10.305949 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-d6bc0c81-eec1-4d8a-8062-adabd0595963 None None] MFA Rules not processed for user `6da947aa42124c3c93fd68dd8867f69c`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:10.307167 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-d6bc0c81-eec1-4d8a-8062-adabd0595963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:10.307262 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ecbc99-7dad-4dd1-b462-33cf8a87e786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e9d3732b6da4ff4a36f43f607744c88, user_id=cd6a36a1e62d45c79af2936942cb39c8, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:10.309854 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ecbc99-7dad-4dd1-b462-33cf8a87e786 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:10.312622 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:10.320942 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1000/1990] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:55:10 2022] PUT /identity/v3/projects/9e9d3732b6da4ff4a36f43f607744c88/users/cd6a36a1e62d45c79af2936942cb39c8/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:10.321829 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ecbc99-7dad-4dd1-b462-33cf8a87e786 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:10.388153 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 991/1991] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:10.389440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fd1f3-ed24-4e0b-b2c8-2b18199ca9c2 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:10.389724 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fd1f3-ed24-4e0b-b2c8-2b18199ca9c2 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:10.389996 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fd1f3-ed24-4e0b-b2c8-2b18199ca9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:10.400197 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ecbc99-7dad-4dd1-b462-33cf8a87e786 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:10.405337 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1000ba1-972a-4267-b545-45502699bd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:10.405945 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1000ba1-972a-4267-b545-45502699bd6d admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:10.406217 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1000ba1-972a-4267-b545-45502699bd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:10.406482 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1000ba1-972a-4267-b545-45502699bd6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:10.407120 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1000ba1-972a-4267-b545-45502699bd6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:10.408680 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1000ba1-972a-4267-b545-45502699bd6d admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:10.418330 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-d69fd1f3-ed24-4e0b-b2c8-2b18199ca9c2 None None] MFA Rules not processed for user `cd6a36a1e62d45c79af2936942cb39c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:10.419131 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1001/1992] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:10.419530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-d69fd1f3-ed24-4e0b-b2c8-2b18199ca9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:10.419972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1000ba1-972a-4267-b545-45502699bd6d admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:10.421655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-d1000ba1-972a-4267-b545-45502699bd6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:10.480698 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1000ba1-972a-4267-b545-45502699bd6d admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:10.484409 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44dd2a-70ce-4f0f-ac3a-aaf184537e59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:10.485007 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44dd2a-70ce-4f0f-ac3a-aaf184537e59 service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:10.485284 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44dd2a-70ce-4f0f-ac3a-aaf184537e59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:10.485577 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44dd2a-70ce-4f0f-ac3a-aaf184537e59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:10.488538 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 992/1993] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:10.489383 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fd1f3-ed24-4e0b-b2c8-2b18199ca9c2 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:10.501707 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fd1f3-ed24-4e0b-b2c8-2b18199ca9c2 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:10.507099 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32c54e-7e3f-4484-b9e1-8d34a3447f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:10.507762 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32c54e-7e3f-4484-b9e1-8d34a3447f5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:10.508041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32c54e-7e3f-4484-b9e1-8d34a3447f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:10.508306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32c54e-7e3f-4484-b9e1-8d34a3447f5c admin admin] PATH_INFO: `/v3/projects/fedd5af14a464e76be803e1d20be49bd/users/64282b94537244df905bef0760c8240a/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:10.523491 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e32c54e-7e3f-4484-b9e1-8d34a3447f5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fedd5af14a464e76be803e1d20be49bd, user_id=64282b94537244df905bef0760c8240a, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:10.526568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e32c54e-7e3f-4484-b9e1-8d34a3447f5c admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:10.539618 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:10.541774 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 993/1994] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:55:10 2022] PUT /identity/v3/projects/fedd5af14a464e76be803e1d20be49bd/users/64282b94537244df905bef0760c8240a/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:10.542539 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32c54e-7e3f-4484-b9e1-8d34a3447f5c admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:10.544144 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-5e32c54e-7e3f-4484-b9e1-8d34a3447f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:10.551998 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44dd2a-70ce-4f0f-ac3a-aaf184537e59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:10.553856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44dd2a-70ce-4f0f-ac3a-aaf184537e59 service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:10.564709 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1002/1995] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:55:10.565979 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a97ef-b241-42e5-b96f-812411caf54b None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:10.566548 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a97ef-b241-42e5-b96f-812411caf54b None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:10.566548 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6a97ef-b241-42e5-b96f-812411caf54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:10.594543 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-ba6a97ef-b241-42e5-b96f-812411caf54b None None] MFA Rules not processed for user `64282b94537244df905bef0760c8240a`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:10.595892 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-ba6a97ef-b241-42e5-b96f-812411caf54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:10.622831 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32c54e-7e3f-4484-b9e1-8d34a3447f5c admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:10.627848 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3534b3e-bd35-482a-bc02-32c1620c2a48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:10.628521 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3534b3e-bd35-482a-bc02-32c1620c2a48 service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:10.629792 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3534b3e-bd35-482a-bc02-32c1620c2a48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:10.630246 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3534b3e-bd35-482a-bc02-32c1620c2a48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:10.654204 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:10.683805 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1003/1996] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:10.690772 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a97ef-b241-42e5-b96f-812411caf54b None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:10.691994 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-ba6a97ef-b241-42e5-b96f-812411caf54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:10.722281 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3534b3e-bd35-482a-bc02-32c1620c2a48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:10.723908 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3534b3e-bd35-482a-bc02-32c1620c2a48 service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:10.734953 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 994/1997] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:55:10.736123 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3534b3e-bd35-482a-bc02-32c1620c2a48 service cinder] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:10.738185 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-b3534b3e-bd35-482a-bc02-32c1620c2a48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:10.846776 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3534b3e-bd35-482a-bc02-32c1620c2a48 service cinder] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:10.849766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6a97ef-b241-42e5-b96f-812411caf54b None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:10.852691 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec0d28-b927-4a56-9888-18ce509bd54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:10.853339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec0d28-b927-4a56-9888-18ce509bd54d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:10.853634 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec0d28-b927-4a56-9888-18ce509bd54d admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:10.854045 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec0d28-b927-4a56-9888-18ce509bd54d admin admin] PATH_INFO: `/v3/users/311231dc752e454c98d59dc1a7d9b708` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:10.854150 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de73fd-bdb3-4e6e-840d-0c0a04f2a777 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a462a891b30847c0aeadbd697652011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:10.854833 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de73fd-bdb3-4e6e-840d-0c0a04f2a777 service glance] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:10.855212 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de73fd-bdb3-4e6e-840d-0c0a04f2a777 service glance] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:10.855349 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec0d28-b927-4a56-9888-18ce509bd54d admin admin] RBAC: Authorizing `identity:delete_user(user_id=311231dc752e454c98d59dc1a7d9b708)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:10.855485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de73fd-bdb3-4e6e-840d-0c0a04f2a777 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:10.857672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec0d28-b927-4a56-9888-18ce509bd54d admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:10.868665 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de73fd-bdb3-4e6e-840d-0c0a04f2a777 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:10.870223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de73fd-bdb3-4e6e-840d-0c0a04f2a777 service glance] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:10.884546 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1004/1998] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:55:10.885629 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de73fd-bdb3-4e6e-840d-0c0a04f2a777 service glance] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:10.896342 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de73fd-bdb3-4e6e-840d-0c0a04f2a777 service glance] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:10.906230 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4906c-6b5b-4dba-a372-6ccc9279ac55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:10.907677 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4906c-6b5b-4dba-a372-6ccc9279ac55 service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:10.910017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4906c-6b5b-4dba-a372-6ccc9279ac55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:10.910657 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4906c-6b5b-4dba-a372-6ccc9279ac55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:10.914049 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-10d4906c-6b5b-4dba-a372-6ccc9279ac55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:10.966298 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-e8ec0d28-b927-4a56-9888-18ce509bd54d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '311231dc752e454c98d59dc1a7d9b708'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:10.984845 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-e8ec0d28-b927-4a56-9888-18ce509bd54d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '311231dc752e454c98d59dc1a7d9b708'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:10.986174 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-e8ec0d28-b927-4a56-9888-18ce509bd54d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '311231dc752e454c98d59dc1a7d9b708'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:10.995170 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-e8ec0d28-b927-4a56-9888-18ce509bd54d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '311231dc752e454c98d59dc1a7d9b708'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:11.007632 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-e8ec0d28-b927-4a56-9888-18ce509bd54d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '311231dc752e454c98d59dc1a7d9b708'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:11.015855 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 995/1999] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:55:10 2022] DELETE /identity/v3/users/311231dc752e454c98d59dc1a7d9b708 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:11.021588 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db072da5-6997-49fa-b340-8bf40d537429 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:11.021955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db072da5-6997-49fa-b340-8bf40d537429 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:11.022295 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db072da5-6997-49fa-b340-8bf40d537429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:11.053479 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4906c-6b5b-4dba-a372-6ccc9279ac55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:11.059097 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4906c-6b5b-4dba-a372-6ccc9279ac55 service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:11.069004 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-db072da5-6997-49fa-b340-8bf40d537429 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:11.070598 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-db072da5-6997-49fa-b340-8bf40d537429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:11.114302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1005/2000] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:55:11.156439 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:11.216978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 996/2001] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:11.227340 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4906c-6b5b-4dba-a372-6ccc9279ac55 service cinder] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:11.229002 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-10d4906c-6b5b-4dba-a372-6ccc9279ac55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:11.235926 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:11.357484 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4906c-6b5b-4dba-a372-6ccc9279ac55 service cinder] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:11.451933 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe8b75-7131-43c3-87e9-5c0eb3cf0b11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:11.452943 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe8b75-7131-43c3-87e9-5c0eb3cf0b11 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:11.453692 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe8b75-7131-43c3-87e9-5c0eb3cf0b11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:11.454856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe8b75-7131-43c3-87e9-5c0eb3cf0b11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:11.467033 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe8b75-7131-43c3-87e9-5c0eb3cf0b11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:11.468580 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe8b75-7131-43c3-87e9-5c0eb3cf0b11 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:11.491394 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1006/2002] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:55:11.776570 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db072da5-6997-49fa-b340-8bf40d537429 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:11.778240 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-db072da5-6997-49fa-b340-8bf40d537429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:11.793556 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db072da5-6997-49fa-b340-8bf40d537429 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:11.799972 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff810f-01ba-46b2-b5c6-e0ab18356453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:11.800988 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff810f-01ba-46b2-b5c6-e0ab18356453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:11.801272 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff810f-01ba-46b2-b5c6-e0ab18356453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:11.801872 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff810f-01ba-46b2-b5c6-e0ab18356453 admin admin] PATH_INFO: `/v3/users/43733de991464324a4fa640e6e10f466` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:11.810192 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff810f-01ba-46b2-b5c6-e0ab18356453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43733de991464324a4fa640e6e10f466)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:11.812516 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff810f-01ba-46b2-b5c6-e0ab18356453 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:11.826603 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe8b75-7131-43c3-87e9-5c0eb3cf0b11 service neutron] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:11.828843 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-b4fe8b75-7131-43c3-87e9-5c0eb3cf0b11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:11.847301 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe8b75-7131-43c3-87e9-5c0eb3cf0b11 service neutron] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:11.865474 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60735a12-d273-42ff-ac21-d62b1cd2f18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:11.866240 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60735a12-d273-42ff-ac21-d62b1cd2f18d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:11.866586 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60735a12-d273-42ff-ac21-d62b1cd2f18d admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:11.867337 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60735a12-d273-42ff-ac21-d62b1cd2f18d admin admin] PATH_INFO: `/v3/users/04f97dec43454e6c9e4d2471dc8e5d71` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:11.868140 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60735a12-d273-42ff-ac21-d62b1cd2f18d admin admin] RBAC: Authorizing `identity:delete_user(user_id=04f97dec43454e6c9e4d2471dc8e5d71)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:11.870171 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60735a12-d273-42ff-ac21-d62b1cd2f18d admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:11.931008 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0aff810f-01ba-46b2-b5c6-e0ab18356453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43733de991464324a4fa640e6e10f466'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:11.947600 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0aff810f-01ba-46b2-b5c6-e0ab18356453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43733de991464324a4fa640e6e10f466'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:11.948369 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0aff810f-01ba-46b2-b5c6-e0ab18356453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43733de991464324a4fa640e6e10f466'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:11.958660 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0aff810f-01ba-46b2-b5c6-e0ab18356453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43733de991464324a4fa640e6e10f466'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:11.959046 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-60735a12-d273-42ff-ac21-d62b1cd2f18d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04f97dec43454e6c9e4d2471dc8e5d71'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:11.969107 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0aff810f-01ba-46b2-b5c6-e0ab18356453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43733de991464324a4fa640e6e10f466'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:11.975828 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-60735a12-d273-42ff-ac21-d62b1cd2f18d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04f97dec43454e6c9e4d2471dc8e5d71'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:11.976786 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-60735a12-d273-42ff-ac21-d62b1cd2f18d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04f97dec43454e6c9e4d2471dc8e5d71'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:11.981276 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 997/2003] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:55:11 2022] DELETE /identity/v3/users/43733de991464324a4fa640e6e10f466 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:11.982213 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff810f-01ba-46b2-b5c6-e0ab18356453 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:11.984209 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-0aff810f-01ba-46b2-b5c6-e0ab18356453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:11.985814 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-60735a12-d273-42ff-ac21-d62b1cd2f18d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04f97dec43454e6c9e4d2471dc8e5d71'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:11.999539 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-60735a12-d273-42ff-ac21-d62b1cd2f18d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04f97dec43454e6c9e4d2471dc8e5d71'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:12.009415 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1007/2004] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:55:11 2022] DELETE /identity/v3/users/04f97dec43454e6c9e4d2471dc8e5d71 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:12.010482 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4f7d2-61ca-4a55-83f6-cb3c7349f930 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:12.010838 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4f7d2-61ca-4a55-83f6-cb3c7349f930 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:12.011252 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4f7d2-61ca-4a55-83f6-cb3c7349f930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:12.030361 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-92a4f7d2-61ca-4a55-83f6-cb3c7349f930 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:12.031704 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-92a4f7d2-61ca-4a55-83f6-cb3c7349f930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:12.064704 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:12.083043 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff810f-01ba-46b2-b5c6-e0ab18356453 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:12.146713 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1008/2005] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:12.151294 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f06168-1278-44c4-8e3e-589277c7d74a None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:12.151645 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f06168-1278-44c4-8e3e-589277c7d74a None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:12.158047 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f06168-1278-44c4-8e3e-589277c7d74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:12.166068 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:12.179012 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd42769-2943-40cd-aabd-1c097f65d1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:12.180825 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd42769-2943-40cd-aabd-1c097f65d1ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:12.181461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd42769-2943-40cd-aabd-1c097f65d1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:12.181952 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd42769-2943-40cd-aabd-1c097f65d1ad admin admin] PATH_INFO: `/v3/projects/f2acfbf97fdc4f24a36b78305e1eee54` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:12.183176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd42769-2943-40cd-aabd-1c097f65d1ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2acfbf97fdc4f24a36b78305e1eee54)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:12.185093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd42769-2943-40cd-aabd-1c097f65d1ad admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:12.191759 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-98f06168-1278-44c4-8e3e-589277c7d74a None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:12.193050 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-98f06168-1278-44c4-8e3e-589277c7d74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:12.206988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1009/2006] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:12.207725 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f06168-1278-44c4-8e3e-589277c7d74a None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:12.210196 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-98f06168-1278-44c4-8e3e-589277c7d74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:12.248746 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-7cd42769-2943-40cd-aabd-1c097f65d1ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2acfbf97fdc4f24a36b78305e1eee54', 'request_id': 'req-7cd42769-2943-40cd-aabd-1c097f65d1ad'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:12.263940 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-7cd42769-2943-40cd-aabd-1c097f65d1ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2acfbf97fdc4f24a36b78305e1eee54', 'request_id': 'req-7cd42769-2943-40cd-aabd-1c097f65d1ad'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:12.272049 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-7cd42769-2943-40cd-aabd-1c097f65d1ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2acfbf97fdc4f24a36b78305e1eee54', 'request_id': 'req-7cd42769-2943-40cd-aabd-1c097f65d1ad'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:12.284574 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f06168-1278-44c4-8e3e-589277c7d74a None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:12.287625 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-7cd42769-2943-40cd-aabd-1c097f65d1ad admin admin] The token cache is being invalidate because project f2acfbf97fdc4f24a36b78305e1eee54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:55:12.287941 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-7cd42769-2943-40cd-aabd-1c097f65d1ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:12.288599 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-7cd42769-2943-40cd-aabd-1c097f65d1ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:12.290440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 998/2007] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:55:11 2022] DELETE /identity/v3/projects/f2acfbf97fdc4f24a36b78305e1eee54 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:12.291277 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd42769-2943-40cd-aabd-1c097f65d1ad admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:12.292618 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-7cd42769-2943-40cd-aabd-1c097f65d1ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:12.368661 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb928fc-8111-470b-ab1a-d42577792f1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:12.369293 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb928fc-8111-470b-ab1a-d42577792f1d service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:12.369592 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb928fc-8111-470b-ab1a-d42577792f1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:12.370050 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb928fc-8111-470b-ab1a-d42577792f1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:12.371863 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-8eb928fc-8111-470b-ab1a-d42577792f1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:12.383748 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd42769-2943-40cd-aabd-1c097f65d1ad admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:12.387824 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e37f21-50a9-4e22-a162-92ff4158f6f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:12.388765 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e37f21-50a9-4e22-a162-92ff4158f6f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:12.389063 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e37f21-50a9-4e22-a162-92ff4158f6f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:12.389388 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e37f21-50a9-4e22-a162-92ff4158f6f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:12.391320 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-72e37f21-50a9-4e22-a162-92ff4158f6f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:12.456591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb928fc-8111-470b-ab1a-d42577792f1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:12.458222 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb928fc-8111-470b-ab1a-d42577792f1d service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:12.480211 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1010/2008] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:55:12.481118 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb928fc-8111-470b-ab1a-d42577792f1d service neutron] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:12.484339 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-8eb928fc-8111-470b-ab1a-d42577792f1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:12.509037 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb928fc-8111-470b-ab1a-d42577792f1d service neutron] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:12.514183 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c70b6-4ce9-47ce-8ffd-62c6f3edfb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:12.514774 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c70b6-4ce9-47ce-8ffd-62c6f3edfb63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:12.515055 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c70b6-4ce9-47ce-8ffd-62c6f3edfb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:12.515350 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c70b6-4ce9-47ce-8ffd-62c6f3edfb63 admin admin] PATH_INFO: `/v3/users/7f69f80eb0544487bb4492dd6a4b3c31` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:12.516545 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c70b6-4ce9-47ce-8ffd-62c6f3edfb63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f69f80eb0544487bb4492dd6a4b3c31)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:12.518567 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c70b6-4ce9-47ce-8ffd-62c6f3edfb63 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:12.523735 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e37f21-50a9-4e22-a162-92ff4158f6f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:12.525738 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e37f21-50a9-4e22-a162-92ff4158f6f5 service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:12.540544 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 999/2009] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:55:12.566318 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:12.594897 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-9d2c70b6-4ce9-47ce-8ffd-62c6f3edfb63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f69f80eb0544487bb4492dd6a4b3c31'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:12.618320 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-9d2c70b6-4ce9-47ce-8ffd-62c6f3edfb63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f69f80eb0544487bb4492dd6a4b3c31'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:12.619355 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-9d2c70b6-4ce9-47ce-8ffd-62c6f3edfb63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f69f80eb0544487bb4492dd6a4b3c31'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:12.628397 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-9d2c70b6-4ce9-47ce-8ffd-62c6f3edfb63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f69f80eb0544487bb4492dd6a4b3c31'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:12.638754 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-9d2c70b6-4ce9-47ce-8ffd-62c6f3edfb63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f69f80eb0544487bb4492dd6a4b3c31'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:12.646010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1011/2010] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:55:12 2022] DELETE /identity/v3/users/7f69f80eb0544487bb4492dd6a4b3c31 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:13.092760 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e37f21-50a9-4e22-a162-92ff4158f6f5 service neutron] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:13.094266 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-72e37f21-50a9-4e22-a162-92ff4158f6f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:13.113525 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e37f21-50a9-4e22-a162-92ff4158f6f5 service neutron] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:13.163882 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:13.201433 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be12199-0283-4013-b389-438ae3e2d14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:13.201433 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be12199-0283-4013-b389-438ae3e2d14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:13.201433 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be12199-0283-4013-b389-438ae3e2d14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:13.201433 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be12199-0283-4013-b389-438ae3e2d14f admin admin] PATH_INFO: `/v3/projects/2b7c9e701ebb4656acbfb597679919de` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:13.202999 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be12199-0283-4013-b389-438ae3e2d14f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b7c9e701ebb4656acbfb597679919de)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:13.205279 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be12199-0283-4013-b389-438ae3e2d14f admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:13.213303 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c70b6-4ce9-47ce-8ffd-62c6f3edfb63 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:13.214987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-9d2c70b6-4ce9-47ce-8ffd-62c6f3edfb63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:13.231173 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c70b6-4ce9-47ce-8ffd-62c6f3edfb63 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:13.238806 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386105d-6b54-476e-bd1c-89c4e276f96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:13.239760 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386105d-6b54-476e-bd1c-89c4e276f96a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:13.240038 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386105d-6b54-476e-bd1c-89c4e276f96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:13.240437 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d386105d-6b54-476e-bd1c-89c4e276f96a admin admin] PATH_INFO: `/v3/projects/b977e0511e944569b97554d9b669d76a` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:13.241753 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386105d-6b54-476e-bd1c-89c4e276f96a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b977e0511e944569b97554d9b669d76a)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:13.244868 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d386105d-6b54-476e-bd1c-89c4e276f96a admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:13.266671 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-9be12199-0283-4013-b389-438ae3e2d14f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b7c9e701ebb4656acbfb597679919de', 'request_id': 'req-9be12199-0283-4013-b389-438ae3e2d14f'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:13.273503 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-9be12199-0283-4013-b389-438ae3e2d14f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b7c9e701ebb4656acbfb597679919de', 'request_id': 'req-9be12199-0283-4013-b389-438ae3e2d14f'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:13.282332 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-9be12199-0283-4013-b389-438ae3e2d14f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b7c9e701ebb4656acbfb597679919de', 'request_id': 'req-9be12199-0283-4013-b389-438ae3e2d14f'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:13.304150 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-9be12199-0283-4013-b389-438ae3e2d14f admin admin] The token cache is being invalidate because project 2b7c9e701ebb4656acbfb597679919de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:55:13.306241 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-9be12199-0283-4013-b389-438ae3e2d14f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:13.307510 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-9be12199-0283-4013-b389-438ae3e2d14f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:13.315058 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1000/2011] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:55:13 2022] DELETE /identity/v3/projects/2b7c9e701ebb4656acbfb597679919de => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:13.315058 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be12199-0283-4013-b389-438ae3e2d14f admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:13.318640 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-9be12199-0283-4013-b389-438ae3e2d14f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:13.359880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d386105d-6b54-476e-bd1c-89c4e276f96a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b977e0511e944569b97554d9b669d76a', 'request_id': 'req-d386105d-6b54-476e-bd1c-89c4e276f96a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:13.372856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d386105d-6b54-476e-bd1c-89c4e276f96a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b977e0511e944569b97554d9b669d76a', 'request_id': 'req-d386105d-6b54-476e-bd1c-89c4e276f96a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:13.389425 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d386105d-6b54-476e-bd1c-89c4e276f96a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b977e0511e944569b97554d9b669d76a', 'request_id': 'req-d386105d-6b54-476e-bd1c-89c4e276f96a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:13.412975 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d386105d-6b54-476e-bd1c-89c4e276f96a admin admin] The token cache is being invalidate because project b977e0511e944569b97554d9b669d76a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:55:13.414959 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d386105d-6b54-476e-bd1c-89c4e276f96a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:13.417228 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d386105d-6b54-476e-bd1c-89c4e276f96a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:13.420650 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1012/2012] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:55:13 2022] DELETE /identity/v3/projects/b977e0511e944569b97554d9b669d76a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 10:55:13.421281 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386105d-6b54-476e-bd1c-89c4e276f96a admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:13.429379 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-d386105d-6b54-476e-bd1c-89c4e276f96a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:13.452440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be12199-0283-4013-b389-438ae3e2d14f admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:13.527223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcbbea-5092-4cce-822c-6df60665550f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:13.535058 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcbbea-5092-4cce-822c-6df60665550f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:13.535591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcbbea-5092-4cce-822c-6df60665550f admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:13.535886 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcbbea-5092-4cce-822c-6df60665550f admin admin] PATH_INFO: `/v3/projects/3e1c2ad3b44949e5922e5132f82dad79` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:13.538138 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcbbea-5092-4cce-822c-6df60665550f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e1c2ad3b44949e5922e5132f82dad79)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:13.540494 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcbbea-5092-4cce-822c-6df60665550f admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:13.558198 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:13.563049 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d386105d-6b54-476e-bd1c-89c4e276f96a admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:13.569668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2e0d3-d122-4184-8b1e-e741699d0f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:13.570528 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2e0d3-d122-4184-8b1e-e741699d0f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:13.570978 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2e0d3-d122-4184-8b1e-e741699d0f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:13.571404 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2e0d3-d122-4184-8b1e-e741699d0f42 admin admin] PATH_INFO: `/v3/users/cd6a36a1e62d45c79af2936942cb39c8` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:13.573366 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2e0d3-d122-4184-8b1e-e741699d0f42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd6a36a1e62d45c79af2936942cb39c8)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:13.576078 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2e0d3-d122-4184-8b1e-e741699d0f42 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:13.629952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:13.645521 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ffdcbbea-5092-4cce-822c-6df60665550f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e1c2ad3b44949e5922e5132f82dad79', 'request_id': 'req-ffdcbbea-5092-4cce-822c-6df60665550f'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:13.660806 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ffdcbbea-5092-4cce-822c-6df60665550f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e1c2ad3b44949e5922e5132f82dad79', 'request_id': 'req-ffdcbbea-5092-4cce-822c-6df60665550f'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:13.669572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ffdcbbea-5092-4cce-822c-6df60665550f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e1c2ad3b44949e5922e5132f82dad79', 'request_id': 'req-ffdcbbea-5092-4cce-822c-6df60665550f'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:13.673443 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-63c2e0d3-d122-4184-8b1e-e741699d0f42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd6a36a1e62d45c79af2936942cb39c8'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:13.690013 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ffdcbbea-5092-4cce-822c-6df60665550f admin admin] The token cache is being invalidate because project 3e1c2ad3b44949e5922e5132f82dad79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:55:13.690334 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ffdcbbea-5092-4cce-822c-6df60665550f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:13.691226 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ffdcbbea-5092-4cce-822c-6df60665550f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:13.693154 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1001/2013] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:55:13 2022] DELETE /identity/v3/projects/3e1c2ad3b44949e5922e5132f82dad79 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:13.696712 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcbbea-5092-4cce-822c-6df60665550f admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:13.696712 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ffdcbbea-5092-4cce-822c-6df60665550f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:13.716257 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-63c2e0d3-d122-4184-8b1e-e741699d0f42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd6a36a1e62d45c79af2936942cb39c8'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:13.717565 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-63c2e0d3-d122-4184-8b1e-e741699d0f42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd6a36a1e62d45c79af2936942cb39c8'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:13.729011 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-63c2e0d3-d122-4184-8b1e-e741699d0f42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd6a36a1e62d45c79af2936942cb39c8'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:13.745591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-63c2e0d3-d122-4184-8b1e-e741699d0f42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd6a36a1e62d45c79af2936942cb39c8'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:13.761106 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1013/2014] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:55:13 2022] DELETE /identity/v3/users/cd6a36a1e62d45c79af2936942cb39c8 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:13.781537 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f21615-6926-4d3d-b322-51a31d9a82bf None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:13.782230 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f21615-6926-4d3d-b322-51a31d9a82bf None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:13.784921 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f21615-6926-4d3d-b322-51a31d9a82bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:13.811276 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcbbea-5092-4cce-822c-6df60665550f admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:13.860429 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-98f21615-6926-4d3d-b322-51a31d9a82bf None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:13.862101 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-98f21615-6926-4d3d-b322-51a31d9a82bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:13.935775 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c335e-6338-413d-9c21-93a7c241acf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:13.937347 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c335e-6338-413d-9c21-93a7c241acf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:13.937665 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c335e-6338-413d-9c21-93a7c241acf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:13.939283 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c335e-6338-413d-9c21-93a7c241acf3 admin admin] PATH_INFO: `/v3/users/6da947aa42124c3c93fd68dd8867f69c` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:13.940913 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c335e-6338-413d-9c21-93a7c241acf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6da947aa42124c3c93fd68dd8867f69c)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:13.943526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c335e-6338-413d-9c21-93a7c241acf3 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:13.987791 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1014/2015] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:13.996378 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3d38e-2b0f-408b-b452-482f3b8f5aa5 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:13.996662 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3d38e-2b0f-408b-b452-482f3b8f5aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:13.996934 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3d38e-2b0f-408b-b452-482f3b8f5aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:14.025232 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-eee3d38e-2b0f-408b-b452-482f3b8f5aa5 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:14.026824 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-eee3d38e-2b0f-408b-b452-482f3b8f5aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:14.031324 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-8a8c335e-6338-413d-9c21-93a7c241acf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6da947aa42124c3c93fd68dd8867f69c'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:14.039596 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1015/2016] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:14.039823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:14.041104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3d38e-2b0f-408b-b452-482f3b8f5aa5 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:14.062344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3d38e-2b0f-408b-b452-482f3b8f5aa5 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:14.063349 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-8a8c335e-6338-413d-9c21-93a7c241acf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6da947aa42124c3c93fd68dd8867f69c'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:14.064811 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-8a8c335e-6338-413d-9c21-93a7c241acf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6da947aa42124c3c93fd68dd8867f69c'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:14.082126 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d28f3-9261-45be-ab72-bbe27282c8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:14.083925 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d28f3-9261-45be-ab72-bbe27282c8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:14.084209 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d28f3-9261-45be-ab72-bbe27282c8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:14.084577 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d28f3-9261-45be-ab72-bbe27282c8a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:14.085822 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d28f3-9261-45be-ab72-bbe27282c8a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:55:14.086124 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d28f3-9261-45be-ab72-bbe27282c8a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:14.088751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d28f3-9261-45be-ab72-bbe27282c8a7 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:14.089374 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-8a8c335e-6338-413d-9c21-93a7c241acf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6da947aa42124c3c93fd68dd8867f69c'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:14.105444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-8a8c335e-6338-413d-9c21-93a7c241acf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6da947aa42124c3c93fd68dd8867f69c'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:14.110865 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1016/2017] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:55:14.112429 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d28f3-9261-45be-ab72-bbe27282c8a7 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:14.118213 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1002/2018] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:55:13 2022] DELETE /identity/v3/users/6da947aa42124c3c93fd68dd8867f69c => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:14.119541 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-479d28f3-9261-45be-ab72-bbe27282c8a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:14.153950 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d28f3-9261-45be-ab72-bbe27282c8a7 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:14.274317 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b574a-f541-4e11-89bf-98003b2edb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:14.275204 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b574a-f541-4e11-89bf-98003b2edb7a admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:14.275707 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b574a-f541-4e11-89bf-98003b2edb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:14.276889 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b574a-f541-4e11-89bf-98003b2edb7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:14.277608 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b574a-f541-4e11-89bf-98003b2edb7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:14.279982 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b574a-f541-4e11-89bf-98003b2edb7a admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:14.320900 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1017/2019] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:55:14 2022] POST /identity/v3/projects => generated 389 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:14.325215 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c335e-6338-413d-9c21-93a7c241acf3 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:14.337575 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c335e-6338-413d-9c21-93a7c241acf3 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:14.427550 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec018e8f-a6f2-4742-af06-358aa2037e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:14.428349 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec018e8f-a6f2-4742-af06-358aa2037e74 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:14.428697 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec018e8f-a6f2-4742-af06-358aa2037e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:14.429041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec018e8f-a6f2-4742-af06-358aa2037e74 admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:14.429785 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec018e8f-a6f2-4742-af06-358aa2037e74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:14.434583 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec018e8f-a6f2-4742-af06-358aa2037e74 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:14.459114 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1003/2020] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:55:14 2022] POST /identity/v3/users => generated 295 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:14.460844 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b574a-f541-4e11-89bf-98003b2edb7a admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:14.475348 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b574a-f541-4e11-89bf-98003b2edb7a admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:14.480831 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac8ed0-4ecc-4e82-8fec-c0ab2706a3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:14.481687 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac8ed0-4ecc-4e82-8fec-c0ab2706a3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:14.482812 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac8ed0-4ecc-4e82-8fec-c0ab2706a3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:14.482812 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac8ed0-4ecc-4e82-8fec-c0ab2706a3d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:14.483121 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac8ed0-4ecc-4e82-8fec-c0ab2706a3d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:14.484950 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac8ed0-4ecc-4e82-8fec-c0ab2706a3d3 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:14.492554 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec018e8f-a6f2-4742-af06-358aa2037e74 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:14.495936 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ec018e8f-a6f2-4742-af06-358aa2037e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:14.512854 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec018e8f-a6f2-4742-af06-358aa2037e74 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:14.521900 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1018/2021] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:14.525085 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac8ed0-4ecc-4e82-8fec-c0ab2706a3d3 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:14.528221 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da609b-7026-423c-b4d3-b84ddb052e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:14.529263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da609b-7026-423c-b4d3-b84ddb052e21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:14.529621 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da609b-7026-423c-b4d3-b84ddb052e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:14.529901 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da609b-7026-423c-b4d3-b84ddb052e21 admin admin] PATH_INFO: `/v3/projects/9e9d3732b6da4ff4a36f43f607744c88` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:14.531664 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da609b-7026-423c-b4d3-b84ddb052e21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e9d3732b6da4ff4a36f43f607744c88)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:14.532371 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:14.534104 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da609b-7026-423c-b4d3-b84ddb052e21 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:14.541736 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac8ed0-4ecc-4e82-8fec-c0ab2706a3d3 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:14.548406 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f9b79-71af-498c-a23b-fb536277abf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:14.549190 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f9b79-71af-498c-a23b-fb536277abf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:14.549502 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f9b79-71af-498c-a23b-fb536277abf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:14.549895 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f9b79-71af-498c-a23b-fb536277abf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:14.557038 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f9b79-71af-498c-a23b-fb536277abf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:14.557038 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f9b79-71af-498c-a23b-fb536277abf0 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:14.565807 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1019/2022] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 10:55:14.570511 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f9b79-71af-498c-a23b-fb536277abf0 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:14.583080 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f9b79-71af-498c-a23b-fb536277abf0 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:14.592532 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-80da609b-7026-423c-b4d3-b84ddb052e21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e9d3732b6da4ff4a36f43f607744c88', 'request_id': 'req-80da609b-7026-423c-b4d3-b84ddb052e21'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:14.600504 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-80da609b-7026-423c-b4d3-b84ddb052e21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e9d3732b6da4ff4a36f43f607744c88', 'request_id': 'req-80da609b-7026-423c-b4d3-b84ddb052e21'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:14.607858 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-80da609b-7026-423c-b4d3-b84ddb052e21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e9d3732b6da4ff4a36f43f607744c88', 'request_id': 'req-80da609b-7026-423c-b4d3-b84ddb052e21'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:14.629888 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-80da609b-7026-423c-b4d3-b84ddb052e21 admin admin] The token cache is being invalidate because project 9e9d3732b6da4ff4a36f43f607744c88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:55:14.630373 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-80da609b-7026-423c-b4d3-b84ddb052e21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:14.631369 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-80da609b-7026-423c-b4d3-b84ddb052e21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:14.642041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1004/2023] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:55:14 2022] DELETE /identity/v3/projects/9e9d3732b6da4ff4a36f43f607744c88 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:14.643659 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32957d-2eb5-407c-a36b-d0aa6a298f1f None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:14.644122 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32957d-2eb5-407c-a36b-d0aa6a298f1f None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:14.644500 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32957d-2eb5-407c-a36b-d0aa6a298f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:14.670657 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-7c32957d-2eb5-407c-a36b-d0aa6a298f1f None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:14.672074 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-7c32957d-2eb5-407c-a36b-d0aa6a298f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:14.674061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385d055-1b6d-4782-87fb-b9bf89c9c37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:14.675019 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385d055-1b6d-4782-87fb-b9bf89c9c37d admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:14.675305 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385d055-1b6d-4782-87fb-b9bf89c9c37d admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:14.675601 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385d055-1b6d-4782-87fb-b9bf89c9c37d admin admin] PATH_INFO: `/v3/projects/ec9602b7cfb2411cbb8d56bbe967f35e/users/5044fbac33fa44f7bb7a8e219e82dc35/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:14.697781 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385d055-1b6d-4782-87fb-b9bf89c9c37d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec9602b7cfb2411cbb8d56bbe967f35e, user_id=5044fbac33fa44f7bb7a8e219e82dc35, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:14.704625 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385d055-1b6d-4782-87fb-b9bf89c9c37d admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:14.712614 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1005/2024] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:14.714733 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32957d-2eb5-407c-a36b-d0aa6a298f1f None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:14.731306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-7c32957d-2eb5-407c-a36b-d0aa6a298f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:14.756350 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1020/2025] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:55:14 2022] PUT /identity/v3/projects/ec9602b7cfb2411cbb8d56bbe967f35e/users/5044fbac33fa44f7bb7a8e219e82dc35/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:14.756350 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c087023-3de7-415a-9b75-1aa1dbb1c514 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:14.756350 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c087023-3de7-415a-9b75-1aa1dbb1c514 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:14.756350 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c087023-3de7-415a-9b75-1aa1dbb1c514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:14.777609 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32957d-2eb5-407c-a36b-d0aa6a298f1f None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:14.798097 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-9c087023-3de7-415a-9b75-1aa1dbb1c514 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:14.799616 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-9c087023-3de7-415a-9b75-1aa1dbb1c514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:14.829957 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:14.875587 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67b488-095a-47ee-bac5-a6a530491fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:14.876414 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67b488-095a-47ee-bac5-a6a530491fab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:14.876788 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67b488-095a-47ee-bac5-a6a530491fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:14.877166 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67b488-095a-47ee-bac5-a6a530491fab admin admin] PATH_INFO: `/v3/projects/81c45fe0ef484f7b9837ec09a696bf35` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:14.878487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f67b488-095a-47ee-bac5-a6a530491fab admin admin] RBAC: Authorizing `identity:delete_project(project_id=81c45fe0ef484f7b9837ec09a696bf35)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:14.881724 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f67b488-095a-47ee-bac5-a6a530491fab admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:14.893981 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1021/2026] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:14.897294 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2fa03-1be8-4946-9128-f1b7a9bdfd2f None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:14.897294 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2fa03-1be8-4946-9128-f1b7a9bdfd2f None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:14.897294 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2fa03-1be8-4946-9128-f1b7a9bdfd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:14.928018 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-49a2fa03-1be8-4946-9128-f1b7a9bdfd2f None None] MFA Rules not processed for user `5044fbac33fa44f7bb7a8e219e82dc35`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:14.931783 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-49a2fa03-1be8-4946-9128-f1b7a9bdfd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:14.977522 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5f67b488-095a-47ee-bac5-a6a530491fab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81c45fe0ef484f7b9837ec09a696bf35', 'request_id': 'req-5f67b488-095a-47ee-bac5-a6a530491fab'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:14.984883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5f67b488-095a-47ee-bac5-a6a530491fab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81c45fe0ef484f7b9837ec09a696bf35', 'request_id': 'req-5f67b488-095a-47ee-bac5-a6a530491fab'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:15.001380 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5f67b488-095a-47ee-bac5-a6a530491fab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81c45fe0ef484f7b9837ec09a696bf35', 'request_id': 'req-5f67b488-095a-47ee-bac5-a6a530491fab'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:15.024691 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5f67b488-095a-47ee-bac5-a6a530491fab admin admin] The token cache is being invalidate because project 81c45fe0ef484f7b9837ec09a696bf35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:55:15.025446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5f67b488-095a-47ee-bac5-a6a530491fab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:15.026353 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5f67b488-095a-47ee-bac5-a6a530491fab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:15.028174 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1006/2027] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:55:14 2022] DELETE /identity/v3/projects/81c45fe0ef484f7b9837ec09a696bf35 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:15.029599 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67b488-095a-47ee-bac5-a6a530491fab admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:15.032536 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-5f67b488-095a-47ee-bac5-a6a530491fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:15.043822 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1022/2028] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:15.043822 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82d8a0-b726-4dfe-bba1-e4cb86c10ec4 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:15.043822 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82d8a0-b726-4dfe-bba1-e4cb86c10ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:15.043822 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82d8a0-b726-4dfe-bba1-e4cb86c10ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:15.052763 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:15.071417 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-0a82d8a0-b726-4dfe-bba1-e4cb86c10ec4 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:15.072678 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-0a82d8a0-b726-4dfe-bba1-e4cb86c10ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:15.116956 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67b488-095a-47ee-bac5-a6a530491fab admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:15.123740 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f335dd-503d-4a2e-bb59-41ea3f0e0c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:15.124366 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f335dd-503d-4a2e-bb59-41ea3f0e0c3a admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:15.124641 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f335dd-503d-4a2e-bb59-41ea3f0e0c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:15.124911 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f335dd-503d-4a2e-bb59-41ea3f0e0c3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:15.125613 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f335dd-503d-4a2e-bb59-41ea3f0e0c3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:55:15.125914 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f335dd-503d-4a2e-bb59-41ea3f0e0c3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:15.127515 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f335dd-503d-4a2e-bb59-41ea3f0e0c3a admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:15.144661 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1007/2029] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:55:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:55:15.146403 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f335dd-503d-4a2e-bb59-41ea3f0e0c3a admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:15.148446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-87f335dd-503d-4a2e-bb59-41ea3f0e0c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:15.157429 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1023/2030] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:15.157429 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82d8a0-b726-4dfe-bba1-e4cb86c10ec4 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:15.162037 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f335dd-503d-4a2e-bb59-41ea3f0e0c3a admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:15.166825 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd8427-0f21-4eab-ab71-e60f2dd097d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:15.167415 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd8427-0f21-4eab-ab71-e60f2dd097d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:15.167519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82d8a0-b726-4dfe-bba1-e4cb86c10ec4 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:15.167700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd8427-0f21-4eab-ab71-e60f2dd097d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:15.168030 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd8427-0f21-4eab-ab71-e60f2dd097d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:15.168599 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd8427-0f21-4eab-ab71-e60f2dd097d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:15.170520 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd8427-0f21-4eab-ab71-e60f2dd097d3 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:15.172058 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6315845-83b3-4082-9315-4d6c9f1d34fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:15.172672 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6315845-83b3-4082-9315-4d6c9f1d34fe admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:15.172949 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6315845-83b3-4082-9315-4d6c9f1d34fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:15.173218 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6315845-83b3-4082-9315-4d6c9f1d34fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:15.173863 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6315845-83b3-4082-9315-4d6c9f1d34fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:15.175762 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6315845-83b3-4082-9315-4d6c9f1d34fe admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:15.211028 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1024/2031] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:55:15 2022] POST /identity/v3/projects => generated 363 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:15.212376 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e95c0-4a4d-40f9-b5e8-d9fe99b61ca7 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:15.212663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e95c0-4a4d-40f9-b5e8-d9fe99b61ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:15.212946 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e95c0-4a4d-40f9-b5e8-d9fe99b61ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:15.215367 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1008/2032] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:55:15 2022] POST /identity/v3/projects => generated 387 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:15.218373 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd8427-0f21-4eab-ab71-e60f2dd097d3 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:15.240009 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-777e95c0-4a4d-40f9-b5e8-d9fe99b61ca7 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:15.241227 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-777e95c0-4a4d-40f9-b5e8-d9fe99b61ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:15.273186 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:15.311301 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd8427-0f21-4eab-ab71-e60f2dd097d3 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:15.316472 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf0b27-2c5e-4ba1-8d0c-28828ad996d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:15.317212 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf0b27-2c5e-4ba1-8d0c-28828ad996d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:15.317551 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf0b27-2c5e-4ba1-8d0c-28828ad996d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:15.317848 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf0b27-2c5e-4ba1-8d0c-28828ad996d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:15.318484 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf0b27-2c5e-4ba1-8d0c-28828ad996d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:15.321700 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1025/2033] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:15.321700 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e95c0-4a4d-40f9-b5e8-d9fe99b61ca7 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:15.322651 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf0b27-2c5e-4ba1-8d0c-28828ad996d4 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:15.332310 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e95c0-4a4d-40f9-b5e8-d9fe99b61ca7 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:15.338844 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578f8fb-de6a-412f-9e85-95437ab6eb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:15.339580 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578f8fb-de6a-412f-9e85-95437ab6eb72 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:15.339881 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578f8fb-de6a-412f-9e85-95437ab6eb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:15.340194 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578f8fb-de6a-412f-9e85-95437ab6eb72 admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:15.340927 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578f8fb-de6a-412f-9e85-95437ab6eb72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:15.343457 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578f8fb-de6a-412f-9e85-95437ab6eb72 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:15.361207 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1009/2034] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:55:15 2022] POST /identity/v3/users => generated 282 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:15.365875 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf0b27-2c5e-4ba1-8d0c-28828ad996d4 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:15.370903 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1026/2035] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:55:15 2022] POST /identity/v3/users => generated 300 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:15.371735 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578f8fb-de6a-412f-9e85-95437ab6eb72 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:15.385473 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf0b27-2c5e-4ba1-8d0c-28828ad996d4 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:15.387995 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578f8fb-de6a-412f-9e85-95437ab6eb72 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:15.391694 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873b8c7-f5ac-4788-bd2e-2d05e30c9537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:15.392506 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873b8c7-f5ac-4788-bd2e-2d05e30c9537 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:15.399190 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d61328-571f-4e11-8aa6-4094d9c40409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:15.399990 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d61328-571f-4e11-8aa6-4094d9c40409 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:15.400662 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873b8c7-f5ac-4788-bd2e-2d05e30c9537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:15.400997 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873b8c7-f5ac-4788-bd2e-2d05e30c9537 admin admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:15.401261 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d61328-571f-4e11-8aa6-4094d9c40409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:15.401722 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d61328-571f-4e11-8aa6-4094d9c40409 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:15.401847 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873b8c7-f5ac-4788-bd2e-2d05e30c9537 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:55:15.402134 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873b8c7-f5ac-4788-bd2e-2d05e30c9537 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:15.402411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d61328-571f-4e11-8aa6-4094d9c40409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:15.403831 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873b8c7-f5ac-4788-bd2e-2d05e30c9537 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:15.404231 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d61328-571f-4e11-8aa6-4094d9c40409 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:15.420499 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1027/2036] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:15.420499 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d61328-571f-4e11-8aa6-4094d9c40409 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:15.439426 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d61328-571f-4e11-8aa6-4094d9c40409 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:15.446141 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1010/2037] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:55:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:55:15.447582 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355335a-6086-4350-957a-52121c071e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:15.448351 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355335a-6086-4350-957a-52121c071e14 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:15.448817 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355335a-6086-4350-957a-52121c071e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:15.449226 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355335a-6086-4350-957a-52121c071e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:15.450202 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355335a-6086-4350-957a-52121c071e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:15.452070 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873b8c7-f5ac-4788-bd2e-2d05e30c9537 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:15.452233 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355335a-6086-4350-957a-52121c071e14 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:15.463449 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873b8c7-f5ac-4788-bd2e-2d05e30c9537 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:15.469558 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1028/2038] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:15.469558 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355335a-6086-4350-957a-52121c071e14 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:15.480120 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ed518-a791-4c35-ad2c-b4c83b7c17ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:15.480907 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ed518-a791-4c35-ad2c-b4c83b7c17ce admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:15.481286 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ed518-a791-4c35-ad2c-b4c83b7c17ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:15.481719 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ed518-a791-4c35-ad2c-b4c83b7c17ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:15.483203 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ed518-a791-4c35-ad2c-b4c83b7c17ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:15.484974 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ed518-a791-4c35-ad2c-b4c83b7c17ce admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:15.486776 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355335a-6086-4350-957a-52121c071e14 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:15.491961 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2ffbc-a10b-4025-973b-2c82a799f6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:15.492571 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2ffbc-a10b-4025-973b-2c82a799f6e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:15.492850 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2ffbc-a10b-4025-973b-2c82a799f6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:15.493232 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2ffbc-a10b-4025-973b-2c82a799f6e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:15.493950 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2ffbc-a10b-4025-973b-2c82a799f6e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:15.495852 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2ffbc-a10b-4025-973b-2c82a799f6e1 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:15.501653 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1011/2039] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:15.501653 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ed518-a791-4c35-ad2c-b4c83b7c17ce admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:15.511027 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ed518-a791-4c35-ad2c-b4c83b7c17ce admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:15.515983 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d6b7b-0d7a-445c-81ff-5385757825b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:15.516638 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d6b7b-0d7a-445c-81ff-5385757825b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:15.517038 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d6b7b-0d7a-445c-81ff-5385757825b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:15.517224 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d6b7b-0d7a-445c-81ff-5385757825b5 admin admin] PATH_INFO: `/v3/projects/aeca9ea778254f29a03a4c3ec124b0f6/users/7d315e24c9f54c9e9d9dd5815b0e0622/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:15.539141 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d6b7b-0d7a-445c-81ff-5385757825b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeca9ea778254f29a03a4c3ec124b0f6, user_id=7d315e24c9f54c9e9d9dd5815b0e0622, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:15.541254 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1029/2040] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:55:15 2022] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:15.542530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d6b7b-0d7a-445c-81ff-5385757825b5 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:15.545044 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2ffbc-a10b-4025-973b-2c82a799f6e1 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:15.562751 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1012/2041] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:55:15 2022] PUT /identity/v3/projects/aeca9ea778254f29a03a4c3ec124b0f6/users/7d315e24c9f54c9e9d9dd5815b0e0622/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:15.563616 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d6b7b-0d7a-445c-81ff-5385757825b5 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:15.576742 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:15.643476 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d6b7b-0d7a-445c-81ff-5385757825b5 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:15.649172 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56432df-fa7b-4a28-9d05-0c6bec63d444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:15.649937 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56432df-fa7b-4a28-9d05-0c6bec63d444 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:15.650314 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56432df-fa7b-4a28-9d05-0c6bec63d444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:15.650685 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56432df-fa7b-4a28-9d05-0c6bec63d444 admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:15.651426 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56432df-fa7b-4a28-9d05-0c6bec63d444 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:15.653678 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56432df-fa7b-4a28-9d05-0c6bec63d444 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:15.655805 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2ffbc-a10b-4025-973b-2c82a799f6e1 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:15.661173 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04064254-91b4-423b-ae36-7da644ae44ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:15.662711 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04064254-91b4-423b-ae36-7da644ae44ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:15.663367 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04064254-91b4-423b-ae36-7da644ae44ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:15.663792 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04064254-91b4-423b-ae36-7da644ae44ca admin admin] PATH_INFO: `/v3/projects/fb998ef2583e4984bbbe53cbe8e1deee/users/cae07c56193144ea8672d6e8cad7b3a2/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:15.684913 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1013/2042] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:55:15 2022] POST /identity/v3/users => generated 286 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:15.684913 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56432df-fa7b-4a28-9d05-0c6bec63d444 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:15.703641 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04064254-91b4-423b-ae36-7da644ae44ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb998ef2583e4984bbbe53cbe8e1deee, user_id=cae07c56193144ea8672d6e8cad7b3a2, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:15.707158 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04064254-91b4-423b-ae36-7da644ae44ca admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:15.711097 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56432df-fa7b-4a28-9d05-0c6bec63d444 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:15.724448 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180873d-3a21-452e-a868-eb1f79e7d9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:15.725418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180873d-3a21-452e-a868-eb1f79e7d9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:15.725562 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180873d-3a21-452e-a868-eb1f79e7d9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:15.725837 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180873d-3a21-452e-a868-eb1f79e7d9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:15.726552 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180873d-3a21-452e-a868-eb1f79e7d9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:15.730526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180873d-3a21-452e-a868-eb1f79e7d9d1 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:15.736890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1030/2043] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:55:15 2022] PUT /identity/v3/projects/fb998ef2583e4984bbbe53cbe8e1deee/users/cae07c56193144ea8672d6e8cad7b3a2/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:15.738362 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04064254-91b4-423b-ae36-7da644ae44ca admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:15.752649 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1014/2044] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:15.756098 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3934cd1-3dbe-4eff-8e70-d6605f38ea65 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:15.756098 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3934cd1-3dbe-4eff-8e70-d6605f38ea65 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:15.756098 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3934cd1-3dbe-4eff-8e70-d6605f38ea65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:15.796358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-f3934cd1-3dbe-4eff-8e70-d6605f38ea65 None None] MFA Rules not processed for user `cae07c56193144ea8672d6e8cad7b3a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:15.797639 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-f3934cd1-3dbe-4eff-8e70-d6605f38ea65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:15.848042 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04064254-91b4-423b-ae36-7da644ae44ca admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:15.874378 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd403230-8c05-4c42-bd88-a4016b7cd6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:15.875177 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd403230-8c05-4c42-bd88-a4016b7cd6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:15.875555 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd403230-8c05-4c42-bd88-a4016b7cd6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:15.875920 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd403230-8c05-4c42-bd88-a4016b7cd6a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:15.876805 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd403230-8c05-4c42-bd88-a4016b7cd6a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:15.878522 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd403230-8c05-4c42-bd88-a4016b7cd6a6 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:15.886544 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:15.895494 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1031/2045] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:15.906545 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd403230-8c05-4c42-bd88-a4016b7cd6a6 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:15.922850 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd403230-8c05-4c42-bd88-a4016b7cd6a6 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:15.930924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1015/2046] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:15.931986 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3934cd1-3dbe-4eff-8e70-d6605f38ea65 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:15.932272 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976a21e-e99e-4e3f-9b00-d58e0ece760c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:15.933250 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976a21e-e99e-4e3f-9b00-d58e0ece760c admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:15.933724 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976a21e-e99e-4e3f-9b00-d58e0ece760c admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:15.934214 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976a21e-e99e-4e3f-9b00-d58e0ece760c admin admin] PATH_INFO: `/v3/projects/aeca9ea778254f29a03a4c3ec124b0f6/users/7d315e24c9f54c9e9d9dd5815b0e0622/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:15.937454 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976a21e-e99e-4e3f-9b00-d58e0ece760c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeca9ea778254f29a03a4c3ec124b0f6, user_id=7d315e24c9f54c9e9d9dd5815b0e0622, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:15.941081 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976a21e-e99e-4e3f-9b00-d58e0ece760c admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:15.945690 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3934cd1-3dbe-4eff-8e70-d6605f38ea65 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:15.951554 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22bfd2-bdd5-4253-a08b-0514156b4fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:15.952271 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22bfd2-bdd5-4253-a08b-0514156b4fbc admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:15.952862 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22bfd2-bdd5-4253-a08b-0514156b4fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:15.953211 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22bfd2-bdd5-4253-a08b-0514156b4fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:15.954034 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22bfd2-bdd5-4253-a08b-0514156b4fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:15.959910 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1032/2047] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:55:15 2022] PUT /identity/v3/projects/aeca9ea778254f29a03a4c3ec124b0f6/users/7d315e24c9f54c9e9d9dd5815b0e0622/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:15.960531 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976a21e-e99e-4e3f-9b00-d58e0ece760c admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:15.962690 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-f976a21e-e99e-4e3f-9b00-d58e0ece760c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:15.964884 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22bfd2-bdd5-4253-a08b-0514156b4fbc admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:16.004576 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1016/2048] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:16.024729 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e67adb-bbfa-4fe7-976e-cdfd32bb546d None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:16.030715 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e67adb-bbfa-4fe7-976e-cdfd32bb546d None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:16.031866 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e67adb-bbfa-4fe7-976e-cdfd32bb546d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:16.054000 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976a21e-e99e-4e3f-9b00-d58e0ece760c admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:16.067641 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb9f1b-708e-4c5b-830d-61e8912a3089 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:16.071700 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb9f1b-708e-4c5b-830d-61e8912a3089 service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:16.072001 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb9f1b-708e-4c5b-830d-61e8912a3089 service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:16.072275 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb9f1b-708e-4c5b-830d-61e8912a3089 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:16.078319 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-b8e67adb-bbfa-4fe7-976e-cdfd32bb546d None None] MFA Rules not processed for user `7d315e24c9f54c9e9d9dd5815b0e0622`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:16.079679 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-b8e67adb-bbfa-4fe7-976e-cdfd32bb546d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:16.171472 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:16.186925 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1017/2049] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:16 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:16.188108 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e67adb-bbfa-4fe7-976e-cdfd32bb546d None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:16.199850 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb9f1b-708e-4c5b-830d-61e8912a3089 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:16.203548 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb9f1b-708e-4c5b-830d-61e8912a3089 service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:16.232857 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1033/2050] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:55:16.234298 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb9f1b-708e-4c5b-830d-61e8912a3089 service cinder] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:16.236227 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-8fbb9f1b-708e-4c5b-830d-61e8912a3089 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:16.249523 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb9f1b-708e-4c5b-830d-61e8912a3089 service cinder] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:16.255742 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56918d-22a6-4468-a3fd-d075abeec2aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:16.256571 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56918d-22a6-4468-a3fd-d075abeec2aa service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:16.256665 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56918d-22a6-4468-a3fd-d075abeec2aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:16.256974 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56918d-22a6-4468-a3fd-d075abeec2aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:16.275380 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56918d-22a6-4468-a3fd-d075abeec2aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:16.277487 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56918d-22a6-4468-a3fd-d075abeec2aa service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:16.293183 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1034/2051] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:16 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:55:16.315582 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e67adb-bbfa-4fe7-976e-cdfd32bb546d None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:16.324657 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb4e9a-93ad-48e9-a4ef-eb2b2c074b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:16.325663 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb4e9a-93ad-48e9-a4ef-eb2b2c074b80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:16.326257 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb4e9a-93ad-48e9-a4ef-eb2b2c074b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:16.326734 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb4e9a-93ad-48e9-a4ef-eb2b2c074b80 admin admin] PATH_INFO: `/v3/projects/afc06eb6efa540fa8d303ac1536224d2/users/cfbb13bbb744494badf69f0a5266e418/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:16.425860 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb4e9a-93ad-48e9-a4ef-eb2b2c074b80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afc06eb6efa540fa8d303ac1536224d2, user_id=cfbb13bbb744494badf69f0a5266e418, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:16.451199 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb4e9a-93ad-48e9-a4ef-eb2b2c074b80 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:16.487247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1018/2052] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:55:16 2022] PUT /identity/v3/projects/afc06eb6efa540fa8d303ac1536224d2/users/cfbb13bbb744494badf69f0a5266e418/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:16.493177 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8308daf-7f0e-432e-8fda-6b7dc7c854d0 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:16.493756 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8308daf-7f0e-432e-8fda-6b7dc7c854d0 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:16.493918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8308daf-7f0e-432e-8fda-6b7dc7c854d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:16.537652 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-f8308daf-7f0e-432e-8fda-6b7dc7c854d0 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:16.540123 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-f8308daf-7f0e-432e-8fda-6b7dc7c854d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:16.698008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1035/2053] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:16.725899 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb4e9a-93ad-48e9-a4ef-eb2b2c074b80 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:16.734210 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-8afb4e9a-93ad-48e9-a4ef-eb2b2c074b80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:16.914645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:16.935035 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8308daf-7f0e-432e-8fda-6b7dc7c854d0 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:16.947432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8308daf-7f0e-432e-8fda-6b7dc7c854d0 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:16.948789 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb4e9a-93ad-48e9-a4ef-eb2b2c074b80 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:16.953160 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299b46c-386a-4d8f-b6e5-2fa1484163ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:16.953840 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299b46c-386a-4d8f-b6e5-2fa1484163ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:16.954358 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299b46c-386a-4d8f-b6e5-2fa1484163ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:16.954637 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299b46c-386a-4d8f-b6e5-2fa1484163ff admin admin] PATH_INFO: `/v3/users/5044fbac33fa44f7bb7a8e219e82dc35` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:16.955771 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299b46c-386a-4d8f-b6e5-2fa1484163ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=5044fbac33fa44f7bb7a8e219e82dc35)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:16.957468 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5037f2e-d37d-4b07-a418-ea488ee6ed28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:16.958085 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5037f2e-d37d-4b07-a418-ea488ee6ed28 service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:16.958236 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299b46c-386a-4d8f-b6e5-2fa1484163ff admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:16.958410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5037f2e-d37d-4b07-a418-ea488ee6ed28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:16.958659 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5037f2e-d37d-4b07-a418-ea488ee6ed28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:16.984354 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5037f2e-d37d-4b07-a418-ea488ee6ed28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:16.986505 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5037f2e-d37d-4b07-a418-ea488ee6ed28 service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:17.016729 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1019/2054] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:55:17.021854 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-e299b46c-386a-4d8f-b6e5-2fa1484163ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5044fbac33fa44f7bb7a8e219e82dc35'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:17.038029 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-e299b46c-386a-4d8f-b6e5-2fa1484163ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5044fbac33fa44f7bb7a8e219e82dc35'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:17.039297 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-e299b46c-386a-4d8f-b6e5-2fa1484163ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5044fbac33fa44f7bb7a8e219e82dc35'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:17.050412 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-e299b46c-386a-4d8f-b6e5-2fa1484163ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5044fbac33fa44f7bb7a8e219e82dc35'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:17.066206 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-e299b46c-386a-4d8f-b6e5-2fa1484163ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5044fbac33fa44f7bb7a8e219e82dc35'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:17.085710 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1036/2055] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:55:16 2022] DELETE /identity/v3/users/5044fbac33fa44f7bb7a8e219e82dc35 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:17.088749 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb08a5c-7834-460b-baf8-267970445e87 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:17.089106 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb08a5c-7834-460b-baf8-267970445e87 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:17.089801 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb08a5c-7834-460b-baf8-267970445e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:17.127041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-0bb08a5c-7834-460b-baf8-267970445e87 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:17.128678 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-0bb08a5c-7834-460b-baf8-267970445e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:17.253179 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1020/2056] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:17.267790 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299b46c-386a-4d8f-b6e5-2fa1484163ff admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:17.269625 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-e299b46c-386a-4d8f-b6e5-2fa1484163ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:17.325303 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:17.347473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299b46c-386a-4d8f-b6e5-2fa1484163ff admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:17.353151 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cae619-741a-413e-81e7-cc4f6f8a0916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:17.355851 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cae619-741a-413e-81e7-cc4f6f8a0916 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:17.356230 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cae619-741a-413e-81e7-cc4f6f8a0916 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:17.356577 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cae619-741a-413e-81e7-cc4f6f8a0916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:17.367456 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cae619-741a-413e-81e7-cc4f6f8a0916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:17.368906 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cae619-741a-413e-81e7-cc4f6f8a0916 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:17.401364 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1037/2057] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:55:18.133727 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb08a5c-7834-460b-baf8-267970445e87 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:18.134987 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-0bb08a5c-7834-460b-baf8-267970445e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:18.153670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb08a5c-7834-460b-baf8-267970445e87 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:18.160696 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d3e8c-6afc-4932-8614-873d42203aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:18.162100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d3e8c-6afc-4932-8614-873d42203aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:18.162563 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d3e8c-6afc-4932-8614-873d42203aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:18.162984 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d3e8c-6afc-4932-8614-873d42203aaa admin admin] PATH_INFO: `/v3/projects/ec9602b7cfb2411cbb8d56bbe967f35e` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:18.164356 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d3e8c-6afc-4932-8614-873d42203aaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec9602b7cfb2411cbb8d56bbe967f35e)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:18.167219 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d3e8c-6afc-4932-8614-873d42203aaa admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:18.251718 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-bb3d3e8c-6afc-4932-8614-873d42203aaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec9602b7cfb2411cbb8d56bbe967f35e', 'request_id': 'req-bb3d3e8c-6afc-4932-8614-873d42203aaa'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:18.259283 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-bb3d3e8c-6afc-4932-8614-873d42203aaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec9602b7cfb2411cbb8d56bbe967f35e', 'request_id': 'req-bb3d3e8c-6afc-4932-8614-873d42203aaa'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:18.266954 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-bb3d3e8c-6afc-4932-8614-873d42203aaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec9602b7cfb2411cbb8d56bbe967f35e', 'request_id': 'req-bb3d3e8c-6afc-4932-8614-873d42203aaa'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:18.314937 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-bb3d3e8c-6afc-4932-8614-873d42203aaa admin admin] The token cache is being invalidate because project ec9602b7cfb2411cbb8d56bbe967f35e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:55:18.315230 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-bb3d3e8c-6afc-4932-8614-873d42203aaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:18.316666 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-bb3d3e8c-6afc-4932-8614-873d42203aaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:18.318598 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1021/2058] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:55:18 2022] DELETE /identity/v3/projects/ec9602b7cfb2411cbb8d56bbe967f35e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:18.322524 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cae619-741a-413e-81e7-cc4f6f8a0916 service neutron] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:18.341279 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cae619-741a-413e-81e7-cc4f6f8a0916 service neutron] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:18.423649 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28ce0b-9c51-4c6b-813e-9f67a40c8470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:18.424464 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28ce0b-9c51-4c6b-813e-9f67a40c8470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:18.424740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28ce0b-9c51-4c6b-813e-9f67a40c8470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:18.425006 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28ce0b-9c51-4c6b-813e-9f67a40c8470 admin admin] PATH_INFO: `/v3/users/7d315e24c9f54c9e9d9dd5815b0e0622` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:18.428260 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28ce0b-9c51-4c6b-813e-9f67a40c8470 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d315e24c9f54c9e9d9dd5815b0e0622)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:18.431670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28ce0b-9c51-4c6b-813e-9f67a40c8470 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:18.496094 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902400c-e28a-4db2-8640-731dd1ea91d9 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:18.496376 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902400c-e28a-4db2-8640-731dd1ea91d9 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:18.496649 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902400c-e28a-4db2-8640-731dd1ea91d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:18.569412 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-ac28ce0b-9c51-4c6b-813e-9f67a40c8470 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d315e24c9f54c9e9d9dd5815b0e0622'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:18.598101 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-9902400c-e28a-4db2-8640-731dd1ea91d9 None None] MFA Rules not processed for user `cfbb13bbb744494badf69f0a5266e418`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:18.609910 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-9902400c-e28a-4db2-8640-731dd1ea91d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:18.631134 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-ac28ce0b-9c51-4c6b-813e-9f67a40c8470 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d315e24c9f54c9e9d9dd5815b0e0622'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:18.632115 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-ac28ce0b-9c51-4c6b-813e-9f67a40c8470 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d315e24c9f54c9e9d9dd5815b0e0622'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:18.646550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-ac28ce0b-9c51-4c6b-813e-9f67a40c8470 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d315e24c9f54c9e9d9dd5815b0e0622'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:18.665599 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-ac28ce0b-9c51-4c6b-813e-9f67a40c8470 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d315e24c9f54c9e9d9dd5815b0e0622'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:18.687786 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1038/2059] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:55:18 2022] DELETE /identity/v3/users/7d315e24c9f54c9e9d9dd5815b0e0622 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:18.774029 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:18.786844 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1022/2060] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:18.787645 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28ce0b-9c51-4c6b-813e-9f67a40c8470 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:18.789900 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-ac28ce0b-9c51-4c6b-813e-9f67a40c8470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:18.962740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28ce0b-9c51-4c6b-813e-9f67a40c8470 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:18.983279 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c151946-aec4-4447-a77f-101a2a570d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:18.984927 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c151946-aec4-4447-a77f-101a2a570d3f admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:18.985626 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c151946-aec4-4447-a77f-101a2a570d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:18.985626 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c151946-aec4-4447-a77f-101a2a570d3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:18.986412 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c151946-aec4-4447-a77f-101a2a570d3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:18.991097 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c151946-aec4-4447-a77f-101a2a570d3f admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:19.007228 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:19.048330 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1039/2061] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:55:18 2022] POST /identity/v3/projects => generated 373 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:19.057584 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902400c-e28a-4db2-8640-731dd1ea91d9 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:19.097150 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902400c-e28a-4db2-8640-731dd1ea91d9 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:19.267511 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4ace4-6112-4980-9bf2-25c59f663a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:19.268461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4ace4-6112-4980-9bf2-25c59f663a97 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:19.268920 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4ace4-6112-4980-9bf2-25c59f663a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:19.269514 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4ace4-6112-4980-9bf2-25c59f663a97 admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:19.271329 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4ace4-6112-4980-9bf2-25c59f663a97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:19.275019 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4ace4-6112-4980-9bf2-25c59f663a97 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:19.329263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1023/2062] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:55:19 2022] POST /identity/v3/users => generated 293 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:19.334882 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c151946-aec4-4447-a77f-101a2a570d3f admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:19.381024 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4ace4-6112-4980-9bf2-25c59f663a97 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:19.381289 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c151946-aec4-4447-a77f-101a2a570d3f admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:19.384901 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-55c4ace4-6112-4980-9bf2-25c59f663a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:19.390027 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530a7e2-8522-4a5f-9f99-2d817904de70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:19.391000 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530a7e2-8522-4a5f-9f99-2d817904de70 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:19.391469 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530a7e2-8522-4a5f-9f99-2d817904de70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:19.391924 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530a7e2-8522-4a5f-9f99-2d817904de70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:19.393084 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530a7e2-8522-4a5f-9f99-2d817904de70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:19.396096 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530a7e2-8522-4a5f-9f99-2d817904de70 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:19.415681 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4ace4-6112-4980-9bf2-25c59f663a97 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:19.423882 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8a411-dbce-44f6-b847-63c3aac7dc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:19.425827 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8a411-dbce-44f6-b847-63c3aac7dc22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:19.425991 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1040/2063] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:19.427516 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8a411-dbce-44f6-b847-63c3aac7dc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:19.428017 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8a411-dbce-44f6-b847-63c3aac7dc22 admin admin] PATH_INFO: `/v3/projects/aeca9ea778254f29a03a4c3ec124b0f6` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:19.430057 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530a7e2-8522-4a5f-9f99-2d817904de70 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:19.430366 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac8a411-dbce-44f6-b847-63c3aac7dc22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aeca9ea778254f29a03a4c3ec124b0f6)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:19.434242 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac8a411-dbce-44f6-b847-63c3aac7dc22 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:19.441707 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530a7e2-8522-4a5f-9f99-2d817904de70 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:19.447315 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ccc51-2d62-4422-b55a-cd8019e5ab0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:19.447990 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ccc51-2d62-4422-b55a-cd8019e5ab0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:19.448266 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ccc51-2d62-4422-b55a-cd8019e5ab0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:19.448547 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ccc51-2d62-4422-b55a-cd8019e5ab0d admin admin] PATH_INFO: `/v3/projects/cfc3f6622e974c4ca99a8ae6bca9ce35/users/f9ec421b02384e27bb31cd2ac1de1880/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:19.479253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ccc51-2d62-4422-b55a-cd8019e5ab0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfc3f6622e974c4ca99a8ae6bca9ce35, user_id=f9ec421b02384e27bb31cd2ac1de1880, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:19.482349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ccc51-2d62-4422-b55a-cd8019e5ab0d admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:19.517222 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1041/2064] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:55:19 2022] PUT /identity/v3/projects/cfc3f6622e974c4ca99a8ae6bca9ce35/users/f9ec421b02384e27bb31cd2ac1de1880/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:19.522008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ccc51-2d62-4422-b55a-cd8019e5ab0d admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:19.557916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-eac8a411-dbce-44f6-b847-63c3aac7dc22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeca9ea778254f29a03a4c3ec124b0f6', 'request_id': 'req-eac8a411-dbce-44f6-b847-63c3aac7dc22'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:19.574338 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-eac8a411-dbce-44f6-b847-63c3aac7dc22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeca9ea778254f29a03a4c3ec124b0f6', 'request_id': 'req-eac8a411-dbce-44f6-b847-63c3aac7dc22'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:19.584638 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-eac8a411-dbce-44f6-b847-63c3aac7dc22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeca9ea778254f29a03a4c3ec124b0f6', 'request_id': 'req-eac8a411-dbce-44f6-b847-63c3aac7dc22'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:19.603946 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-eac8a411-dbce-44f6-b847-63c3aac7dc22 admin admin] The token cache is being invalidate because project aeca9ea778254f29a03a4c3ec124b0f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:55:19.604649 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-eac8a411-dbce-44f6-b847-63c3aac7dc22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:19.605478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-eac8a411-dbce-44f6-b847-63c3aac7dc22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:19.607510 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1024/2065] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:55:19 2022] DELETE /identity/v3/projects/aeca9ea778254f29a03a4c3ec124b0f6 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:19.615129 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0aa694-cade-4a82-b633-4d848d5c8541 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:19.615533 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0aa694-cade-4a82-b633-4d848d5c8541 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:19.616479 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0aa694-cade-4a82-b633-4d848d5c8541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:19.642491 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-1f0aa694-cade-4a82-b633-4d848d5c8541 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:19.643706 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-1f0aa694-cade-4a82-b633-4d848d5c8541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:19.655558 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ccc51-2d62-4422-b55a-cd8019e5ab0d admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:19.725635 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1025/2066] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:19.734123 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579b997-ae25-4359-9db6-b6ce7162223b None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:19.734414 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579b997-ae25-4359-9db6-b6ce7162223b None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:19.734689 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579b997-ae25-4359-9db6-b6ce7162223b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:19.750897 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6938204-e456-40fe-8820-d25723ff77a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:19.751518 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6938204-e456-40fe-8820-d25723ff77a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:19.751798 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6938204-e456-40fe-8820-d25723ff77a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:19.752065 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6938204-e456-40fe-8820-d25723ff77a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:19.752724 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6938204-e456-40fe-8820-d25723ff77a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:19.754610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6938204-e456-40fe-8820-d25723ff77a9 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:19.755555 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-7579b997-ae25-4359-9db6-b6ce7162223b None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:19.757060 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-7579b997-ae25-4359-9db6-b6ce7162223b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:19.765697 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1026/2067] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:55:19.767004 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1042/2068] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 10:55:19.769970 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579b997-ae25-4359-9db6-b6ce7162223b None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:19.773207 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6938204-e456-40fe-8820-d25723ff77a9 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:19.775412 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-f6938204-e456-40fe-8820-d25723ff77a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:19.776921 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:19.785496 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579b997-ae25-4359-9db6-b6ce7162223b None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:19.794733 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df989862-3350-4b69-b4bf-dd6cc9bf9acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:19.795784 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df989862-3350-4b69-b4bf-dd6cc9bf9acb admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:19.796297 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df989862-3350-4b69-b4bf-dd6cc9bf9acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:19.796802 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df989862-3350-4b69-b4bf-dd6cc9bf9acb admin admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:19.798237 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df989862-3350-4b69-b4bf-dd6cc9bf9acb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:55:19.798237 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df989862-3350-4b69-b4bf-dd6cc9bf9acb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:19.798666 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6938204-e456-40fe-8820-d25723ff77a9 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:19.799473 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df989862-3350-4b69-b4bf-dd6cc9bf9acb admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:19.803864 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec3d92-1838-47d4-8779-520aa02ebc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:19.804529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec3d92-1838-47d4-8779-520aa02ebc5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:19.804808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec3d92-1838-47d4-8779-520aa02ebc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:19.805084 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec3d92-1838-47d4-8779-520aa02ebc5c admin admin] PATH_INFO: `/v3/projects/cfc3f6622e974c4ca99a8ae6bca9ce35/users/f9ec421b02384e27bb31cd2ac1de1880/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:19.807069 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec3d92-1838-47d4-8779-520aa02ebc5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfc3f6622e974c4ca99a8ae6bca9ce35, user_id=f9ec421b02384e27bb31cd2ac1de1880, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:19.809885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec3d92-1838-47d4-8779-520aa02ebc5c admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:19.812259 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1027/2069] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:55:19.816498 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df989862-3350-4b69-b4bf-dd6cc9bf9acb admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:19.826685 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df989862-3350-4b69-b4bf-dd6cc9bf9acb admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:19.827076 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1043/2070] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:55:19 2022] PUT /identity/v3/projects/cfc3f6622e974c4ca99a8ae6bca9ce35/users/f9ec421b02384e27bb31cd2ac1de1880/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 10:55:19.953455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d297954-9254-47e6-99ef-f7d5097005ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:19.954504 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d297954-9254-47e6-99ef-f7d5097005ac admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:19.954854 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d297954-9254-47e6-99ef-f7d5097005ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:19.955187 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d297954-9254-47e6-99ef-f7d5097005ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:19.956386 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d297954-9254-47e6-99ef-f7d5097005ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:19.962179 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d297954-9254-47e6-99ef-f7d5097005ac admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:20.014871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1028/2071] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:55:19 2022] POST /identity/v3/projects => generated 365 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 10:55:20.018914 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec3d92-1838-47d4-8779-520aa02ebc5c admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:20.035825 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec3d92-1838-47d4-8779-520aa02ebc5c admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:20.109515 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:20.144729 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5211c-4953-47f0-bf1e-c383be675b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:20.145265 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5211c-4953-47f0-bf1e-c383be675b2d admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:20.145684 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5211c-4953-47f0-bf1e-c383be675b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:20.145963 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5211c-4953-47f0-bf1e-c383be675b2d admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:20.146775 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5211c-4953-47f0-bf1e-c383be675b2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:20.148777 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5211c-4953-47f0-bf1e-c383be675b2d admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:20.179896 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1044/2072] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:55:20 2022] POST /identity/v3/users => generated 283 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 10:55:20.183801 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d297954-9254-47e6-99ef-f7d5097005ac admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:20.197573 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d297954-9254-47e6-99ef-f7d5097005ac admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:20.202543 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77360d19-30a8-46e9-849d-9a4f1946d324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:20.203164 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77360d19-30a8-46e9-849d-9a4f1946d324 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:20.203443 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77360d19-30a8-46e9-849d-9a4f1946d324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:20.203714 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77360d19-30a8-46e9-849d-9a4f1946d324 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:20.204918 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77360d19-30a8-46e9-849d-9a4f1946d324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:20.206613 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77360d19-30a8-46e9-849d-9a4f1946d324 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:20.219385 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1029/2073] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 10:55:20.232364 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5211c-4953-47f0-bf1e-c383be675b2d admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:20.264345 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5211c-4953-47f0-bf1e-c383be675b2d admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:20.271672 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a83c99-cde5-4e61-9672-feea5a5308bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:20.273091 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a83c99-cde5-4e61-9672-feea5a5308bb admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:20.273732 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a83c99-cde5-4e61-9672-feea5a5308bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:20.274153 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a83c99-cde5-4e61-9672-feea5a5308bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:20.275080 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a83c99-cde5-4e61-9672-feea5a5308bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:20.289206 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a83c99-cde5-4e61-9672-feea5a5308bb admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:20.320294 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1045/2074] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:20 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:20.322733 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77360d19-30a8-46e9-849d-9a4f1946d324 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:20.344085 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77360d19-30a8-46e9-849d-9a4f1946d324 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:20.365094 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa3bf6-e379-4dd5-ac72-0329eee90031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:20.370164 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa3bf6-e379-4dd5-ac72-0329eee90031 admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:20.370988 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa3bf6-e379-4dd5-ac72-0329eee90031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:20.371418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa3bf6-e379-4dd5-ac72-0329eee90031 admin admin] PATH_INFO: `/v3/projects/e129c6847ebb45cdb772c49767ce9056/users/1ccf24d06b324d9fa8652c5d7d307331/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:20.404102 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa3bf6-e379-4dd5-ac72-0329eee90031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e129c6847ebb45cdb772c49767ce9056, user_id=1ccf24d06b324d9fa8652c5d7d307331, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:20.411965 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa3bf6-e379-4dd5-ac72-0329eee90031 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:20.447218 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1030/2075] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:55:20 2022] PUT /identity/v3/projects/e129c6847ebb45cdb772c49767ce9056/users/1ccf24d06b324d9fa8652c5d7d307331/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:20.458303 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106f382-fcf3-4ee0-b846-911a5bd3a28d None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:20.459333 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106f382-fcf3-4ee0-b846-911a5bd3a28d None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:20.459773 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106f382-fcf3-4ee0-b846-911a5bd3a28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:20.525497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-d106f382-fcf3-4ee0-b846-911a5bd3a28d None None] MFA Rules not processed for user `1ccf24d06b324d9fa8652c5d7d307331`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:20.530065 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-d106f382-fcf3-4ee0-b846-911a5bd3a28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:20.733739 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1046/2076] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:20.741895 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa3bf6-e379-4dd5-ac72-0329eee90031 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:20.899203 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa3bf6-e379-4dd5-ac72-0329eee90031 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:20.916781 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502a18f-3a0c-4b72-bb00-5cf3871264a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:20.917038 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502a18f-3a0c-4b72-bb00-5cf3871264a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:20.917340 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502a18f-3a0c-4b72-bb00-5cf3871264a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:20.917621 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502a18f-3a0c-4b72-bb00-5cf3871264a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:20.918263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502a18f-3a0c-4b72-bb00-5cf3871264a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:20.920367 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502a18f-3a0c-4b72-bb00-5cf3871264a2 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:20.941746 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9854b0-f003-4752-8c5a-3d843f601434 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:20.942095 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9854b0-f003-4752-8c5a-3d843f601434 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:20.942373 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9854b0-f003-4752-8c5a-3d843f601434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:20.969365 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1031/2077] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:55:20 2022] POST /identity/v3/projects => generated 367 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:20.972732 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502a18f-3a0c-4b72-bb00-5cf3871264a2 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:21.013953 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-4b9854b0-f003-4752-8c5a-3d843f601434 None None] MFA Rules not processed for user `f9ec421b02384e27bb31cd2ac1de1880`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:21.015451 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-4b9854b0-f003-4752-8c5a-3d843f601434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:21.043278 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:21.095026 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502a18f-3a0c-4b72-bb00-5cf3871264a2 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:21.102922 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393fbb2-9eaf-445c-80a6-5a2928836f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:21.103900 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393fbb2-9eaf-445c-80a6-5a2928836f0e admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:21.104230 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393fbb2-9eaf-445c-80a6-5a2928836f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:21.104877 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393fbb2-9eaf-445c-80a6-5a2928836f0e admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:21.105973 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393fbb2-9eaf-445c-80a6-5a2928836f0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:21.107926 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393fbb2-9eaf-445c-80a6-5a2928836f0e admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:21.134286 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1047/2078] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:21.143532 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1032/2079] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:55:20 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:21.147940 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efa12e-ff5c-4f3c-b6f0-92eadd7cc458 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:21.148229 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efa12e-ff5c-4f3c-b6f0-92eadd7cc458 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:21.148506 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efa12e-ff5c-4f3c-b6f0-92eadd7cc458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:21.154363 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9854b0-f003-4752-8c5a-3d843f601434 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:21.171520 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-14efa12e-ff5c-4f3c-b6f0-92eadd7cc458 None None] MFA Rules not processed for user `cfbb13bbb744494badf69f0a5266e418`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:21.172739 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9854b0-f003-4752-8c5a-3d843f601434 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:21.172877 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-14efa12e-ff5c-4f3c-b6f0-92eadd7cc458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:21.180387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049d66b-c19b-40f5-9664-3c88dd716729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:21.181437 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049d66b-c19b-40f5-9664-3c88dd716729 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:21.182144 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049d66b-c19b-40f5-9664-3c88dd716729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:21.182815 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049d66b-c19b-40f5-9664-3c88dd716729 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:21.185194 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049d66b-c19b-40f5-9664-3c88dd716729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:21.185770 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049d66b-c19b-40f5-9664-3c88dd716729 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:21.208301 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1048/2080] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:21.212232 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049d66b-c19b-40f5-9664-3c88dd716729 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:21.227143 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049d66b-c19b-40f5-9664-3c88dd716729 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:21.240597 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bd56d-d4cb-4e6a-a8e7-d93e920fddef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:21.240597 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bd56d-d4cb-4e6a-a8e7-d93e920fddef admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:21.240913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bd56d-d4cb-4e6a-a8e7-d93e920fddef admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:21.241290 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bd56d-d4cb-4e6a-a8e7-d93e920fddef admin admin] PATH_INFO: `/v3/projects/854a16ce168e4cabaaaf36639c756573/users/804f6b5ad0cf465c890c7ee4b600dfde/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:21.257592 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1033/2081] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:21.266693 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efa12e-ff5c-4f3c-b6f0-92eadd7cc458 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:21.270862 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-14efa12e-ff5c-4f3c-b6f0-92eadd7cc458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:21.280155 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20bd56d-d4cb-4e6a-a8e7-d93e920fddef admin admin] RBAC: Authorizing `identity:create_grant(project_id=854a16ce168e4cabaaaf36639c756573, user_id=804f6b5ad0cf465c890c7ee4b600dfde, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:21.284558 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20bd56d-d4cb-4e6a-a8e7-d93e920fddef admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:21.317941 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1049/2082] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:55:21 2022] PUT /identity/v3/projects/854a16ce168e4cabaaaf36639c756573/users/804f6b5ad0cf465c890c7ee4b600dfde/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:21.322905 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bd56d-d4cb-4e6a-a8e7-d93e920fddef admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:21.351062 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:21.449821 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bd56d-d4cb-4e6a-a8e7-d93e920fddef admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:21.458679 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6e8f3-6334-4c6b-9df4-14d5827b4174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:21.459525 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6e8f3-6334-4c6b-9df4-14d5827b4174 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:21.460388 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6e8f3-6334-4c6b-9df4-14d5827b4174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:21.460388 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6e8f3-6334-4c6b-9df4-14d5827b4174 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:21.461604 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6e8f3-6334-4c6b-9df4-14d5827b4174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:21.463601 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6e8f3-6334-4c6b-9df4-14d5827b4174 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:21.491843 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1050/2083] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:21.494975 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6e8f3-6334-4c6b-9df4-14d5827b4174 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:21.498655 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efa12e-ff5c-4f3c-b6f0-92eadd7cc458 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:21.510425 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6e8f3-6334-4c6b-9df4-14d5827b4174 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:21.518286 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3b8ae-39bd-4713-aa51-5c54acd2a95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:21.519711 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3b8ae-39bd-4713-aa51-5c54acd2a95b admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:21.519888 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3b8ae-39bd-4713-aa51-5c54acd2a95b admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:21.520136 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3b8ae-39bd-4713-aa51-5c54acd2a95b admin admin] PATH_INFO: `/v3/projects/854a16ce168e4cabaaaf36639c756573/users/804f6b5ad0cf465c890c7ee4b600dfde/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:21.522367 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3b8ae-39bd-4713-aa51-5c54acd2a95b admin admin] RBAC: Authorizing `identity:create_grant(project_id=854a16ce168e4cabaaaf36639c756573, user_id=804f6b5ad0cf465c890c7ee4b600dfde, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:21.525728 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3b8ae-39bd-4713-aa51-5c54acd2a95b admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:21.545351 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1051/2084] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:55:21 2022] PUT /identity/v3/projects/854a16ce168e4cabaaaf36639c756573/users/804f6b5ad0cf465c890c7ee4b600dfde/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 10:55:21.553830 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf7398-f29b-4edc-94ab-790c5536fd88 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:21.557348 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf7398-f29b-4edc-94ab-790c5536fd88 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:21.557618 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf7398-f29b-4edc-94ab-790c5536fd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:21.605362 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-22cf7398-f29b-4edc-94ab-790c5536fd88 None None] MFA Rules not processed for user `804f6b5ad0cf465c890c7ee4b600dfde`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:21.606767 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-22cf7398-f29b-4edc-94ab-790c5536fd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:21.630768 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:21.649119 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a3c0f-079d-4ad3-9eb4-2897780629bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:21.649836 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a3c0f-079d-4ad3-9eb4-2897780629bc service nova] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:21.650180 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a3c0f-079d-4ad3-9eb4-2897780629bc service nova] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:21.650925 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a3c0f-079d-4ad3-9eb4-2897780629bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:21.654502 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-8d8a3c0f-079d-4ad3-9eb4-2897780629bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:21.686680 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1052/2085] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:21 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:55:21.698232 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf7398-f29b-4edc-94ab-790c5536fd88 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:21.699612 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-22cf7398-f29b-4edc-94ab-790c5536fd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:21.730657 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a3c0f-079d-4ad3-9eb4-2897780629bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:21.732276 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a3c0f-079d-4ad3-9eb4-2897780629bc service nova] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:21.744072 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1034/2086] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 10:55:21.774591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf7398-f29b-4edc-94ab-790c5536fd88 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:21.779550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7ee9c-887d-449a-a0fb-6173a6714c1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:21.780083 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7ee9c-887d-449a-a0fb-6173a6714c1e service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:21.780516 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7ee9c-887d-449a-a0fb-6173a6714c1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:21.780836 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7ee9c-887d-449a-a0fb-6173a6714c1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:21.791564 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7ee9c-887d-449a-a0fb-6173a6714c1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:21.793115 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7ee9c-887d-449a-a0fb-6173a6714c1e service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:21.810584 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1053/2087] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:21 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 10:55:21.908857 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a3c0f-079d-4ad3-9eb4-2897780629bc service nova] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:21.998738 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a3c0f-079d-4ad3-9eb4-2897780629bc service nova] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:22.006333 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a725bb-d9c6-45f5-a507-f309bc0e6979 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:22.007726 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a725bb-d9c6-45f5-a507-f309bc0e6979 service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:22.008357 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a725bb-d9c6-45f5-a507-f309bc0e6979 service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:22.008799 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a725bb-d9c6-45f5-a507-f309bc0e6979 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:22.095171 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a725bb-d9c6-45f5-a507-f309bc0e6979 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:22.097848 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a725bb-d9c6-45f5-a507-f309bc0e6979 service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:22.110813 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1035/2088] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 10:55:27.727797 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7ee9c-887d-449a-a0fb-6173a6714c1e service cinder] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:27.743565 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:27.826253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7ee9c-887d-449a-a0fb-6173a6714c1e service cinder] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:27.833800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07795c07-f4ed-45ba-a459-9265d7378c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:27.834574 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07795c07-f4ed-45ba-a459-9265d7378c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:27.834807 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07795c07-f4ed-45ba-a459-9265d7378c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:27.835080 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07795c07-f4ed-45ba-a459-9265d7378c6f admin admin] PATH_INFO: `/v3/users/1ccf24d06b324d9fa8652c5d7d307331` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:27.836259 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07795c07-f4ed-45ba-a459-9265d7378c6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ccf24d06b324d9fa8652c5d7d307331)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:27.838214 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07795c07-f4ed-45ba-a459-9265d7378c6f admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:27.888665 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-07795c07-f4ed-45ba-a459-9265d7378c6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ccf24d06b324d9fa8652c5d7d307331'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:27.917753 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-07795c07-f4ed-45ba-a459-9265d7378c6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ccf24d06b324d9fa8652c5d7d307331'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:27.919289 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-07795c07-f4ed-45ba-a459-9265d7378c6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ccf24d06b324d9fa8652c5d7d307331'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:27.928593 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-07795c07-f4ed-45ba-a459-9265d7378c6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ccf24d06b324d9fa8652c5d7d307331'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:27.936569 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-07795c07-f4ed-45ba-a459-9265d7378c6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ccf24d06b324d9fa8652c5d7d307331'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:27.943487 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1054/2089] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:55:27 2022] DELETE /identity/v3/users/1ccf24d06b324d9fa8652c5d7d307331 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:27.947917 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478d4db-e6d7-44cf-864e-939aed0f8038 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:27.948421 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478d4db-e6d7-44cf-864e-939aed0f8038 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:27.948516 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478d4db-e6d7-44cf-864e-939aed0f8038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:27.967822 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-a478d4db-e6d7-44cf-864e-939aed0f8038 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:27.969048 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a478d4db-e6d7-44cf-864e-939aed0f8038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:28.021219 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:28.038897 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1036/2090] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:28.048740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07795c07-f4ed-45ba-a459-9265d7378c6f admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:28.050220 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-07795c07-f4ed-45ba-a459-9265d7378c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:28.112237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07795c07-f4ed-45ba-a459-9265d7378c6f admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:28.116859 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b87b0-0e54-4d5b-9f23-d0c8699d4c8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:28.117606 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b87b0-0e54-4d5b-9f23-d0c8699d4c8d service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:28.117946 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b87b0-0e54-4d5b-9f23-d0c8699d4c8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:28.118279 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b87b0-0e54-4d5b-9f23-d0c8699d4c8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:28.129791 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b87b0-0e54-4d5b-9f23-d0c8699d4c8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:28.132014 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b87b0-0e54-4d5b-9f23-d0c8699d4c8d service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:28.143829 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1055/2091] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:55:28.536931 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478d4db-e6d7-44cf-864e-939aed0f8038 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:28.539032 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a478d4db-e6d7-44cf-864e-939aed0f8038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:28.561582 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478d4db-e6d7-44cf-864e-939aed0f8038 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:28.570252 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcde7d8-315f-486d-b43c-66b6d7a0b5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:28.570920 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcde7d8-315f-486d-b43c-66b6d7a0b5e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:28.571198 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcde7d8-315f-486d-b43c-66b6d7a0b5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:28.571762 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcde7d8-315f-486d-b43c-66b6d7a0b5e7 admin admin] PATH_INFO: `/v3/projects/e129c6847ebb45cdb772c49767ce9056` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:28.573900 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcde7d8-315f-486d-b43c-66b6d7a0b5e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e129c6847ebb45cdb772c49767ce9056)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:28.576323 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcde7d8-315f-486d-b43c-66b6d7a0b5e7 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:28.641192 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-2fcde7d8-315f-486d-b43c-66b6d7a0b5e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e129c6847ebb45cdb772c49767ce9056', 'request_id': 'req-2fcde7d8-315f-486d-b43c-66b6d7a0b5e7'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:28.652180 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-2fcde7d8-315f-486d-b43c-66b6d7a0b5e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e129c6847ebb45cdb772c49767ce9056', 'request_id': 'req-2fcde7d8-315f-486d-b43c-66b6d7a0b5e7'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:28.662528 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-2fcde7d8-315f-486d-b43c-66b6d7a0b5e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e129c6847ebb45cdb772c49767ce9056', 'request_id': 'req-2fcde7d8-315f-486d-b43c-66b6d7a0b5e7'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:28.678420 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-2fcde7d8-315f-486d-b43c-66b6d7a0b5e7 admin admin] The token cache is being invalidate because project e129c6847ebb45cdb772c49767ce9056 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:55:28.678714 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-2fcde7d8-315f-486d-b43c-66b6d7a0b5e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:28.679489 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-2fcde7d8-315f-486d-b43c-66b6d7a0b5e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:28.681272 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1037/2092] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:55:28 2022] DELETE /identity/v3/projects/e129c6847ebb45cdb772c49767ce9056 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:28.685463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b87b0-0e54-4d5b-9f23-d0c8699d4c8d service neutron] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:28.697045 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b87b0-0e54-4d5b-9f23-d0c8699d4c8d service neutron] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:28.734625 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:28.762574 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87f8e5-ffa6-4b57-a328-21e6971f6278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:28.763208 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87f8e5-ffa6-4b57-a328-21e6971f6278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:28.763483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87f8e5-ffa6-4b57-a328-21e6971f6278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:28.763799 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87f8e5-ffa6-4b57-a328-21e6971f6278 admin admin] PATH_INFO: `/v3/users/804f6b5ad0cf465c890c7ee4b600dfde` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:28.764863 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87f8e5-ffa6-4b57-a328-21e6971f6278 admin admin] RBAC: Authorizing `identity:delete_user(user_id=804f6b5ad0cf465c890c7ee4b600dfde)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:28.766871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87f8e5-ffa6-4b57-a328-21e6971f6278 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:28.819411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-bb87f8e5-ffa6-4b57-a328-21e6971f6278 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '804f6b5ad0cf465c890c7ee4b600dfde'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:28.835342 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-bb87f8e5-ffa6-4b57-a328-21e6971f6278 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '804f6b5ad0cf465c890c7ee4b600dfde'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:28.836089 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-bb87f8e5-ffa6-4b57-a328-21e6971f6278 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '804f6b5ad0cf465c890c7ee4b600dfde'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:28.850562 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-bb87f8e5-ffa6-4b57-a328-21e6971f6278 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '804f6b5ad0cf465c890c7ee4b600dfde'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:28.861891 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-bb87f8e5-ffa6-4b57-a328-21e6971f6278 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '804f6b5ad0cf465c890c7ee4b600dfde'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:28.870651 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1056/2093] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:55:28 2022] DELETE /identity/v3/users/804f6b5ad0cf465c890c7ee4b600dfde => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 10:55:29.609574 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcde7d8-315f-486d-b43c-66b6d7a0b5e7 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:29.611769 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-2fcde7d8-315f-486d-b43c-66b6d7a0b5e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:29.632737 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcde7d8-315f-486d-b43c-66b6d7a0b5e7 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:29.717253 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a189f-4eb4-4cd9-a32a-7d95cad37953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:29.717947 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a189f-4eb4-4cd9-a32a-7d95cad37953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:29.718225 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a189f-4eb4-4cd9-a32a-7d95cad37953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:29.718838 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a189f-4eb4-4cd9-a32a-7d95cad37953 admin admin] PATH_INFO: `/v3/projects/854a16ce168e4cabaaaf36639c756573` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:29.719737 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a189f-4eb4-4cd9-a32a-7d95cad37953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=854a16ce168e4cabaaaf36639c756573)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:29.721756 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a189f-4eb4-4cd9-a32a-7d95cad37953 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:29.786842 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-a57a189f-4eb4-4cd9-a32a-7d95cad37953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '854a16ce168e4cabaaaf36639c756573', 'request_id': 'req-a57a189f-4eb4-4cd9-a32a-7d95cad37953'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:29.794504 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-a57a189f-4eb4-4cd9-a32a-7d95cad37953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '854a16ce168e4cabaaaf36639c756573', 'request_id': 'req-a57a189f-4eb4-4cd9-a32a-7d95cad37953'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:29.817736 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-a57a189f-4eb4-4cd9-a32a-7d95cad37953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '854a16ce168e4cabaaaf36639c756573', 'request_id': 'req-a57a189f-4eb4-4cd9-a32a-7d95cad37953'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:29.838398 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-a57a189f-4eb4-4cd9-a32a-7d95cad37953 admin admin] The token cache is being invalidate because project 854a16ce168e4cabaaaf36639c756573 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:55:29.838751 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-a57a189f-4eb4-4cd9-a32a-7d95cad37953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:29.839815 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-a57a189f-4eb4-4cd9-a32a-7d95cad37953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:29.844913 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1038/2094] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:55:29 2022] DELETE /identity/v3/projects/854a16ce168e4cabaaaf36639c756573 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:29.846710 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58b4e3-7b9c-4c26-878d-bc0308081227 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:29.847232 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58b4e3-7b9c-4c26-878d-bc0308081227 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:29.847600 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58b4e3-7b9c-4c26-878d-bc0308081227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:29.872414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-cb58b4e3-7b9c-4c26-878d-bc0308081227 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:29.873727 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-cb58b4e3-7b9c-4c26-878d-bc0308081227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:29.940406 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1057/2095] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:29.949023 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a3289-e7f9-4687-80f5-ef364697e5a9 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:29.949383 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a3289-e7f9-4687-80f5-ef364697e5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:29.949665 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a3289-e7f9-4687-80f5-ef364697e5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:29.959145 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:29.971690 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-ce1a3289-e7f9-4687-80f5-ef364697e5a9 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:29.973101 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ce1a3289-e7f9-4687-80f5-ef364697e5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:29.982042 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1039/2096] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:29.986029 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58b4e3-7b9c-4c26-878d-bc0308081227 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:29.996414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58b4e3-7b9c-4c26-878d-bc0308081227 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:30.000878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99408cc0-4a30-4d52-9997-c39f858e44ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:30.001504 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99408cc0-4a30-4d52-9997-c39f858e44ba admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:30.001785 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99408cc0-4a30-4d52-9997-c39f858e44ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:30.002060 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99408cc0-4a30-4d52-9997-c39f858e44ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:30.002711 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99408cc0-4a30-4d52-9997-c39f858e44ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:55:30.003004 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99408cc0-4a30-4d52-9997-c39f858e44ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:30.004864 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99408cc0-4a30-4d52-9997-c39f858e44ba admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:30.017444 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1058/2097] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:55:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:55:30.021814 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a3289-e7f9-4687-80f5-ef364697e5a9 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:30.031098 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a3289-e7f9-4687-80f5-ef364697e5a9 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:30.035817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e04c2-05a0-4c6b-95d4-c14c92e2a2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:30.036929 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e04c2-05a0-4c6b-95d4-c14c92e2a2e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:30.037205 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e04c2-05a0-4c6b-95d4-c14c92e2a2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:30.037511 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e04c2-05a0-4c6b-95d4-c14c92e2a2e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:30.038199 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e04c2-05a0-4c6b-95d4-c14c92e2a2e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:30.049174 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e04c2-05a0-4c6b-95d4-c14c92e2a2e6 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:30.083553 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1040/2098] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:55:30 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:30.087874 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99408cc0-4a30-4d52-9997-c39f858e44ba admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:30.112665 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99408cc0-4a30-4d52-9997-c39f858e44ba admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:30.193766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:30.232820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba107c-23da-4c62-a110-d808cd90a99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:30.236258 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba107c-23da-4c62-a110-d808cd90a99d admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:30.236546 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba107c-23da-4c62-a110-d808cd90a99d admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:30.236822 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba107c-23da-4c62-a110-d808cd90a99d admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:30.238354 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba107c-23da-4c62-a110-d808cd90a99d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:30.244093 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba107c-23da-4c62-a110-d808cd90a99d admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:30.292401 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1059/2099] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:55:30 2022] POST /identity/v3/users => generated 286 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 10:55:30.293635 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e04c2-05a0-4c6b-95d4-c14c92e2a2e6 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:30.316235 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e04c2-05a0-4c6b-95d4-c14c92e2a2e6 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:30.321562 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8313d0-10ec-43f6-a830-16ebc842b62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:30.322271 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8313d0-10ec-43f6-a830-16ebc842b62a admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:30.322555 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8313d0-10ec-43f6-a830-16ebc842b62a admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:30.323331 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8313d0-10ec-43f6-a830-16ebc842b62a admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:30.323483 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8313d0-10ec-43f6-a830-16ebc842b62a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:30.325122 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8313d0-10ec-43f6-a830-16ebc842b62a admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:30.359952 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1041/2100] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:30.363717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba107c-23da-4c62-a110-d808cd90a99d admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:30.385239 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba107c-23da-4c62-a110-d808cd90a99d admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:30.391733 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b3b0f-e341-47a6-985a-3e2b93365d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:30.392505 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b3b0f-e341-47a6-985a-3e2b93365d0e admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:30.392849 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b3b0f-e341-47a6-985a-3e2b93365d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:30.393223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b3b0f-e341-47a6-985a-3e2b93365d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:30.394009 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b3b0f-e341-47a6-985a-3e2b93365d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:30.396456 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b3b0f-e341-47a6-985a-3e2b93365d0e admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:30.409358 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1060/2101] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 10:55:30.414224 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8313d0-10ec-43f6-a830-16ebc842b62a admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:30.426197 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8313d0-10ec-43f6-a830-16ebc842b62a admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:30.432055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b871f-43e9-4a34-a287-a48d71050fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:30.432786 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b871f-43e9-4a34-a287-a48d71050fc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:30.433147 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b871f-43e9-4a34-a287-a48d71050fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:30.433543 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b871f-43e9-4a34-a287-a48d71050fc1 admin admin] PATH_INFO: `/v3/projects/cac576f0f54941728f98eac56c1b901a/users/6733f8dd2ec74833ad027df209870470/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:30.454417 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b871f-43e9-4a34-a287-a48d71050fc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cac576f0f54941728f98eac56c1b901a, user_id=6733f8dd2ec74833ad027df209870470, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:30.457219 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b871f-43e9-4a34-a287-a48d71050fc1 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:30.472577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1042/2102] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:55:30 2022] PUT /identity/v3/projects/cac576f0f54941728f98eac56c1b901a/users/6733f8dd2ec74833ad027df209870470/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 10:55:30.483918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371c376-6a24-44d6-a26b-b78e121319f6 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:30.484198 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371c376-6a24-44d6-a26b-b78e121319f6 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:30.484464 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371c376-6a24-44d6-a26b-b78e121319f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:30.519191 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-6371c376-6a24-44d6-a26b-b78e121319f6 None None] MFA Rules not processed for user `6733f8dd2ec74833ad027df209870470`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:30.520433 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-6371c376-6a24-44d6-a26b-b78e121319f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:30.604934 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1061/2103] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:30.632621 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b871f-43e9-4a34-a287-a48d71050fc1 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:30.634599 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-234b871f-43e9-4a34-a287-a48d71050fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:30.699513 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b871f-43e9-4a34-a287-a48d71050fc1 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:30.703283 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94221777-a750-4553-9b70-24a699173ed4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:30.703952 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94221777-a750-4553-9b70-24a699173ed4 service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:30.704297 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94221777-a750-4553-9b70-24a699173ed4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:30.704635 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94221777-a750-4553-9b70-24a699173ed4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:30.713480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94221777-a750-4553-9b70-24a699173ed4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:30.714942 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94221777-a750-4553-9b70-24a699173ed4 service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:30.724418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1043/2104] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:55:30.749643 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371c376-6a24-44d6-a26b-b78e121319f6 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:30.821242 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371c376-6a24-44d6-a26b-b78e121319f6 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:30.826167 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d50db-b7e9-44fc-9c65-668b531c6f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:30.827549 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d50db-b7e9-44fc-9c65-668b531c6f5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:30.827827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d50db-b7e9-44fc-9c65-668b531c6f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:30.828106 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d50db-b7e9-44fc-9c65-668b531c6f5f admin admin] PATH_INFO: `/v3/users/6733f8dd2ec74833ad027df209870470` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:30.829486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d50db-b7e9-44fc-9c65-668b531c6f5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6733f8dd2ec74833ad027df209870470)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:30.831767 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d50db-b7e9-44fc-9c65-668b531c6f5f admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:30.885083 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-8c1d50db-b7e9-44fc-9c65-668b531c6f5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6733f8dd2ec74833ad027df209870470'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:30.890530 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:30.900486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-8c1d50db-b7e9-44fc-9c65-668b531c6f5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6733f8dd2ec74833ad027df209870470'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:30.901688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-8c1d50db-b7e9-44fc-9c65-668b531c6f5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6733f8dd2ec74833ad027df209870470'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:30.911059 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-8c1d50db-b7e9-44fc-9c65-668b531c6f5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6733f8dd2ec74833ad027df209870470'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:30.919805 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-8c1d50db-b7e9-44fc-9c65-668b531c6f5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6733f8dd2ec74833ad027df209870470'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:30.925694 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1062/2105] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:55:30 2022] DELETE /identity/v3/users/6733f8dd2ec74833ad027df209870470 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:30.930374 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f542d-8521-4bb3-b6f4-978017f486d5 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:30.930662 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f542d-8521-4bb3-b6f4-978017f486d5 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:30.931100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f542d-8521-4bb3-b6f4-978017f486d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:30.950529 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-2f4f542d-8521-4bb3-b6f4-978017f486d5 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:30.951790 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-2f4f542d-8521-4bb3-b6f4-978017f486d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:31.011253 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1044/2106] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:31.021455 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d50db-b7e9-44fc-9c65-668b531c6f5f admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:31.022941 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-8c1d50db-b7e9-44fc-9c65-668b531c6f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:31.089142 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d50db-b7e9-44fc-9c65-668b531c6f5f admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:31.092796 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2313958-0bfe-46fd-ba29-9c6273dd7979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:31.093417 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2313958-0bfe-46fd-ba29-9c6273dd7979 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:31.093723 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2313958-0bfe-46fd-ba29-9c6273dd7979 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:31.093994 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2313958-0bfe-46fd-ba29-9c6273dd7979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:31.103632 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2313958-0bfe-46fd-ba29-9c6273dd7979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:31.105104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2313958-0bfe-46fd-ba29-9c6273dd7979 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:31.114595 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1063/2107] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:55:31.404562 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f542d-8521-4bb3-b6f4-978017f486d5 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:31.410085 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-2f4f542d-8521-4bb3-b6f4-978017f486d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:31.430879 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f542d-8521-4bb3-b6f4-978017f486d5 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:31.439672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab866f4b-1791-48ef-a239-ef72d271469d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:31.440779 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab866f4b-1791-48ef-a239-ef72d271469d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:31.441591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab866f4b-1791-48ef-a239-ef72d271469d admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:31.442042 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab866f4b-1791-48ef-a239-ef72d271469d admin admin] PATH_INFO: `/v3/projects/cac576f0f54941728f98eac56c1b901a` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:31.444445 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab866f4b-1791-48ef-a239-ef72d271469d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cac576f0f54941728f98eac56c1b901a)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:31.447395 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab866f4b-1791-48ef-a239-ef72d271469d admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:31.494980 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:31.503366 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ab866f4b-1791-48ef-a239-ef72d271469d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cac576f0f54941728f98eac56c1b901a', 'request_id': 'req-ab866f4b-1791-48ef-a239-ef72d271469d'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:31.510888 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ab866f4b-1791-48ef-a239-ef72d271469d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cac576f0f54941728f98eac56c1b901a', 'request_id': 'req-ab866f4b-1791-48ef-a239-ef72d271469d'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:31.517157 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ab866f4b-1791-48ef-a239-ef72d271469d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cac576f0f54941728f98eac56c1b901a', 'request_id': 'req-ab866f4b-1791-48ef-a239-ef72d271469d'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:31.534115 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ab866f4b-1791-48ef-a239-ef72d271469d admin admin] The token cache is being invalidate because project cac576f0f54941728f98eac56c1b901a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:55:31.534545 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ab866f4b-1791-48ef-a239-ef72d271469d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:31.535279 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ab866f4b-1791-48ef-a239-ef72d271469d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:31.537697 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1045/2108] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:55:31 2022] DELETE /identity/v3/projects/cac576f0f54941728f98eac56c1b901a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:35.362104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2313958-0bfe-46fd-ba29-9c6273dd7979 service neutron] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:35.363570 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-a2313958-0bfe-46fd-ba29-9c6273dd7979 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:35.377220 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2313958-0bfe-46fd-ba29-9c6273dd7979 service neutron] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:35.437166 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25428738-1fa2-43de-8c20-c3a6db1af550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:35.437916 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25428738-1fa2-43de-8c20-c3a6db1af550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:35.438193 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25428738-1fa2-43de-8c20-c3a6db1af550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:35.438469 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25428738-1fa2-43de-8c20-c3a6db1af550 admin admin] PATH_INFO: `/v3/users/64282b94537244df905bef0760c8240a` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:35.439616 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25428738-1fa2-43de-8c20-c3a6db1af550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64282b94537244df905bef0760c8240a)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:35.441773 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25428738-1fa2-43de-8c20-c3a6db1af550 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:35.527197 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-25428738-1fa2-43de-8c20-c3a6db1af550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64282b94537244df905bef0760c8240a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:35.543525 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-25428738-1fa2-43de-8c20-c3a6db1af550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64282b94537244df905bef0760c8240a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:35.544480 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-25428738-1fa2-43de-8c20-c3a6db1af550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64282b94537244df905bef0760c8240a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:35.553426 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-25428738-1fa2-43de-8c20-c3a6db1af550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64282b94537244df905bef0760c8240a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:35.555238 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:35.564642 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-25428738-1fa2-43de-8c20-c3a6db1af550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64282b94537244df905bef0760c8240a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:35.574048 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1064/2109] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:55:35 2022] DELETE /identity/v3/users/64282b94537244df905bef0760c8240a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:35.578348 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407fd4b-6f2c-4589-8dd9-e4153417a171 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:35.578807 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407fd4b-6f2c-4589-8dd9-e4153417a171 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:35.578914 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407fd4b-6f2c-4589-8dd9-e4153417a171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:35.605060 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-4407fd4b-6f2c-4589-8dd9-e4153417a171 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:35.606342 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-4407fd4b-6f2c-4589-8dd9-e4153417a171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:35.695800 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1046/2110] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:35.704983 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25428738-1fa2-43de-8c20-c3a6db1af550 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:35.706786 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-25428738-1fa2-43de-8c20-c3a6db1af550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:35.785420 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25428738-1fa2-43de-8c20-c3a6db1af550 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:35.789598 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4dc375-92c6-44bb-85fe-350878c63056 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:35.790199 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4dc375-92c6-44bb-85fe-350878c63056 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:35.790468 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4dc375-92c6-44bb-85fe-350878c63056 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:35.790731 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4dc375-92c6-44bb-85fe-350878c63056 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:35.804493 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4dc375-92c6-44bb-85fe-350878c63056 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:35.806372 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4dc375-92c6-44bb-85fe-350878c63056 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:35.817793 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1065/2111] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:55:36.150587 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407fd4b-6f2c-4589-8dd9-e4153417a171 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:36.151879 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-4407fd4b-6f2c-4589-8dd9-e4153417a171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:36.171796 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407fd4b-6f2c-4589-8dd9-e4153417a171 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:36.177507 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a255735-22f2-4a89-b67b-a322b24194cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:36.178258 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a255735-22f2-4a89-b67b-a322b24194cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:36.178534 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a255735-22f2-4a89-b67b-a322b24194cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:36.178802 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a255735-22f2-4a89-b67b-a322b24194cd admin admin] PATH_INFO: `/v3/projects/fedd5af14a464e76be803e1d20be49bd` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:36.179937 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a255735-22f2-4a89-b67b-a322b24194cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fedd5af14a464e76be803e1d20be49bd)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:36.182870 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a255735-22f2-4a89-b67b-a322b24194cd admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:36.247247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-1a255735-22f2-4a89-b67b-a322b24194cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fedd5af14a464e76be803e1d20be49bd', 'request_id': 'req-1a255735-22f2-4a89-b67b-a322b24194cd'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:36.257242 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-1a255735-22f2-4a89-b67b-a322b24194cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fedd5af14a464e76be803e1d20be49bd', 'request_id': 'req-1a255735-22f2-4a89-b67b-a322b24194cd'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:36.265450 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-1a255735-22f2-4a89-b67b-a322b24194cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fedd5af14a464e76be803e1d20be49bd', 'request_id': 'req-1a255735-22f2-4a89-b67b-a322b24194cd'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:36.281067 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-1a255735-22f2-4a89-b67b-a322b24194cd admin admin] The token cache is being invalidate because project fedd5af14a464e76be803e1d20be49bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:55:36.281651 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-1a255735-22f2-4a89-b67b-a322b24194cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:36.282343 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-1a255735-22f2-4a89-b67b-a322b24194cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:36.284057 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1047/2112] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:55:36 2022] DELETE /identity/v3/projects/fedd5af14a464e76be803e1d20be49bd => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:36.288957 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bcd85-5075-430a-9fdc-8d88eff95e69 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:36.289133 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bcd85-5075-430a-9fdc-8d88eff95e69 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:36.289440 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bcd85-5075-430a-9fdc-8d88eff95e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:36.311630 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-cd9bcd85-5075-430a-9fdc-8d88eff95e69 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:36.313665 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-cd9bcd85-5075-430a-9fdc-8d88eff95e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:36.366967 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a255735-22f2-4a89-b67b-a322b24194cd admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:36.368440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-1a255735-22f2-4a89-b67b-a322b24194cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:36.412846 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1066/2113] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:55:36.423456 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c5779-f89d-4389-b551-afeae9d470e1 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:36.423740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c5779-f89d-4389-b551-afeae9d470e1 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:36.424014 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c5779-f89d-4389-b551-afeae9d470e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:36.451522 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-f80c5779-f89d-4389-b551-afeae9d470e1 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:36.451522 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-f80c5779-f89d-4389-b551-afeae9d470e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:36.454278 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:36.462871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1067/2114] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:36.466398 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c5779-f89d-4389-b551-afeae9d470e1 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:36.475449 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a255735-22f2-4a89-b67b-a322b24194cd admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:36.479845 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c5779-f89d-4389-b551-afeae9d470e1 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:36.480618 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13c7a3-e43b-4860-992b-ed25ce9ab497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:36.481397 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13c7a3-e43b-4860-992b-ed25ce9ab497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:36.481639 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13c7a3-e43b-4860-992b-ed25ce9ab497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:36.481820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13c7a3-e43b-4860-992b-ed25ce9ab497 admin admin] PATH_INFO: `/v3/users/2eda8def7e754c869cd5ca64498e5c98` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:36.483060 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13c7a3-e43b-4860-992b-ed25ce9ab497 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eda8def7e754c869cd5ca64498e5c98)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:36.484868 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee66c3b-bff8-4ad8-8d5f-519633015326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:36.485167 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13c7a3-e43b-4860-992b-ed25ce9ab497 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:36.485498 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee66c3b-bff8-4ad8-8d5f-519633015326 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:36.485776 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee66c3b-bff8-4ad8-8d5f-519633015326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:36.486045 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee66c3b-bff8-4ad8-8d5f-519633015326 admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:36.486848 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee66c3b-bff8-4ad8-8d5f-519633015326 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:55:36.487168 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee66c3b-bff8-4ad8-8d5f-519633015326 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:36.490238 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee66c3b-bff8-4ad8-8d5f-519633015326 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:36.508842 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1068/2115] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:55:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:55:36.509936 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee66c3b-bff8-4ad8-8d5f-519633015326 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:36.524893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee66c3b-bff8-4ad8-8d5f-519633015326 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:36.535090 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7266dd0-8355-4b85-82b9-0135d7b0e353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:36.536571 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7266dd0-8355-4b85-82b9-0135d7b0e353 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:36.536994 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7266dd0-8355-4b85-82b9-0135d7b0e353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:36.537895 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7266dd0-8355-4b85-82b9-0135d7b0e353 admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:36.538728 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7266dd0-8355-4b85-82b9-0135d7b0e353 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:36.540754 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7266dd0-8355-4b85-82b9-0135d7b0e353 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:36.554950 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ed13c7a3-e43b-4860-992b-ed25ce9ab497 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eda8def7e754c869cd5ca64498e5c98'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:36.579874 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ed13c7a3-e43b-4860-992b-ed25ce9ab497 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eda8def7e754c869cd5ca64498e5c98'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:36.581545 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ed13c7a3-e43b-4860-992b-ed25ce9ab497 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eda8def7e754c869cd5ca64498e5c98'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:36.589341 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ed13c7a3-e43b-4860-992b-ed25ce9ab497 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eda8def7e754c869cd5ca64498e5c98'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:36.597039 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1069/2116] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:55:36 2022] POST /identity/v3/projects => generated 375 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:36.612151 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7266dd0-8355-4b85-82b9-0135d7b0e353 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:36.624115 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ed13c7a3-e43b-4860-992b-ed25ce9ab497 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eda8def7e754c869cd5ca64498e5c98'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:36.636197 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1048/2117] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:55:36 2022] DELETE /identity/v3/users/2eda8def7e754c869cd5ca64498e5c98 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 10:55:36.712562 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:36.747477 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7266dd0-8355-4b85-82b9-0135d7b0e353 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:36.822835 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181b9c6-e030-4d92-a7ef-35dc9b37ba49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:36.823798 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181b9c6-e030-4d92-a7ef-35dc9b37ba49 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:36.824499 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181b9c6-e030-4d92-a7ef-35dc9b37ba49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:36.824862 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181b9c6-e030-4d92-a7ef-35dc9b37ba49 admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:36.826013 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181b9c6-e030-4d92-a7ef-35dc9b37ba49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:36.827670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181b9c6-e030-4d92-a7ef-35dc9b37ba49 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:36.862498 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1070/2118] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:55:36 2022] POST /identity/v3/users => generated 288 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:36.866861 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13c7a3-e43b-4860-992b-ed25ce9ab497 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:36.868783 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ed13c7a3-e43b-4860-992b-ed25ce9ab497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:36.880549 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181b9c6-e030-4d92-a7ef-35dc9b37ba49 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:36.882790 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13c7a3-e43b-4860-992b-ed25ce9ab497 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:36.882919 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-8181b9c6-e030-4d92-a7ef-35dc9b37ba49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:36.887366 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e782aa-5a6a-4d5e-9728-e4c98b70eb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:36.887961 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e782aa-5a6a-4d5e-9728-e4c98b70eb1c admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:36.888233 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e782aa-5a6a-4d5e-9728-e4c98b70eb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:36.888499 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e782aa-5a6a-4d5e-9728-e4c98b70eb1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:36.889153 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e782aa-5a6a-4d5e-9728-e4c98b70eb1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:36.890943 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e782aa-5a6a-4d5e-9728-e4c98b70eb1c admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:36.895781 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181b9c6-e030-4d92-a7ef-35dc9b37ba49 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:36.902458 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f76ac-6f9e-4f07-892d-5fa06b869ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:36.903094 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f76ac-6f9e-4f07-892d-5fa06b869ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:36.903704 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f76ac-6f9e-4f07-892d-5fa06b869ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:36.903826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1049/2119] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:36.903921 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f76ac-6f9e-4f07-892d-5fa06b869ff9 admin admin] PATH_INFO: `/v3/projects/0e2149e0214041f19068442396cd1d01` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:36.905110 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f76ac-6f9e-4f07-892d-5fa06b869ff9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e2149e0214041f19068442396cd1d01)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:36.907155 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f76ac-6f9e-4f07-892d-5fa06b869ff9 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:36.911822 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e782aa-5a6a-4d5e-9728-e4c98b70eb1c admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:36.923616 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e782aa-5a6a-4d5e-9728-e4c98b70eb1c admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:36.928315 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9fa7f-d7ff-4415-ac57-0e84e1c5919b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:36.928900 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9fa7f-d7ff-4415-ac57-0e84e1c5919b admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:36.929185 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9fa7f-d7ff-4415-ac57-0e84e1c5919b admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:36.929492 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9fa7f-d7ff-4415-ac57-0e84e1c5919b admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:36.930163 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9fa7f-d7ff-4415-ac57-0e84e1c5919b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:36.931782 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9fa7f-d7ff-4415-ac57-0e84e1c5919b admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:36.942693 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1050/2120] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:36.946749 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9fa7f-d7ff-4415-ac57-0e84e1c5919b admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:36.956775 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-2b5f76ac-6f9e-4f07-892d-5fa06b869ff9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e2149e0214041f19068442396cd1d01', 'request_id': 'req-2b5f76ac-6f9e-4f07-892d-5fa06b869ff9'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:36.958484 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9fa7f-d7ff-4415-ac57-0e84e1c5919b admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:36.971721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-2b5f76ac-6f9e-4f07-892d-5fa06b869ff9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e2149e0214041f19068442396cd1d01', 'request_id': 'req-2b5f76ac-6f9e-4f07-892d-5fa06b869ff9'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:36.982839 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-2b5f76ac-6f9e-4f07-892d-5fa06b869ff9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e2149e0214041f19068442396cd1d01', 'request_id': 'req-2b5f76ac-6f9e-4f07-892d-5fa06b869ff9'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:36.995802 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-2b5f76ac-6f9e-4f07-892d-5fa06b869ff9 admin admin] The token cache is being invalidate because project 0e2149e0214041f19068442396cd1d01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:55:36.996093 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-2b5f76ac-6f9e-4f07-892d-5fa06b869ff9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:36.996752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-2b5f76ac-6f9e-4f07-892d-5fa06b869ff9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:36.998305 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1071/2121] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:55:36 2022] DELETE /identity/v3/projects/0e2149e0214041f19068442396cd1d01 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 10:55:37.004005 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f04b3-a692-46e7-9e43-1039722b2c7f None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:37.004365 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f04b3-a692-46e7-9e43-1039722b2c7f None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:37.005020 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f04b3-a692-46e7-9e43-1039722b2c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:37.024630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04723bf2-065a-4a8c-984e-8463abe5073f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:37.025130 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-9d4f04b3-a692-46e7-9e43-1039722b2c7f None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:37.025262 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04723bf2-065a-4a8c-984e-8463abe5073f admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:37.025584 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04723bf2-065a-4a8c-984e-8463abe5073f admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:37.025861 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04723bf2-065a-4a8c-984e-8463abe5073f admin admin] PATH_INFO: `/v3/projects/5d610be7ed1d4dfb8926901955f7574f/users/80ba92d29db149f59aa55d2949cefe90/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:37.026357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-9d4f04b3-a692-46e7-9e43-1039722b2c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:37.034096 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1072/2122] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:55:37.042252 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04723bf2-065a-4a8c-984e-8463abe5073f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d610be7ed1d4dfb8926901955f7574f, user_id=80ba92d29db149f59aa55d2949cefe90, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:37.043233 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271033e-3ff7-4be7-b77f-8222cf599f68 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:37.043519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271033e-3ff7-4be7-b77f-8222cf599f68 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:37.043792 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271033e-3ff7-4be7-b77f-8222cf599f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:37.045257 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04723bf2-065a-4a8c-984e-8463abe5073f admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:37.061511 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1051/2123] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:55:36 2022] PUT /identity/v3/projects/5d610be7ed1d4dfb8926901955f7574f/users/80ba92d29db149f59aa55d2949cefe90/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:37.068112 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-e271033e-3ff7-4be7-b77f-8222cf599f68 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:37.070094 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-e271033e-3ff7-4be7-b77f-8222cf599f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:37.072194 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca73b1-eb93-4a22-865c-74bdfca613c4 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:37.072469 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca73b1-eb93-4a22-865c-74bdfca613c4 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:37.072742 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca73b1-eb93-4a22-865c-74bdfca613c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:37.103820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-14ca73b1-eb93-4a22-865c-74bdfca613c4 None None] MFA Rules not processed for user `80ba92d29db149f59aa55d2949cefe90`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:37.105041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-14ca73b1-eb93-4a22-865c-74bdfca613c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:37.124559 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:37.140911 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1073/2124] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:55:37.145846 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271033e-3ff7-4be7-b77f-8222cf599f68 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:37.156734 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271033e-3ff7-4be7-b77f-8222cf599f68 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:37.162141 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d000a-3735-476c-a5ed-309ef82e4958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:37.162737 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d000a-3735-476c-a5ed-309ef82e4958 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:37.163010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d000a-3735-476c-a5ed-309ef82e4958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:37.163278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d000a-3735-476c-a5ed-309ef82e4958 admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:37.163925 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d000a-3735-476c-a5ed-309ef82e4958 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:55:37.164228 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d000a-3735-476c-a5ed-309ef82e4958 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:37.165849 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d000a-3735-476c-a5ed-309ef82e4958 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:37.167310 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:37.174679 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1052/2125] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:55:37.180854 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1074/2126] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:55:37.184638 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca73b1-eb93-4a22-865c-74bdfca613c4 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:37.187035 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d000a-3735-476c-a5ed-309ef82e4958 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:37.188708 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-508d000a-3735-476c-a5ed-309ef82e4958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:37.195756 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca73b1-eb93-4a22-865c-74bdfca613c4 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:37.200310 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779289a-48e4-440f-bbc7-673b1fd63b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:37.200892 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779289a-48e4-440f-bbc7-673b1fd63b79 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:37.201176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779289a-48e4-440f-bbc7-673b1fd63b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:37.201485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779289a-48e4-440f-bbc7-673b1fd63b79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:37.202105 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779289a-48e4-440f-bbc7-673b1fd63b79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:37.203981 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779289a-48e4-440f-bbc7-673b1fd63b79 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:37.231293 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1053/2127] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:55:37 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:37.235277 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779289a-48e4-440f-bbc7-673b1fd63b79 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:37.246662 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d000a-3735-476c-a5ed-309ef82e4958 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:37.300476 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9eff4c-aab0-4078-bea1-0772275c9fa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:37.301404 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9eff4c-aab0-4078-bea1-0772275c9fa3 service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:37.301845 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9eff4c-aab0-4078-bea1-0772275c9fa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:37.302223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9eff4c-aab0-4078-bea1-0772275c9fa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:37.303772 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779289a-48e4-440f-bbc7-673b1fd63b79 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:37.308793 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802296b-4e7a-4c71-8ee8-72bdd52f6012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:37.309428 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802296b-4e7a-4c71-8ee8-72bdd52f6012 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:37.309735 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802296b-4e7a-4c71-8ee8-72bdd52f6012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:37.310006 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802296b-4e7a-4c71-8ee8-72bdd52f6012 admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:37.310630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802296b-4e7a-4c71-8ee8-72bdd52f6012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:37.312546 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802296b-4e7a-4c71-8ee8-72bdd52f6012 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:37.335962 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1054/2128] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:55:37 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 10:55:37.340251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802296b-4e7a-4c71-8ee8-72bdd52f6012 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:37.351280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802296b-4e7a-4c71-8ee8-72bdd52f6012 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:37.356111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d49a07-d179-4b2f-89d9-c687348b7f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:37.356847 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d49a07-d179-4b2f-89d9-c687348b7f92 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:37.357130 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d49a07-d179-4b2f-89d9-c687348b7f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:37.357439 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d49a07-d179-4b2f-89d9-c687348b7f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:37.358089 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d49a07-d179-4b2f-89d9-c687348b7f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:37.359681 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d49a07-d179-4b2f-89d9-c687348b7f92 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:37.367021 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9eff4c-aab0-4078-bea1-0772275c9fa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:37.368441 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9eff4c-aab0-4078-bea1-0772275c9fa3 service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:37.370107 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1055/2129] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 10:55:37.374202 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d49a07-d179-4b2f-89d9-c687348b7f92 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:37.377595 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1075/2130] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 10:55:37.385410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d49a07-d179-4b2f-89d9-c687348b7f92 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:37.390309 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4278b75-b364-400d-94f4-e3e3d588872e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:37.390901 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4278b75-b364-400d-94f4-e3e3d588872e admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:37.391230 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4278b75-b364-400d-94f4-e3e3d588872e admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:37.391454 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4278b75-b364-400d-94f4-e3e3d588872e admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:37.392097 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4278b75-b364-400d-94f4-e3e3d588872e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:37.393727 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4278b75-b364-400d-94f4-e3e3d588872e admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:37.404968 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1056/2131] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 10:55:37.408996 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9eff4c-aab0-4078-bea1-0772275c9fa3 service cinder] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:37.419730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9eff4c-aab0-4078-bea1-0772275c9fa3 service cinder] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:37.424369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca8ef7-0de4-47f2-804f-fa99cb8b9f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:37.425139 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca8ef7-0de4-47f2-804f-fa99cb8b9f2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:37.425532 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca8ef7-0de4-47f2-804f-fa99cb8b9f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:37.425837 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca8ef7-0de4-47f2-804f-fa99cb8b9f2d admin admin] PATH_INFO: `/v3/projects/438ecc4193654d05a9296157b3f63dec/users/2f9976b79f2840bf90eeba66eb999e6c/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:37.444914 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ca8ef7-0de4-47f2-804f-fa99cb8b9f2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=438ecc4193654d05a9296157b3f63dec, user_id=2f9976b79f2840bf90eeba66eb999e6c, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:37.447767 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ca8ef7-0de4-47f2-804f-fa99cb8b9f2d admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:37.462730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1076/2132] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:55:37 2022] PUT /identity/v3/projects/438ecc4193654d05a9296157b3f63dec/users/2f9976b79f2840bf90eeba66eb999e6c/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:37.467580 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5b8b9-fb37-4af7-987f-637d8b6a485c None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:37.467891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5b8b9-fb37-4af7-987f-637d8b6a485c None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:37.468168 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5b8b9-fb37-4af7-987f-637d8b6a485c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:37.486817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-97e5b8b9-fb37-4af7-987f-637d8b6a485c None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:37.488018 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-97e5b8b9-fb37-4af7-987f-637d8b6a485c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:37.555251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1057/2133] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:37.564871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca8ef7-0de4-47f2-804f-fa99cb8b9f2d admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:37.567979 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-72ca8ef7-0de4-47f2-804f-fa99cb8b9f2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:37.613245 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:37.638420 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca8ef7-0de4-47f2-804f-fa99cb8b9f2d admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:37.642960 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83534f-967b-4f3b-8fc0-7ea861b3bb4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:37.643816 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83534f-967b-4f3b-8fc0-7ea861b3bb4b service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:37.644190 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83534f-967b-4f3b-8fc0-7ea861b3bb4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:37.644557 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83534f-967b-4f3b-8fc0-7ea861b3bb4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:37.656298 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83534f-967b-4f3b-8fc0-7ea861b3bb4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:37.658611 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83534f-967b-4f3b-8fc0-7ea861b3bb4b service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:37.671753 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1077/2134] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:55:42.153850 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234058f6-8245-40b5-b4eb-ab0203096121 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:42.154501 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234058f6-8245-40b5-b4eb-ab0203096121 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:42.155022 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234058f6-8245-40b5-b4eb-ab0203096121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:42.179992 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:42.196837 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-234058f6-8245-40b5-b4eb-ab0203096121 None None] MFA Rules not processed for user `2f9976b79f2840bf90eeba66eb999e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:42.198072 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-234058f6-8245-40b5-b4eb-ab0203096121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:42.268166 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1058/2135] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:42.279990 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83534f-967b-4f3b-8fc0-7ea861b3bb4b service neutron] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:42.281552 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-ff83534f-967b-4f3b-8fc0-7ea861b3bb4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:42.377026 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83534f-967b-4f3b-8fc0-7ea861b3bb4b service neutron] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:42.385136 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435568c-3c4c-48d2-be0e-d9a2b66db364 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:42.386006 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435568c-3c4c-48d2-be0e-d9a2b66db364 service nova] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:42.386644 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435568c-3c4c-48d2-be0e-d9a2b66db364 service nova] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:42.386747 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435568c-3c4c-48d2-be0e-d9a2b66db364 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:42.398224 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2435568c-3c4c-48d2-be0e-d9a2b66db364 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:42.400936 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2435568c-3c4c-48d2-be0e-d9a2b66db364 service nova] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:42.413605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1078/2136] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:55:42.851978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234058f6-8245-40b5-b4eb-ab0203096121 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:42.853651 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-234058f6-8245-40b5-b4eb-ab0203096121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:42.923630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234058f6-8245-40b5-b4eb-ab0203096121 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:42.930225 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef43ff-53de-4c2e-9f24-b7ee3a0e993e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:42.930975 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef43ff-53de-4c2e-9f24-b7ee3a0e993e service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:42.931804 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef43ff-53de-4c2e-9f24-b7ee3a0e993e service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:42.932155 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef43ff-53de-4c2e-9f24-b7ee3a0e993e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:42.935324 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-04ef43ff-53de-4c2e-9f24-b7ee3a0e993e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:43.019527 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef43ff-53de-4c2e-9f24-b7ee3a0e993e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:43.022176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef43ff-53de-4c2e-9f24-b7ee3a0e993e service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:43.034767 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1059/2137] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:55:44.335722 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144a77f-bc49-4592-b94b-2dade3004f6f None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:44.336198 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144a77f-bc49-4592-b94b-2dade3004f6f None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:44.336335 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144a77f-bc49-4592-b94b-2dade3004f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:44.362569 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-2144a77f-bc49-4592-b94b-2dade3004f6f None None] MFA Rules not processed for user `2f9976b79f2840bf90eeba66eb999e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:44.364566 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-2144a77f-bc49-4592-b94b-2dade3004f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:44.372981 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1079/2138] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:52.893297 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef43ff-53de-4c2e-9f24-b7ee3a0e993e service cinder] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:52.895794 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-04ef43ff-53de-4c2e-9f24-b7ee3a0e993e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:52.913698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef43ff-53de-4c2e-9f24-b7ee3a0e993e service cinder] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:52.927398 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b64436-cc65-4977-a7f7-cf03b1107d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:52.928034 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b64436-cc65-4977-a7f7-cf03b1107d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:52.928308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b64436-cc65-4977-a7f7-cf03b1107d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:52.928577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b64436-cc65-4977-a7f7-cf03b1107d2e admin admin] PATH_INFO: `/v3/users/80ba92d29db149f59aa55d2949cefe90` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:52.929752 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b64436-cc65-4977-a7f7-cf03b1107d2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=80ba92d29db149f59aa55d2949cefe90)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:52.931687 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b64436-cc65-4977-a7f7-cf03b1107d2e admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:52.983301 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:52.989572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-86b64436-cc65-4977-a7f7-cf03b1107d2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80ba92d29db149f59aa55d2949cefe90'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:53.006427 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-86b64436-cc65-4977-a7f7-cf03b1107d2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80ba92d29db149f59aa55d2949cefe90'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:53.007270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-86b64436-cc65-4977-a7f7-cf03b1107d2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80ba92d29db149f59aa55d2949cefe90'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:53.016881 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-86b64436-cc65-4977-a7f7-cf03b1107d2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80ba92d29db149f59aa55d2949cefe90'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:53.026786 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-86b64436-cc65-4977-a7f7-cf03b1107d2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80ba92d29db149f59aa55d2949cefe90'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:53.043373 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1060/2139] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:55:52 2022] DELETE /identity/v3/users/80ba92d29db149f59aa55d2949cefe90 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:53.047998 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f6ca8-ae87-48e0-9bfd-40d53273829c None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:53.048484 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f6ca8-ae87-48e0-9bfd-40d53273829c None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:53.048595 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f6ca8-ae87-48e0-9bfd-40d53273829c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:53.070350 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-684f6ca8-ae87-48e0-9bfd-40d53273829c None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:53.071944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-684f6ca8-ae87-48e0-9bfd-40d53273829c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:53.148430 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1080/2140] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:53.155166 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b64436-cc65-4977-a7f7-cf03b1107d2e admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:53.156787 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-86b64436-cc65-4977-a7f7-cf03b1107d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:53.225862 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b64436-cc65-4977-a7f7-cf03b1107d2e admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:53.233291 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2897a-652c-459a-9962-a9e1442d2f6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:53.233967 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2897a-652c-459a-9962-a9e1442d2f6e service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:53.234273 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2897a-652c-459a-9962-a9e1442d2f6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:53.234542 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2897a-652c-459a-9962-a9e1442d2f6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:53.245216 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2897a-652c-459a-9962-a9e1442d2f6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:53.246712 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2897a-652c-459a-9962-a9e1442d2f6e service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:53.257467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1061/2141] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:55:53.884234 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f6ca8-ae87-48e0-9bfd-40d53273829c None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:53.886981 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-684f6ca8-ae87-48e0-9bfd-40d53273829c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:53.915255 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f6ca8-ae87-48e0-9bfd-40d53273829c None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:53.920220 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc70cd7-13a1-4c00-8c74-10284b3587d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:53.920855 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc70cd7-13a1-4c00-8c74-10284b3587d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:53.921126 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc70cd7-13a1-4c00-8c74-10284b3587d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:53.921429 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc70cd7-13a1-4c00-8c74-10284b3587d4 admin admin] PATH_INFO: `/v3/projects/5d610be7ed1d4dfb8926901955f7574f` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:53.922552 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc70cd7-13a1-4c00-8c74-10284b3587d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d610be7ed1d4dfb8926901955f7574f)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:53.925208 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc70cd7-13a1-4c00-8c74-10284b3587d4 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:53.975163 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-6fc70cd7-13a1-4c00-8c74-10284b3587d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d610be7ed1d4dfb8926901955f7574f', 'request_id': 'req-6fc70cd7-13a1-4c00-8c74-10284b3587d4'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:53.979697 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:53.981608 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-6fc70cd7-13a1-4c00-8c74-10284b3587d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d610be7ed1d4dfb8926901955f7574f', 'request_id': 'req-6fc70cd7-13a1-4c00-8c74-10284b3587d4'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:53.991041 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-6fc70cd7-13a1-4c00-8c74-10284b3587d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d610be7ed1d4dfb8926901955f7574f', 'request_id': 'req-6fc70cd7-13a1-4c00-8c74-10284b3587d4'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:54.002562 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-6fc70cd7-13a1-4c00-8c74-10284b3587d4 admin admin] The token cache is being invalidate because project 5d610be7ed1d4dfb8926901955f7574f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:55:54.002847 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-6fc70cd7-13a1-4c00-8c74-10284b3587d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:54.003498 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-6fc70cd7-13a1-4c00-8c74-10284b3587d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:55:54.005272 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1081/2142] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:55:53 2022] DELETE /identity/v3/projects/5d610be7ed1d4dfb8926901955f7574f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:55:54.010306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a60ff-6ad0-40f7-81dd-cdc804348b26 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:54.010811 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a60ff-6ad0-40f7-81dd-cdc804348b26 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:54.010908 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a60ff-6ad0-40f7-81dd-cdc804348b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:54.030097 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-c90a60ff-6ad0-40f7-81dd-cdc804348b26 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:54.031307 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-c90a60ff-6ad0-40f7-81dd-cdc804348b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:54.101987 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1062/2143] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:55:54.109573 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ef628-3f5f-4792-b9b1-3abf0a9cc707 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:54.110094 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ef628-3f5f-4792-b9b1-3abf0a9cc707 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:54.110297 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ef628-3f5f-4792-b9b1-3abf0a9cc707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:54.131947 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-f23ef628-3f5f-4792-b9b1-3abf0a9cc707 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:54.133139 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-f23ef628-3f5f-4792-b9b1-3abf0a9cc707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:54.141244 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1082/2144] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:54.145583 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a60ff-6ad0-40f7-81dd-cdc804348b26 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:54.155255 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a60ff-6ad0-40f7-81dd-cdc804348b26 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:54.162019 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5a878-488e-492d-a93d-bb5e042ba3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:54.163072 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5a878-488e-492d-a93d-bb5e042ba3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:54.163072 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5a878-488e-492d-a93d-bb5e042ba3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:54.163307 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5a878-488e-492d-a93d-bb5e042ba3a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:54.163981 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5a878-488e-492d-a93d-bb5e042ba3a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:55:54.164266 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5a878-488e-492d-a93d-bb5e042ba3a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:54.165923 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5a878-488e-492d-a93d-bb5e042ba3a4 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:54.185120 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1063/2145] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:55:54.190277 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ef628-3f5f-4792-b9b1-3abf0a9cc707 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:54.203633 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ef628-3f5f-4792-b9b1-3abf0a9cc707 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:54.208633 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06960a80-0416-4aa7-bad0-ffa5dc327632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:54.209470 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06960a80-0416-4aa7-bad0-ffa5dc327632 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:54.209929 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06960a80-0416-4aa7-bad0-ffa5dc327632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:54.210195 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06960a80-0416-4aa7-bad0-ffa5dc327632 admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:54.210818 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06960a80-0416-4aa7-bad0-ffa5dc327632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:54.212703 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06960a80-0416-4aa7-bad0-ffa5dc327632 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:54.249186 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1083/2146] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:55:54 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:55:54.253249 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5a878-488e-492d-a93d-bb5e042ba3a4 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:54.264386 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5a878-488e-492d-a93d-bb5e042ba3a4 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:54.315903 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:55:54.331012 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968c996-7386-489d-a545-37c27aaca095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:54.331617 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968c996-7386-489d-a545-37c27aaca095 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:54.331894 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968c996-7386-489d-a545-37c27aaca095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:54.332161 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968c996-7386-489d-a545-37c27aaca095 admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:54.332818 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e968c996-7386-489d-a545-37c27aaca095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:54.334812 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e968c996-7386-489d-a545-37c27aaca095 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:54.363307 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1064/2147] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:55:54 2022] POST /identity/v3/users => generated 285 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 10:55:54.368057 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06960a80-0416-4aa7-bad0-ffa5dc327632 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:54.379156 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06960a80-0416-4aa7-bad0-ffa5dc327632 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:54.385124 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6799ec-b7a4-44d0-9edd-2f93581ac319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:54.385753 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6799ec-b7a4-44d0-9edd-2f93581ac319 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:54.386029 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6799ec-b7a4-44d0-9edd-2f93581ac319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:54.386298 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6799ec-b7a4-44d0-9edd-2f93581ac319 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:54.386941 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6799ec-b7a4-44d0-9edd-2f93581ac319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:54.388637 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6799ec-b7a4-44d0-9edd-2f93581ac319 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:54.402239 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1084/2148] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:55:54.406702 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968c996-7386-489d-a545-37c27aaca095 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:54.419393 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968c996-7386-489d-a545-37c27aaca095 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:54.424662 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06e326-e95b-427c-a454-698d32625033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:54.425469 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06e326-e95b-427c-a454-698d32625033 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:54.425835 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06e326-e95b-427c-a454-698d32625033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:54.427362 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06e326-e95b-427c-a454-698d32625033 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:54.428126 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06e326-e95b-427c-a454-698d32625033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:54.429902 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06e326-e95b-427c-a454-698d32625033 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:54.445775 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1065/2149] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 10:55:54.450390 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6799ec-b7a4-44d0-9edd-2f93581ac319 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:54.462542 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6799ec-b7a4-44d0-9edd-2f93581ac319 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:54.469373 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c87ba6-062d-46ec-bff0-1678a8cd7d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:54.470276 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c87ba6-062d-46ec-bff0-1678a8cd7d1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:54.470749 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c87ba6-062d-46ec-bff0-1678a8cd7d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:54.471026 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c87ba6-062d-46ec-bff0-1678a8cd7d1e admin admin] PATH_INFO: `/v3/projects/8c7b311db2e24b6c85367c9ceb0bda99/users/7501da56ad6a4aeea8f5546d196a887c/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:54.495926 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c87ba6-062d-46ec-bff0-1678a8cd7d1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c7b311db2e24b6c85367c9ceb0bda99, user_id=7501da56ad6a4aeea8f5546d196a887c, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:54.499698 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c87ba6-062d-46ec-bff0-1678a8cd7d1e admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:54.519996 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1085/2150] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:55:54 2022] PUT /identity/v3/projects/8c7b311db2e24b6c85367c9ceb0bda99/users/7501da56ad6a4aeea8f5546d196a887c/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 10:55:54.531089 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f192fac-5076-400c-9613-c0d5bb9c8aec None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:54.531473 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f192fac-5076-400c-9613-c0d5bb9c8aec None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:54.531814 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f192fac-5076-400c-9613-c0d5bb9c8aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:54.580015 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-4f192fac-5076-400c-9613-c0d5bb9c8aec None None] MFA Rules not processed for user `7501da56ad6a4aeea8f5546d196a887c`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:55:54.581829 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-4f192fac-5076-400c-9613-c0d5bb9c8aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:54.667815 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1066/2151] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:55:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:55:54.683564 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c87ba6-062d-46ec-bff0-1678a8cd7d1e admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:54.687709 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-a9c87ba6-062d-46ec-bff0-1678a8cd7d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:55:54.755340 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c87ba6-062d-46ec-bff0-1678a8cd7d1e admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:55:54.759038 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69566154-f451-493b-87ca-b024ee05ddd8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a462a891b30847c0aeadbd697652011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:55:54.759627 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69566154-f451-493b-87ca-b024ee05ddd8 service glance] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:55:54.759906 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69566154-f451-493b-87ca-b024ee05ddd8 service glance] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:55:54.760171 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69566154-f451-493b-87ca-b024ee05ddd8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:55:54.768237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69566154-f451-493b-87ca-b024ee05ddd8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:55:54.769675 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69566154-f451-493b-87ca-b024ee05ddd8 service glance] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:55:54.778444 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1086/2152] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:55:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 10:55:59.994946 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f192fac-5076-400c-9613-c0d5bb9c8aec None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:55:59.996922 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-4f192fac-5076-400c-9613-c0d5bb9c8aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:00.076439 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f192fac-5076-400c-9613-c0d5bb9c8aec None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:00.081010 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c1a66-e7b1-41f9-8da2-28937ad0fb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:00.081661 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c1a66-e7b1-41f9-8da2-28937ad0fb5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:00.081932 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c1a66-e7b1-41f9-8da2-28937ad0fb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:00.082199 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c1a66-e7b1-41f9-8da2-28937ad0fb5a admin admin] PATH_INFO: `/v3/users/cae07c56193144ea8672d6e8cad7b3a2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:00.083930 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c1a66-e7b1-41f9-8da2-28937ad0fb5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cae07c56193144ea8672d6e8cad7b3a2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:00.086002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c1a66-e7b1-41f9-8da2-28937ad0fb5a admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:00.140716 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-a88c1a66-e7b1-41f9-8da2-28937ad0fb5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cae07c56193144ea8672d6e8cad7b3a2'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:00.149642 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:00.156104 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-a88c1a66-e7b1-41f9-8da2-28937ad0fb5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cae07c56193144ea8672d6e8cad7b3a2'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:00.157137 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-a88c1a66-e7b1-41f9-8da2-28937ad0fb5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cae07c56193144ea8672d6e8cad7b3a2'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:00.165630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-a88c1a66-e7b1-41f9-8da2-28937ad0fb5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cae07c56193144ea8672d6e8cad7b3a2'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:00.175109 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-a88c1a66-e7b1-41f9-8da2-28937ad0fb5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cae07c56193144ea8672d6e8cad7b3a2'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:00.184600 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1067/2153] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:55:59 2022] DELETE /identity/v3/users/cae07c56193144ea8672d6e8cad7b3a2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:56:00.188346 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b93056-659d-46d8-bd25-9e7d9d8651db None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:00.188868 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b93056-659d-46d8-bd25-9e7d9d8651db None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:00.188960 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b93056-659d-46d8-bd25-9e7d9d8651db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:00.210620 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-f6b93056-659d-46d8-bd25-9e7d9d8651db None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:00.211909 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-f6b93056-659d-46d8-bd25-9e7d9d8651db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:00.272861 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1087/2154] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:56:00.283338 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c1a66-e7b1-41f9-8da2-28937ad0fb5a admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:00.284856 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a88c1a66-e7b1-41f9-8da2-28937ad0fb5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:00.360660 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c1a66-e7b1-41f9-8da2-28937ad0fb5a admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:00.364786 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e156a23-2e2c-427d-86ba-9baa162f1bf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:00.365439 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e156a23-2e2c-427d-86ba-9baa162f1bf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:00.365746 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e156a23-2e2c-427d-86ba-9baa162f1bf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:00.366017 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e156a23-2e2c-427d-86ba-9baa162f1bf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:00.380043 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e156a23-2e2c-427d-86ba-9baa162f1bf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:00.381863 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e156a23-2e2c-427d-86ba-9baa162f1bf2 service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:00.401599 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1068/2155] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:56:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:56:00.702995 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b93056-659d-46d8-bd25-9e7d9d8651db None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:00.704518 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-f6b93056-659d-46d8-bd25-9e7d9d8651db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:00.718907 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b93056-659d-46d8-bd25-9e7d9d8651db None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:00.724003 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3f539-176c-4932-9cdc-cedb7d69f98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:00.724651 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3f539-176c-4932-9cdc-cedb7d69f98b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:00.724918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3f539-176c-4932-9cdc-cedb7d69f98b admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:00.725193 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3f539-176c-4932-9cdc-cedb7d69f98b admin admin] PATH_INFO: `/v3/projects/fb998ef2583e4984bbbe53cbe8e1deee` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:00.726406 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3f539-176c-4932-9cdc-cedb7d69f98b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb998ef2583e4984bbbe53cbe8e1deee)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:00.728392 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3f539-176c-4932-9cdc-cedb7d69f98b admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:00.751335 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:00.781322 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-97b3f539-176c-4932-9cdc-cedb7d69f98b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb998ef2583e4984bbbe53cbe8e1deee', 'request_id': 'req-97b3f539-176c-4932-9cdc-cedb7d69f98b'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:00.787832 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-97b3f539-176c-4932-9cdc-cedb7d69f98b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb998ef2583e4984bbbe53cbe8e1deee', 'request_id': 'req-97b3f539-176c-4932-9cdc-cedb7d69f98b'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:00.797152 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-97b3f539-176c-4932-9cdc-cedb7d69f98b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb998ef2583e4984bbbe53cbe8e1deee', 'request_id': 'req-97b3f539-176c-4932-9cdc-cedb7d69f98b'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:00.808795 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-97b3f539-176c-4932-9cdc-cedb7d69f98b admin admin] The token cache is being invalidate because project fb998ef2583e4984bbbe53cbe8e1deee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:56:00.809085 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-97b3f539-176c-4932-9cdc-cedb7d69f98b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:00.809754 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-97b3f539-176c-4932-9cdc-cedb7d69f98b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:00.811291 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1088/2156] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:56:00 2022] DELETE /identity/v3/projects/fb998ef2583e4984bbbe53cbe8e1deee => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:56:00.816056 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e122a96-ad19-4976-832d-efad8449b53d None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:00.816409 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e122a96-ad19-4976-832d-efad8449b53d None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:00.816687 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e122a96-ad19-4976-832d-efad8449b53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:00.837643 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-0e122a96-ad19-4976-832d-efad8449b53d None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:00.839325 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-0e122a96-ad19-4976-832d-efad8449b53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:00.921280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1069/2157] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:56:00.929998 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec550a0-4a3e-42b1-818c-cb248aa23f29 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:00.930282 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec550a0-4a3e-42b1-818c-cb248aa23f29 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:00.930556 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec550a0-4a3e-42b1-818c-cb248aa23f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:00.958107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-bec550a0-4a3e-42b1-818c-cb248aa23f29 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:00.959332 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-bec550a0-4a3e-42b1-818c-cb248aa23f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:00.974123 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1089/2158] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:56:00.974837 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e122a96-ad19-4976-832d-efad8449b53d None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:00.989342 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e122a96-ad19-4976-832d-efad8449b53d None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:00.995503 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef39cc9-9098-4dd3-9484-afd1c1b0afd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:00.996104 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef39cc9-9098-4dd3-9484-afd1c1b0afd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:00.996380 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef39cc9-9098-4dd3-9484-afd1c1b0afd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:00.997138 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef39cc9-9098-4dd3-9484-afd1c1b0afd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:00.997445 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef39cc9-9098-4dd3-9484-afd1c1b0afd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:56:00.997764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef39cc9-9098-4dd3-9484-afd1c1b0afd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:01.000671 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef39cc9-9098-4dd3-9484-afd1c1b0afd6 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:01.023738 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1070/2159] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:56:01.025047 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec550a0-4a3e-42b1-818c-cb248aa23f29 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:01.034971 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec550a0-4a3e-42b1-818c-cb248aa23f29 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:01.055355 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e214d-224c-49ff-8554-f0c193c68030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:01.055989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e214d-224c-49ff-8554-f0c193c68030 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:01.058399 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e214d-224c-49ff-8554-f0c193c68030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:01.058677 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e214d-224c-49ff-8554-f0c193c68030 admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:01.060901 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e214d-224c-49ff-8554-f0c193c68030 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:01.063867 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e214d-224c-49ff-8554-f0c193c68030 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:01.111860 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1090/2160] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:56:01 2022] POST /identity/v3/projects => generated 375 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:56:01.116592 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef39cc9-9098-4dd3-9484-afd1c1b0afd6 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:01.127562 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef39cc9-9098-4dd3-9484-afd1c1b0afd6 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:01.206590 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbabab7-529f-45a3-99e5-bf3d87d768e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:01.207311 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbabab7-529f-45a3-99e5-bf3d87d768e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:01.207780 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbabab7-529f-45a3-99e5-bf3d87d768e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:01.208134 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbabab7-529f-45a3-99e5-bf3d87d768e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:01.208878 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbabab7-529f-45a3-99e5-bf3d87d768e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:01.211239 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbabab7-529f-45a3-99e5-bf3d87d768e6 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:01.225441 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:01.251493 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1071/2161] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:56:01 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:56:01.252043 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e214d-224c-49ff-8554-f0c193c68030 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:01.264589 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e214d-224c-49ff-8554-f0c193c68030 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:01.271908 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4df4a8-1052-4cee-a2b2-b83142e13b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:01.272888 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4df4a8-1052-4cee-a2b2-b83142e13b8e admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:01.273237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4df4a8-1052-4cee-a2b2-b83142e13b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:01.273619 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4df4a8-1052-4cee-a2b2-b83142e13b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:01.274375 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4df4a8-1052-4cee-a2b2-b83142e13b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:01.276156 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4df4a8-1052-4cee-a2b2-b83142e13b8e admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:01.290923 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1091/2162] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 10:56:01.295850 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbabab7-529f-45a3-99e5-bf3d87d768e6 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:01.310477 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbabab7-529f-45a3-99e5-bf3d87d768e6 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:01.316248 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e048e-0885-402b-872c-f52f760f1913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:01.317007 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e048e-0885-402b-872c-f52f760f1913 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:01.317291 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e048e-0885-402b-872c-f52f760f1913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:01.317644 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e048e-0885-402b-872c-f52f760f1913 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:01.318313 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e048e-0885-402b-872c-f52f760f1913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:01.320535 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e048e-0885-402b-872c-f52f760f1913 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:01.356364 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1072/2163] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:56:01.364881 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4df4a8-1052-4cee-a2b2-b83142e13b8e admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:01.376357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4df4a8-1052-4cee-a2b2-b83142e13b8e admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:01.382087 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c065b55-996b-45fc-b6e8-3e169d594cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:01.382837 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c065b55-996b-45fc-b6e8-3e169d594cfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:01.383182 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c065b55-996b-45fc-b6e8-3e169d594cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:01.383917 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c065b55-996b-45fc-b6e8-3e169d594cfc admin admin] PATH_INFO: `/v3/projects/0838ba0ef89e41968bd8dbf0b162da37/users/4c8107c22c2440819d4e4e930873f1e6/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:01.403818 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c065b55-996b-45fc-b6e8-3e169d594cfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0838ba0ef89e41968bd8dbf0b162da37, user_id=4c8107c22c2440819d4e4e930873f1e6, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:01.407220 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c065b55-996b-45fc-b6e8-3e169d594cfc admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:01.433122 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1092/2164] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:56:01 2022] PUT /identity/v3/projects/0838ba0ef89e41968bd8dbf0b162da37/users/4c8107c22c2440819d4e4e930873f1e6/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:56:01.441080 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3239d-9995-4cc6-b52b-fb341ed530a0 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:01.441461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3239d-9995-4cc6-b52b-fb341ed530a0 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:01.441790 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3239d-9995-4cc6-b52b-fb341ed530a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:01.472472 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-a8d3239d-9995-4cc6-b52b-fb341ed530a0 None None] MFA Rules not processed for user `4c8107c22c2440819d4e4e930873f1e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:01.474238 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a8d3239d-9995-4cc6-b52b-fb341ed530a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:01.549332 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1073/2165] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:56:01.561769 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c065b55-996b-45fc-b6e8-3e169d594cfc admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:01.563473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-3c065b55-996b-45fc-b6e8-3e169d594cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:01.639810 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c065b55-996b-45fc-b6e8-3e169d594cfc admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:01.643528 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217328d3-04ab-4f42-ad5c-30adf20ff252 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:01.644127 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217328d3-04ab-4f42-ad5c-30adf20ff252 service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:01.644407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217328d3-04ab-4f42-ad5c-30adf20ff252 service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:01.644675 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217328d3-04ab-4f42-ad5c-30adf20ff252 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:01.653912 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217328d3-04ab-4f42-ad5c-30adf20ff252 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:01.655326 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217328d3-04ab-4f42-ad5c-30adf20ff252 service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:01.665738 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1093/2166] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:56:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:56:03.044487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499deea-b41d-4599-8bba-53c4dbbf5894 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:03.044969 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499deea-b41d-4599-8bba-53c4dbbf5894 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:03.045079 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499deea-b41d-4599-8bba-53c4dbbf5894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:03.064390 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-9499deea-b41d-4599-8bba-53c4dbbf5894 None None] MFA Rules not processed for user `4c8107c22c2440819d4e4e930873f1e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:03.065612 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-9499deea-b41d-4599-8bba-53c4dbbf5894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:03.072818 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1074/2167] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:56:06.692477 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217328d3-04ab-4f42-ad5c-30adf20ff252 service cinder] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:06.694227 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-217328d3-04ab-4f42-ad5c-30adf20ff252 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:06.748678 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:06.769331 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217328d3-04ab-4f42-ad5c-30adf20ff252 service cinder] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:06.775222 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5806a2c-672a-42ef-ac5d-6f46c087ad67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:06.775868 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5806a2c-672a-42ef-ac5d-6f46c087ad67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:06.776177 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5806a2c-672a-42ef-ac5d-6f46c087ad67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:06.776451 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5806a2c-672a-42ef-ac5d-6f46c087ad67 admin admin] PATH_INFO: `/v3/users/cfbb13bbb744494badf69f0a5266e418` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:06.777623 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5806a2c-672a-42ef-ac5d-6f46c087ad67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfbb13bbb744494badf69f0a5266e418)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:06.779537 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5806a2c-672a-42ef-ac5d-6f46c087ad67 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:06.831455 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d5806a2c-672a-42ef-ac5d-6f46c087ad67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfbb13bbb744494badf69f0a5266e418'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:06.843743 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d5806a2c-672a-42ef-ac5d-6f46c087ad67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfbb13bbb744494badf69f0a5266e418'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:06.844420 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d5806a2c-672a-42ef-ac5d-6f46c087ad67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfbb13bbb744494badf69f0a5266e418'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:06.851682 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d5806a2c-672a-42ef-ac5d-6f46c087ad67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfbb13bbb744494badf69f0a5266e418'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:06.859223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d5806a2c-672a-42ef-ac5d-6f46c087ad67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfbb13bbb744494badf69f0a5266e418'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:06.868738 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1094/2168] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:56:06 2022] DELETE /identity/v3/users/cfbb13bbb744494badf69f0a5266e418 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:56:07.047050 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499deea-b41d-4599-8bba-53c4dbbf5894 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:07.098319 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499deea-b41d-4599-8bba-53c4dbbf5894 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:07.178088 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce64a89-352d-48a4-b4cf-dc74216df40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:07.178716 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce64a89-352d-48a4-b4cf-dc74216df40a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:07.178996 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce64a89-352d-48a4-b4cf-dc74216df40a admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:07.179264 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce64a89-352d-48a4-b4cf-dc74216df40a admin admin] PATH_INFO: `/v3/projects/afc06eb6efa540fa8d303ac1536224d2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:07.180964 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce64a89-352d-48a4-b4cf-dc74216df40a admin admin] RBAC: Authorizing `identity:delete_project(project_id=afc06eb6efa540fa8d303ac1536224d2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:07.183751 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce64a89-352d-48a4-b4cf-dc74216df40a admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:07.241603 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5ce64a89-352d-48a4-b4cf-dc74216df40a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afc06eb6efa540fa8d303ac1536224d2', 'request_id': 'req-5ce64a89-352d-48a4-b4cf-dc74216df40a'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:07.249086 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5ce64a89-352d-48a4-b4cf-dc74216df40a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afc06eb6efa540fa8d303ac1536224d2', 'request_id': 'req-5ce64a89-352d-48a4-b4cf-dc74216df40a'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:07.256984 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5ce64a89-352d-48a4-b4cf-dc74216df40a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afc06eb6efa540fa8d303ac1536224d2', 'request_id': 'req-5ce64a89-352d-48a4-b4cf-dc74216df40a'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:07.270922 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:07.275353 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5ce64a89-352d-48a4-b4cf-dc74216df40a admin admin] The token cache is being invalidate because project afc06eb6efa540fa8d303ac1536224d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:56:07.276666 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5ce64a89-352d-48a4-b4cf-dc74216df40a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:07.277533 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5ce64a89-352d-48a4-b4cf-dc74216df40a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:07.280105 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1075/2169] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:56:07 2022] DELETE /identity/v3/projects/afc06eb6efa540fa8d303ac1536224d2 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:56:07.283935 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5806a2c-672a-42ef-ac5d-6f46c087ad67 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:07.286509 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-d5806a2c-672a-42ef-ac5d-6f46c087ad67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:07.303947 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5806a2c-672a-42ef-ac5d-6f46c087ad67 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:07.384651 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3cde1-ab0c-49aa-b2a1-6781bab6700f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:07.385555 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3cde1-ab0c-49aa-b2a1-6781bab6700f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:07.385836 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3cde1-ab0c-49aa-b2a1-6781bab6700f admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:07.386111 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3cde1-ab0c-49aa-b2a1-6781bab6700f admin admin] PATH_INFO: `/v3/users/f9ec421b02384e27bb31cd2ac1de1880` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:07.387250 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3cde1-ab0c-49aa-b2a1-6781bab6700f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9ec421b02384e27bb31cd2ac1de1880)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:07.389182 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3cde1-ab0c-49aa-b2a1-6781bab6700f admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:07.434942 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-18b3cde1-ab0c-49aa-b2a1-6781bab6700f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9ec421b02384e27bb31cd2ac1de1880'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:07.446526 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-18b3cde1-ab0c-49aa-b2a1-6781bab6700f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9ec421b02384e27bb31cd2ac1de1880'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:07.447177 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-18b3cde1-ab0c-49aa-b2a1-6781bab6700f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9ec421b02384e27bb31cd2ac1de1880'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:07.449096 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:07.455269 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-18b3cde1-ab0c-49aa-b2a1-6781bab6700f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9ec421b02384e27bb31cd2ac1de1880'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:07.463291 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-18b3cde1-ab0c-49aa-b2a1-6781bab6700f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9ec421b02384e27bb31cd2ac1de1880'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:07.469097 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1095/2170] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:56:07 2022] DELETE /identity/v3/users/f9ec421b02384e27bb31cd2ac1de1880 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:56:07.642250 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce64a89-352d-48a4-b4cf-dc74216df40a admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:07.643777 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-5ce64a89-352d-48a4-b4cf-dc74216df40a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:07.656950 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce64a89-352d-48a4-b4cf-dc74216df40a admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:07.714083 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c6a4d-83f1-4f47-aa59-dae325c9c630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:07.714733 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c6a4d-83f1-4f47-aa59-dae325c9c630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:07.715004 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c6a4d-83f1-4f47-aa59-dae325c9c630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:07.715270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c6a4d-83f1-4f47-aa59-dae325c9c630 admin admin] PATH_INFO: `/v3/projects/cfc3f6622e974c4ca99a8ae6bca9ce35` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:07.716374 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c6a4d-83f1-4f47-aa59-dae325c9c630 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfc3f6622e974c4ca99a8ae6bca9ce35)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:07.718329 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c6a4d-83f1-4f47-aa59-dae325c9c630 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:07.766773 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ff6c6a4d-83f1-4f47-aa59-dae325c9c630 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfc3f6622e974c4ca99a8ae6bca9ce35', 'request_id': 'req-ff6c6a4d-83f1-4f47-aa59-dae325c9c630'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:07.774885 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ff6c6a4d-83f1-4f47-aa59-dae325c9c630 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfc3f6622e974c4ca99a8ae6bca9ce35', 'request_id': 'req-ff6c6a4d-83f1-4f47-aa59-dae325c9c630'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:07.781560 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ff6c6a4d-83f1-4f47-aa59-dae325c9c630 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfc3f6622e974c4ca99a8ae6bca9ce35', 'request_id': 'req-ff6c6a4d-83f1-4f47-aa59-dae325c9c630'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:07.795558 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ff6c6a4d-83f1-4f47-aa59-dae325c9c630 admin admin] The token cache is being invalidate because project cfc3f6622e974c4ca99a8ae6bca9ce35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:56:07.796355 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ff6c6a4d-83f1-4f47-aa59-dae325c9c630 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:07.796450 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ff6c6a4d-83f1-4f47-aa59-dae325c9c630 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:07.797956 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1076/2171] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:56:07 2022] DELETE /identity/v3/projects/cfc3f6622e974c4ca99a8ae6bca9ce35 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:56:07.802891 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b269b-9d26-40c3-94a3-f96121506450 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:07.803337 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b269b-9d26-40c3-94a3-f96121506450 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:07.803431 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b269b-9d26-40c3-94a3-f96121506450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:07.822850 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-6e2b269b-9d26-40c3-94a3-f96121506450 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:07.824049 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-6e2b269b-9d26-40c3-94a3-f96121506450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:07.882802 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1096/2172] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:56:07.890692 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f176533-a35c-447a-9047-4b1c805816db None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:07.890978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f176533-a35c-447a-9047-4b1c805816db None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:07.891251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f176533-a35c-447a-9047-4b1c805816db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:07.911876 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-6f176533-a35c-447a-9047-4b1c805816db None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:07.913068 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-6f176533-a35c-447a-9047-4b1c805816db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:07.920933 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1077/2173] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:56:07.925144 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b269b-9d26-40c3-94a3-f96121506450 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:07.935147 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b269b-9d26-40c3-94a3-f96121506450 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:07.939757 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727605b-cb25-4899-aa83-b982603502b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:07.940355 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727605b-cb25-4899-aa83-b982603502b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:07.940627 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727605b-cb25-4899-aa83-b982603502b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:07.940902 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727605b-cb25-4899-aa83-b982603502b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:07.941609 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e727605b-cb25-4899-aa83-b982603502b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:56:07.942397 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e727605b-cb25-4899-aa83-b982603502b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:07.944063 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e727605b-cb25-4899-aa83-b982603502b0 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:07.956066 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1097/2174] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:56:07.961110 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f176533-a35c-447a-9047-4b1c805816db None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:07.970379 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f176533-a35c-447a-9047-4b1c805816db None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:07.974987 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707c422-aa42-46b6-9c06-62a056275f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:07.975565 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707c422-aa42-46b6-9c06-62a056275f64 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:07.975837 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707c422-aa42-46b6-9c06-62a056275f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:07.976102 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707c422-aa42-46b6-9c06-62a056275f64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:07.976724 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707c422-aa42-46b6-9c06-62a056275f64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:07.978630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707c422-aa42-46b6-9c06-62a056275f64 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:08.004922 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1078/2175] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:56:07 2022] POST /identity/v3/projects => generated 361 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:56:08.009387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727605b-cb25-4899-aa83-b982603502b0 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:08.019502 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727605b-cb25-4899-aa83-b982603502b0 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:08.081975 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8bb09-18a2-4595-9f7c-6bd00e12ad1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:08.083227 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8bb09-18a2-4595-9f7c-6bd00e12ad1a admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:08.083496 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8bb09-18a2-4595-9f7c-6bd00e12ad1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:08.083760 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8bb09-18a2-4595-9f7c-6bd00e12ad1a admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:08.084402 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8bb09-18a2-4595-9f7c-6bd00e12ad1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:08.086356 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8bb09-18a2-4595-9f7c-6bd00e12ad1a admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:08.106402 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1098/2176] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:56:08 2022] POST /identity/v3/users => generated 281 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:56:08.110827 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707c422-aa42-46b6-9c06-62a056275f64 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:08.120971 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707c422-aa42-46b6-9c06-62a056275f64 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:08.125578 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c001c5-a03a-49c1-b86e-3089ace12423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:08.126158 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c001c5-a03a-49c1-b86e-3089ace12423 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:08.126429 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c001c5-a03a-49c1-b86e-3089ace12423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:08.126690 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c001c5-a03a-49c1-b86e-3089ace12423 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:08.127322 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c001c5-a03a-49c1-b86e-3089ace12423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:08.128890 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c001c5-a03a-49c1-b86e-3089ace12423 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:08.139234 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1079/2177] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:56:08.142958 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8bb09-18a2-4595-9f7c-6bd00e12ad1a admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:08.153404 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8bb09-18a2-4595-9f7c-6bd00e12ad1a admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:08.157986 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d14f52-89c5-4351-9145-cd32be579809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:08.158566 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d14f52-89c5-4351-9145-cd32be579809 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:08.158843 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d14f52-89c5-4351-9145-cd32be579809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:08.159114 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d14f52-89c5-4351-9145-cd32be579809 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:08.159753 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d14f52-89c5-4351-9145-cd32be579809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:08.161342 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d14f52-89c5-4351-9145-cd32be579809 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:08.171587 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1099/2178] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:56:08.175595 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c001c5-a03a-49c1-b86e-3089ace12423 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:08.185426 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c001c5-a03a-49c1-b86e-3089ace12423 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:08.190039 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399ed9d-36d0-4a7e-93b6-cd398ae197b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:08.190656 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399ed9d-36d0-4a7e-93b6-cd398ae197b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:08.190930 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399ed9d-36d0-4a7e-93b6-cd398ae197b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:08.191195 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399ed9d-36d0-4a7e-93b6-cd398ae197b6 admin admin] PATH_INFO: `/v3/projects/b24a86fb98f24f258de5af2ed14fcb75/users/ab94fe906be1414f95bd7f09e7711f35/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:08.205638 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399ed9d-36d0-4a7e-93b6-cd398ae197b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b24a86fb98f24f258de5af2ed14fcb75, user_id=ab94fe906be1414f95bd7f09e7711f35, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:08.208883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399ed9d-36d0-4a7e-93b6-cd398ae197b6 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:08.221846 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1080/2179] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:56:08 2022] PUT /identity/v3/projects/b24a86fb98f24f258de5af2ed14fcb75/users/ab94fe906be1414f95bd7f09e7711f35/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:56:08.232137 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f831c-5fcd-4fe2-9802-8370456f0b8b None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:08.232414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f831c-5fcd-4fe2-9802-8370456f0b8b None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:08.232687 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f831c-5fcd-4fe2-9802-8370456f0b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:08.269205 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-9a4f831c-5fcd-4fe2-9802-8370456f0b8b None None] MFA Rules not processed for user `ab94fe906be1414f95bd7f09e7711f35`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:08.271380 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-9a4f831c-5fcd-4fe2-9802-8370456f0b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:08.311427 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:08.339973 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1100/2180] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:56:08.376907 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399ed9d-36d0-4a7e-93b6-cd398ae197b6 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:08.378657 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-d399ed9d-36d0-4a7e-93b6-cd398ae197b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:08.409614 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:08.443436 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399ed9d-36d0-4a7e-93b6-cd398ae197b6 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:08.447485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9625e-e820-4820-8edf-bfc2df6f15b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:08.448170 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9625e-e820-4820-8edf-bfc2df6f15b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:08.448519 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9625e-e820-4820-8edf-bfc2df6f15b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:08.448865 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9625e-e820-4820-8edf-bfc2df6f15b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:08.457932 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9625e-e820-4820-8edf-bfc2df6f15b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:08.459394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a9625e-e820-4820-8edf-bfc2df6f15b4 service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:08.468667 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1081/2181] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:56:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:56:08.487198 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f831c-5fcd-4fe2-9802-8370456f0b8b None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:08.556321 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f831c-5fcd-4fe2-9802-8370456f0b8b None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:08.560917 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16d668-287b-49ee-ae20-fdaae2e2397c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:08.561571 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16d668-287b-49ee-ae20-fdaae2e2397c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:08.561853 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16d668-287b-49ee-ae20-fdaae2e2397c admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:08.562127 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16d668-287b-49ee-ae20-fdaae2e2397c admin admin] PATH_INFO: `/v3/users/ab94fe906be1414f95bd7f09e7711f35` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:08.563465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16d668-287b-49ee-ae20-fdaae2e2397c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab94fe906be1414f95bd7f09e7711f35)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:08.565622 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16d668-287b-49ee-ae20-fdaae2e2397c admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:08.622322 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-ee16d668-287b-49ee-ae20-fdaae2e2397c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab94fe906be1414f95bd7f09e7711f35'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:08.634792 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-ee16d668-287b-49ee-ae20-fdaae2e2397c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab94fe906be1414f95bd7f09e7711f35'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:08.635458 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-ee16d668-287b-49ee-ae20-fdaae2e2397c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab94fe906be1414f95bd7f09e7711f35'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:08.642389 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-ee16d668-287b-49ee-ae20-fdaae2e2397c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab94fe906be1414f95bd7f09e7711f35'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:08.649556 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-ee16d668-287b-49ee-ae20-fdaae2e2397c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab94fe906be1414f95bd7f09e7711f35'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:08.655296 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1101/2182] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:56:08 2022] DELETE /identity/v3/users/ab94fe906be1414f95bd7f09e7711f35 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:56:08.659878 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0256c66-02eb-4658-b036-01714e62ed19 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:08.660154 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0256c66-02eb-4658-b036-01714e62ed19 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:08.660416 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0256c66-02eb-4658-b036-01714e62ed19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:08.680460 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-f0256c66-02eb-4658-b036-01714e62ed19 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:08.681673 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-f0256c66-02eb-4658-b036-01714e62ed19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:08.742846 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1082/2183] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:56:08.752328 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16d668-287b-49ee-ae20-fdaae2e2397c admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:08.753807 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-ee16d668-287b-49ee-ae20-fdaae2e2397c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:08.810594 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16d668-287b-49ee-ae20-fdaae2e2397c admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:08.814287 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3e8e9-38c9-4e03-b26d-e47ee7f0a51d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:08.814903 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3e8e9-38c9-4e03-b26d-e47ee7f0a51d service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:08.815178 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3e8e9-38c9-4e03-b26d-e47ee7f0a51d service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:08.815443 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3e8e9-38c9-4e03-b26d-e47ee7f0a51d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:08.824592 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d3e8e9-38c9-4e03-b26d-e47ee7f0a51d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:08.826046 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d3e8e9-38c9-4e03-b26d-e47ee7f0a51d service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:08.835361 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1102/2184] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:56:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 10:56:09.104571 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0256c66-02eb-4658-b036-01714e62ed19 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:09.106018 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-f0256c66-02eb-4658-b036-01714e62ed19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:09.117920 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0256c66-02eb-4658-b036-01714e62ed19 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:09.122745 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb1e76-7c55-42be-ad94-432bbbee0993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:09.123380 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb1e76-7c55-42be-ad94-432bbbee0993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:09.123750 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb1e76-7c55-42be-ad94-432bbbee0993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:09.124014 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb1e76-7c55-42be-ad94-432bbbee0993 admin admin] PATH_INFO: `/v3/projects/b24a86fb98f24f258de5af2ed14fcb75` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:09.125207 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb1e76-7c55-42be-ad94-432bbbee0993 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b24a86fb98f24f258de5af2ed14fcb75)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:09.127315 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb1e76-7c55-42be-ad94-432bbbee0993 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:09.177562 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-85eb1e76-7c55-42be-ad94-432bbbee0993 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b24a86fb98f24f258de5af2ed14fcb75', 'request_id': 'req-85eb1e76-7c55-42be-ad94-432bbbee0993'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:09.183046 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-85eb1e76-7c55-42be-ad94-432bbbee0993 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b24a86fb98f24f258de5af2ed14fcb75', 'request_id': 'req-85eb1e76-7c55-42be-ad94-432bbbee0993'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:09.189020 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-85eb1e76-7c55-42be-ad94-432bbbee0993 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b24a86fb98f24f258de5af2ed14fcb75', 'request_id': 'req-85eb1e76-7c55-42be-ad94-432bbbee0993'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:09.200856 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-85eb1e76-7c55-42be-ad94-432bbbee0993 admin admin] The token cache is being invalidate because project b24a86fb98f24f258de5af2ed14fcb75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:56:09.201139 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-85eb1e76-7c55-42be-ad94-432bbbee0993 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:09.201791 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-85eb1e76-7c55-42be-ad94-432bbbee0993 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:09.203271 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1083/2185] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:56:09 2022] DELETE /identity/v3/projects/b24a86fb98f24f258de5af2ed14fcb75 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:56:09.208632 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649e13a-6da3-431f-b72b-5e6586ea5ca4 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:09.208913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649e13a-6da3-431f-b72b-5e6586ea5ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:09.209181 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649e13a-6da3-431f-b72b-5e6586ea5ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:09.216855 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:09.231320 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-4649e13a-6da3-431f-b72b-5e6586ea5ca4 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:09.232592 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-4649e13a-6da3-431f-b72b-5e6586ea5ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:09.295275 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1103/2186] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:56:09.303731 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937e6eb-c1d9-42c2-83ef-83b7ef9f890a None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:09.304040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937e6eb-c1d9-42c2-83ef-83b7ef9f890a None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:09.304337 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937e6eb-c1d9-42c2-83ef-83b7ef9f890a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:09.323441 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-7937e6eb-c1d9-42c2-83ef-83b7ef9f890a None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:09.324625 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-7937e6eb-c1d9-42c2-83ef-83b7ef9f890a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:09.332846 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1084/2187] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:56:09.336976 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649e13a-6da3-431f-b72b-5e6586ea5ca4 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:09.346766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649e13a-6da3-431f-b72b-5e6586ea5ca4 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:09.352585 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490fbffb-af54-4129-90f3-03a8ada9dd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:09.353173 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490fbffb-af54-4129-90f3-03a8ada9dd92 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:09.353488 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490fbffb-af54-4129-90f3-03a8ada9dd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:09.353761 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490fbffb-af54-4129-90f3-03a8ada9dd92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:09.354406 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490fbffb-af54-4129-90f3-03a8ada9dd92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:56:09.354707 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490fbffb-af54-4129-90f3-03a8ada9dd92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:09.356281 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490fbffb-af54-4129-90f3-03a8ada9dd92 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:09.367742 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1104/2188] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:56:09.371955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937e6eb-c1d9-42c2-83ef-83b7ef9f890a None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:09.381358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937e6eb-c1d9-42c2-83ef-83b7ef9f890a None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:09.385978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a892a-ea66-4f2d-ae2b-b20d8aa254ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:09.386553 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a892a-ea66-4f2d-ae2b-b20d8aa254ba admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:09.386828 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a892a-ea66-4f2d-ae2b-b20d8aa254ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:09.387089 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a892a-ea66-4f2d-ae2b-b20d8aa254ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:09.387709 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a892a-ea66-4f2d-ae2b-b20d8aa254ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:09.389632 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a892a-ea66-4f2d-ae2b-b20d8aa254ba admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:09.416867 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1085/2189] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:56:09 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:56:09.420952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490fbffb-af54-4129-90f3-03a8ada9dd92 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:09.430769 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490fbffb-af54-4129-90f3-03a8ada9dd92 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:09.485488 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a122ebe6-8957-4d58-82cc-b33cc80382b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:09.486074 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122ebe6-8957-4d58-82cc-b33cc80382b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:09.486350 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122ebe6-8957-4d58-82cc-b33cc80382b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:09.486618 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122ebe6-8957-4d58-82cc-b33cc80382b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:09.487221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a122ebe6-8957-4d58-82cc-b33cc80382b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:09.489094 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a122ebe6-8957-4d58-82cc-b33cc80382b4 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:09.509816 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1105/2190] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:56:09 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 10:56:09.514145 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a892a-ea66-4f2d-ae2b-b20d8aa254ba admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:09.524960 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a892a-ea66-4f2d-ae2b-b20d8aa254ba admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:09.529624 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11822d81-f27d-44ff-acbf-50c8225c5807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:09.530205 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11822d81-f27d-44ff-acbf-50c8225c5807 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:09.530479 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11822d81-f27d-44ff-acbf-50c8225c5807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:09.530770 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11822d81-f27d-44ff-acbf-50c8225c5807 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:09.531407 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11822d81-f27d-44ff-acbf-50c8225c5807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:09.532965 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11822d81-f27d-44ff-acbf-50c8225c5807 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:09.544133 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1086/2191] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 10:56:09.548359 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a122ebe6-8957-4d58-82cc-b33cc80382b4 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:09.558827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a122ebe6-8957-4d58-82cc-b33cc80382b4 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:09.564903 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb953d4d-144f-4cd6-95a9-c70606646bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:09.565557 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb953d4d-144f-4cd6-95a9-c70606646bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:09.565832 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb953d4d-144f-4cd6-95a9-c70606646bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:09.566097 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb953d4d-144f-4cd6-95a9-c70606646bb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:09.567583 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb953d4d-144f-4cd6-95a9-c70606646bb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:09.569215 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb953d4d-144f-4cd6-95a9-c70606646bb2 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:09.580443 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1106/2192] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:56:09.585343 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11822d81-f27d-44ff-acbf-50c8225c5807 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:09.597502 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11822d81-f27d-44ff-acbf-50c8225c5807 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:09.603699 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb057bd-c933-4e20-8c1b-f44cb51c79f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:09.604323 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb057bd-c933-4e20-8c1b-f44cb51c79f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:09.604677 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb057bd-c933-4e20-8c1b-f44cb51c79f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:09.605027 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb057bd-c933-4e20-8c1b-f44cb51c79f8 admin admin] PATH_INFO: `/v3/projects/cebf980612fb4b76b4aa227239c611b8/users/754ee5d8cd874fc3a958c9b923d276c8/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:09.615697 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:09.627352 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb057bd-c933-4e20-8c1b-f44cb51c79f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cebf980612fb4b76b4aa227239c611b8, user_id=754ee5d8cd874fc3a958c9b923d276c8, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:09.631623 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb057bd-c933-4e20-8c1b-f44cb51c79f8 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:09.646856 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1087/2193] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:56:09 2022] PUT /identity/v3/projects/cebf980612fb4b76b4aa227239c611b8/users/754ee5d8cd874fc3a958c9b923d276c8/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:56:09.657130 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df994850-0641-43ca-adf3-4e67e1970123 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:09.657527 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df994850-0641-43ca-adf3-4e67e1970123 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:09.657866 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df994850-0641-43ca-adf3-4e67e1970123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:09.687975 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-df994850-0641-43ca-adf3-4e67e1970123 None None] MFA Rules not processed for user `754ee5d8cd874fc3a958c9b923d276c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:09.689205 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-df994850-0641-43ca-adf3-4e67e1970123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:09.760058 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:09.769628 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1107/2194] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:56:09.777803 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb057bd-c933-4e20-8c1b-f44cb51c79f8 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:09.779686 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-0cb057bd-c933-4e20-8c1b-f44cb51c79f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:09.855226 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb057bd-c933-4e20-8c1b-f44cb51c79f8 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:09.859154 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb00af3-c076-4ef9-9bb2-99d978f85485 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:09.859754 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb00af3-c076-4ef9-9bb2-99d978f85485 service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:09.860062 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb00af3-c076-4ef9-9bb2-99d978f85485 service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:09.860333 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb00af3-c076-4ef9-9bb2-99d978f85485 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:09.869693 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb00af3-c076-4ef9-9bb2-99d978f85485 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:09.871119 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb00af3-c076-4ef9-9bb2-99d978f85485 service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:09.881178 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1088/2195] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:56:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:56:12.886208 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df994850-0641-43ca-adf3-4e67e1970123 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:12.947014 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df994850-0641-43ca-adf3-4e67e1970123 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:12.951522 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee2f47-eaf7-42b3-ac77-f65f6e85372d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:12.952136 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee2f47-eaf7-42b3-ac77-f65f6e85372d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:12.952411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee2f47-eaf7-42b3-ac77-f65f6e85372d admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:12.952680 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee2f47-eaf7-42b3-ac77-f65f6e85372d admin admin] PATH_INFO: `/v3/users/754ee5d8cd874fc3a958c9b923d276c8` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:12.953852 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee2f47-eaf7-42b3-ac77-f65f6e85372d admin admin] RBAC: Authorizing `identity:delete_user(user_id=754ee5d8cd874fc3a958c9b923d276c8)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:12.955752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee2f47-eaf7-42b3-ac77-f65f6e85372d admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:13.002677 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-98ee2f47-eaf7-42b3-ac77-f65f6e85372d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '754ee5d8cd874fc3a958c9b923d276c8'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:13.014667 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-98ee2f47-eaf7-42b3-ac77-f65f6e85372d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '754ee5d8cd874fc3a958c9b923d276c8'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:13.015321 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-98ee2f47-eaf7-42b3-ac77-f65f6e85372d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '754ee5d8cd874fc3a958c9b923d276c8'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:13.022810 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-98ee2f47-eaf7-42b3-ac77-f65f6e85372d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '754ee5d8cd874fc3a958c9b923d276c8'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:13.029749 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-98ee2f47-eaf7-42b3-ac77-f65f6e85372d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '754ee5d8cd874fc3a958c9b923d276c8'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:13.036095 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1108/2196] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:56:12 2022] DELETE /identity/v3/users/754ee5d8cd874fc3a958c9b923d276c8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:56:13.040503 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acb19b-1152-404c-a1bc-7f565a38dc59 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:13.040963 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acb19b-1152-404c-a1bc-7f565a38dc59 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:13.041052 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acb19b-1152-404c-a1bc-7f565a38dc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:13.059191 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-c0acb19b-1152-404c-a1bc-7f565a38dc59 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:13.060373 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-c0acb19b-1152-404c-a1bc-7f565a38dc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:13.117232 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1089/2197] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:56:13.126624 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee2f47-eaf7-42b3-ac77-f65f6e85372d admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:13.128014 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-98ee2f47-eaf7-42b3-ac77-f65f6e85372d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:13.183611 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee2f47-eaf7-42b3-ac77-f65f6e85372d admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:13.187463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb48459-7a7a-4840-8707-0b4b8672f4fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:13.188058 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb48459-7a7a-4840-8707-0b4b8672f4fb service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:13.188329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb48459-7a7a-4840-8707-0b4b8672f4fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:13.188591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb48459-7a7a-4840-8707-0b4b8672f4fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:13.197992 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb48459-7a7a-4840-8707-0b4b8672f4fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:13.200975 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb48459-7a7a-4840-8707-0b4b8672f4fb service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:13.210577 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1109/2198] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:56:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 10:56:13.526655 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0acb19b-1152-404c-a1bc-7f565a38dc59 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:13.528184 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-c0acb19b-1152-404c-a1bc-7f565a38dc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:13.540672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0acb19b-1152-404c-a1bc-7f565a38dc59 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:13.547487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110c3e9-2c9d-4729-9af5-865c68f7694d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:13.548112 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110c3e9-2c9d-4729-9af5-865c68f7694d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:13.548776 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110c3e9-2c9d-4729-9af5-865c68f7694d admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:13.548776 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110c3e9-2c9d-4729-9af5-865c68f7694d admin admin] PATH_INFO: `/v3/projects/cebf980612fb4b76b4aa227239c611b8` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:13.561922 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110c3e9-2c9d-4729-9af5-865c68f7694d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cebf980612fb4b76b4aa227239c611b8)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:13.564017 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110c3e9-2c9d-4729-9af5-865c68f7694d admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:13.621790 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0110c3e9-2c9d-4729-9af5-865c68f7694d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cebf980612fb4b76b4aa227239c611b8', 'request_id': 'req-0110c3e9-2c9d-4729-9af5-865c68f7694d'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:13.630243 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0110c3e9-2c9d-4729-9af5-865c68f7694d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cebf980612fb4b76b4aa227239c611b8', 'request_id': 'req-0110c3e9-2c9d-4729-9af5-865c68f7694d'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:13.636787 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0110c3e9-2c9d-4729-9af5-865c68f7694d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cebf980612fb4b76b4aa227239c611b8', 'request_id': 'req-0110c3e9-2c9d-4729-9af5-865c68f7694d'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:13.650452 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0110c3e9-2c9d-4729-9af5-865c68f7694d admin admin] The token cache is being invalidate because project cebf980612fb4b76b4aa227239c611b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:56:13.650744 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0110c3e9-2c9d-4729-9af5-865c68f7694d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:13.651365 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0110c3e9-2c9d-4729-9af5-865c68f7694d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:13.652933 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1090/2199] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:56:13 2022] DELETE /identity/v3/projects/cebf980612fb4b76b4aa227239c611b8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:56:13.657901 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659fdd7-b3b1-4064-94f9-ff1c54997690 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:13.658219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659fdd7-b3b1-4064-94f9-ff1c54997690 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:13.658489 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659fdd7-b3b1-4064-94f9-ff1c54997690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:13.679717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-b659fdd7-b3b1-4064-94f9-ff1c54997690 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:13.680919 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-b659fdd7-b3b1-4064-94f9-ff1c54997690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:13.694823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:13.744795 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1110/2200] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:56:13.752468 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78097a8f-51c0-4984-9ef8-24f582817924 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:13.752751 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78097a8f-51c0-4984-9ef8-24f582817924 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:13.753025 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78097a8f-51c0-4984-9ef8-24f582817924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:13.778975 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-78097a8f-51c0-4984-9ef8-24f582817924 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:13.780346 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-78097a8f-51c0-4984-9ef8-24f582817924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:13.792290 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1091/2201] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:56:13.793700 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659fdd7-b3b1-4064-94f9-ff1c54997690 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:13.803412 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659fdd7-b3b1-4064-94f9-ff1c54997690 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:13.808060 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33eb69a-1bb7-448d-9635-20103d38db2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:13.808646 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33eb69a-1bb7-448d-9635-20103d38db2a admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:13.808921 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33eb69a-1bb7-448d-9635-20103d38db2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:13.809190 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33eb69a-1bb7-448d-9635-20103d38db2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:13.809944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33eb69a-1bb7-448d-9635-20103d38db2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:56:13.810271 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33eb69a-1bb7-448d-9635-20103d38db2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:13.811838 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33eb69a-1bb7-448d-9635-20103d38db2a admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:13.823092 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1111/2202] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:56:13.827306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78097a8f-51c0-4984-9ef8-24f582817924 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:13.837012 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78097a8f-51c0-4984-9ef8-24f582817924 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:13.841613 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c5bcb-7bae-4dea-8185-31af76dd6d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:13.842191 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c5bcb-7bae-4dea-8185-31af76dd6d85 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:13.842465 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c5bcb-7bae-4dea-8185-31af76dd6d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:13.842730 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c5bcb-7bae-4dea-8185-31af76dd6d85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:13.843339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c5bcb-7bae-4dea-8185-31af76dd6d85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:13.845194 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c5bcb-7bae-4dea-8185-31af76dd6d85 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:13.850276 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:13.873737 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1092/2203] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:56:13 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:56:13.877792 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33eb69a-1bb7-448d-9635-20103d38db2a admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:13.888267 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33eb69a-1bb7-448d-9635-20103d38db2a admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:13.946617 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b53777-e502-4e6d-b532-7dc42b1ea690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:13.947204 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b53777-e502-4e6d-b532-7dc42b1ea690 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:13.947478 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b53777-e502-4e6d-b532-7dc42b1ea690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:13.947741 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b53777-e502-4e6d-b532-7dc42b1ea690 admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:13.948360 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b53777-e502-4e6d-b532-7dc42b1ea690 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:13.950371 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b53777-e502-4e6d-b532-7dc42b1ea690 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:13.974697 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1112/2204] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:56:13 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 10:56:13.975929 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c5bcb-7bae-4dea-8185-31af76dd6d85 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:13.986151 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c5bcb-7bae-4dea-8185-31af76dd6d85 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:13.990794 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc47be-31cd-4c4c-b054-009c8fe095c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:13.991420 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc47be-31cd-4c4c-b054-009c8fe095c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:13.991689 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc47be-31cd-4c4c-b054-009c8fe095c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:13.991956 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc47be-31cd-4c4c-b054-009c8fe095c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:13.992597 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc47be-31cd-4c4c-b054-009c8fe095c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:13.994208 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc47be-31cd-4c4c-b054-009c8fe095c5 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:14.004768 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1093/2205] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:56:14.008817 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b53777-e502-4e6d-b532-7dc42b1ea690 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:14.019188 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b53777-e502-4e6d-b532-7dc42b1ea690 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:14.025031 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a8683-4645-4699-bb27-a6824eeaff68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:14.025661 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a8683-4645-4699-bb27-a6824eeaff68 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:14.025939 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a8683-4645-4699-bb27-a6824eeaff68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:14.026207 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a8683-4645-4699-bb27-a6824eeaff68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:14.026879 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a8683-4645-4699-bb27-a6824eeaff68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:14.028677 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a8683-4645-4699-bb27-a6824eeaff68 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:14.040457 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1113/2206] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:56:14.044860 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc47be-31cd-4c4c-b054-009c8fe095c5 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:14.055398 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc47be-31cd-4c4c-b054-009c8fe095c5 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:14.060040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656130c8-e4bf-4fac-bfc2-0bae4771320b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:14.060688 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656130c8-e4bf-4fac-bfc2-0bae4771320b admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:14.060967 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656130c8-e4bf-4fac-bfc2-0bae4771320b admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:14.061275 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656130c8-e4bf-4fac-bfc2-0bae4771320b admin admin] PATH_INFO: `/v3/projects/8d66a455c35944a0a181b303da79f261/users/5f3264f99c3345eb85930e7818f16cde/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:14.078402 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656130c8-e4bf-4fac-bfc2-0bae4771320b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d66a455c35944a0a181b303da79f261, user_id=5f3264f99c3345eb85930e7818f16cde, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:14.081095 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656130c8-e4bf-4fac-bfc2-0bae4771320b admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:14.094715 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1094/2207] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:56:14 2022] PUT /identity/v3/projects/8d66a455c35944a0a181b303da79f261/users/5f3264f99c3345eb85930e7818f16cde/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:56:14.101473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e496d1-bf47-49bc-896e-5b4be7918142 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:14.101758 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e496d1-bf47-49bc-896e-5b4be7918142 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:14.102029 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e496d1-bf47-49bc-896e-5b4be7918142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:14.120331 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-18e496d1-bf47-49bc-896e-5b4be7918142 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:14.121567 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-18e496d1-bf47-49bc-896e-5b4be7918142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:14.184672 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1114/2208] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:56:14.197380 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656130c8-e4bf-4fac-bfc2-0bae4771320b admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:14.199093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-656130c8-e4bf-4fac-bfc2-0bae4771320b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:14.258155 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656130c8-e4bf-4fac-bfc2-0bae4771320b admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:14.261833 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3644a-ce65-4676-90c9-18186ed026cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:14.262429 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3644a-ce65-4676-90c9-18186ed026cb service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:14.262704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3644a-ce65-4676-90c9-18186ed026cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:14.262975 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3644a-ce65-4676-90c9-18186ed026cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:14.274393 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3644a-ce65-4676-90c9-18186ed026cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:14.275899 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3644a-ce65-4676-90c9-18186ed026cb service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:14.285294 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1095/2209] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:56:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:56:14.984691 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30890c-736e-4326-a80f-3d384dc81599 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:14.985220 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30890c-736e-4326-a80f-3d384dc81599 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:14.985220 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30890c-736e-4326-a80f-3d384dc81599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:15.014015 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-2f30890c-736e-4326-a80f-3d384dc81599 None None] MFA Rules not processed for user `5f3264f99c3345eb85930e7818f16cde`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:15.015237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-2f30890c-736e-4326-a80f-3d384dc81599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:15.056805 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:15.114636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1115/2210] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:56:15.125249 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3644a-ce65-4676-90c9-18186ed026cb service neutron] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:15.126765 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-50a3644a-ce65-4676-90c9-18186ed026cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:15.185591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3644a-ce65-4676-90c9-18186ed026cb service neutron] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:15.189112 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5bd04e-4b7d-41b7-8f4c-d24d2cac6662 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:15.189739 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5bd04e-4b7d-41b7-8f4c-d24d2cac6662 service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:15.190012 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5bd04e-4b7d-41b7-8f4c-d24d2cac6662 service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:15.190275 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5bd04e-4b7d-41b7-8f4c-d24d2cac6662 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:15.198904 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5bd04e-4b7d-41b7-8f4c-d24d2cac6662 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:15.200625 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5bd04e-4b7d-41b7-8f4c-d24d2cac6662 service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:15.209214 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1096/2211] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:56:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:56:17.680171 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70257163-a92f-4bc1-a19f-7858ad887889 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:17.680734 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70257163-a92f-4bc1-a19f-7858ad887889 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:17.680734 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70257163-a92f-4bc1-a19f-7858ad887889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:17.703324 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-70257163-a92f-4bc1-a19f-7858ad887889 None None] MFA Rules not processed for user `5f3264f99c3345eb85930e7818f16cde`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:17.704528 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-70257163-a92f-4bc1-a19f-7858ad887889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:17.716266 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1116/2212] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:56:24.929015 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1d6fe-f84e-41a5-8dfd-40db948ea040 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:24.929565 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1d6fe-f84e-41a5-8dfd-40db948ea040 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:24.929666 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1d6fe-f84e-41a5-8dfd-40db948ea040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:24.951823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-4cb1d6fe-f84e-41a5-8dfd-40db948ea040 None None] MFA Rules not processed for user `e7eebb4bd7e04ff8bc4304a40cf6ba35`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:24.953395 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-4cb1d6fe-f84e-41a5-8dfd-40db948ea040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:25.008590 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:25.020725 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1097/2213] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 7 10:56:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:56:25.092317 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70257163-a92f-4bc1-a19f-7858ad887889 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:25.094202 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-70257163-a92f-4bc1-a19f-7858ad887889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:25.182616 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70257163-a92f-4bc1-a19f-7858ad887889 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:25.187864 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feaf182-b189-472d-ba81-88a6cf777ba8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7181e5118c547a3a31d2e080c25ff01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:25.189078 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feaf182-b189-472d-ba81-88a6cf777ba8 service swift] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:25.189396 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feaf182-b189-472d-ba81-88a6cf777ba8 service swift] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:25.189675 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feaf182-b189-472d-ba81-88a6cf777ba8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:25.199428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feaf182-b189-472d-ba81-88a6cf777ba8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:25.201081 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feaf182-b189-472d-ba81-88a6cf777ba8 service swift] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:25.209750 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1117/2214] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 7 10:56:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 10:56:25.843973 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b17c1-f824-4d2c-ac55-2dc5693086f2 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:25.844257 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b17c1-f824-4d2c-ac55-2dc5693086f2 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:25.844527 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b17c1-f824-4d2c-ac55-2dc5693086f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:25.867093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-1e5b17c1-f824-4d2c-ac55-2dc5693086f2 None None] MFA Rules not processed for user `e7eebb4bd7e04ff8bc4304a40cf6ba35`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:25.868619 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-1e5b17c1-f824-4d2c-ac55-2dc5693086f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:25.877715 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1098/2215] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 7 10:56:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:56:25.891072 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feaf182-b189-472d-ba81-88a6cf777ba8 service swift] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:25.902337 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feaf182-b189-472d-ba81-88a6cf777ba8 service swift] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:25.907254 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51f746-cb5c-4015-8f6e-6dd529614465 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7181e5118c547a3a31d2e080c25ff01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:25.907837 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51f746-cb5c-4015-8f6e-6dd529614465 service swift] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:25.908107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51f746-cb5c-4015-8f6e-6dd529614465 service swift] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:25.908375 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51f746-cb5c-4015-8f6e-6dd529614465 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:25.917570 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51f746-cb5c-4015-8f6e-6dd529614465 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:25.919170 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51f746-cb5c-4015-8f6e-6dd529614465 service swift] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:25.927531 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1118/2216] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 7 10:56:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 10:56:26.229038 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e87577-85ae-4ebb-a6fe-5119e5c93cc0 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:26.229982 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e87577-85ae-4ebb-a6fe-5119e5c93cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:26.230396 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e87577-85ae-4ebb-a6fe-5119e5c93cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:26.254675 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-d4e87577-85ae-4ebb-a6fe-5119e5c93cc0 None None] MFA Rules not processed for user `e7eebb4bd7e04ff8bc4304a40cf6ba35`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:26.256952 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-d4e87577-85ae-4ebb-a6fe-5119e5c93cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:26.265426 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1099/2217] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 7 10:56:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:56:26.278013 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51f746-cb5c-4015-8f6e-6dd529614465 service swift] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:26.288515 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51f746-cb5c-4015-8f6e-6dd529614465 service swift] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:26.294061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ebff0-dd52-4e71-954b-48c8fe295c64 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7181e5118c547a3a31d2e080c25ff01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:26.294683 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ebff0-dd52-4e71-954b-48c8fe295c64 service swift] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:26.294957 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ebff0-dd52-4e71-954b-48c8fe295c64 service swift] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:26.295228 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ebff0-dd52-4e71-954b-48c8fe295c64 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:26.304123 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ebff0-dd52-4e71-954b-48c8fe295c64 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:26.305735 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ebff0-dd52-4e71-954b-48c8fe295c64 service swift] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:26.314055 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1119/2218] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 7 10:56:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 07 10:56:26.689872 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a711c-75b7-4f4a-a489-690343396214 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:26.690160 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a711c-75b7-4f4a-a489-690343396214 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:26.690439 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a711c-75b7-4f4a-a489-690343396214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:26.711202 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-8d3a711c-75b7-4f4a-a489-690343396214 None None] MFA Rules not processed for user `e7eebb4bd7e04ff8bc4304a40cf6ba35`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:26.712354 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-8d3a711c-75b7-4f4a-a489-690343396214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:26.719736 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1100/2219] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 7 10:56:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:56:26.732841 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ebff0-dd52-4e71-954b-48c8fe295c64 service swift] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:26.744890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ebff0-dd52-4e71-954b-48c8fe295c64 service swift] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:26.750019 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddaf608-2d5f-4430-bbba-e25654709575 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7181e5118c547a3a31d2e080c25ff01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:26.750606 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddaf608-2d5f-4430-bbba-e25654709575 service swift] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:26.750913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddaf608-2d5f-4430-bbba-e25654709575 service swift] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:26.751191 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddaf608-2d5f-4430-bbba-e25654709575 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:26.759931 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddaf608-2d5f-4430-bbba-e25654709575 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:26.761547 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddaf608-2d5f-4430-bbba-e25654709575 service swift] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:26.769990 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1120/2220] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 7 10:56:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 10:56:26.786998 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fa523-cea2-473d-9cce-f29138847743 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:26.787295 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fa523-cea2-473d-9cce-f29138847743 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:26.787573 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fa523-cea2-473d-9cce-f29138847743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:26.808410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-b95fa523-cea2-473d-9cce-f29138847743 None None] MFA Rules not processed for user `7696bfdd618a47eb91753adb60ea7812`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:26.809767 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-b95fa523-cea2-473d-9cce-f29138847743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:26.871638 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1101/2221] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:56:28.970500 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddaf608-2d5f-4430-bbba-e25654709575 service swift] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:28.972055 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-9ddaf608-2d5f-4430-bbba-e25654709575 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:28.988056 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddaf608-2d5f-4430-bbba-e25654709575 service swift] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:28.993298 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3f026-7496-4dfd-ac84-9557f18f36bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:28.993938 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3f026-7496-4dfd-ac84-9557f18f36bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:28.994224 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3f026-7496-4dfd-ac84-9557f18f36bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:28.994499 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3f026-7496-4dfd-ac84-9557f18f36bd admin admin] PATH_INFO: `/v3/users/4c8107c22c2440819d4e4e930873f1e6` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:28.995628 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3f026-7496-4dfd-ac84-9557f18f36bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c8107c22c2440819d4e4e930873f1e6)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:28.997582 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3f026-7496-4dfd-ac84-9557f18f36bd admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:29.052652 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-93a3f026-7496-4dfd-ac84-9557f18f36bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c8107c22c2440819d4e4e930873f1e6'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:29.058562 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:29.067918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-93a3f026-7496-4dfd-ac84-9557f18f36bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c8107c22c2440819d4e4e930873f1e6'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:29.069124 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-93a3f026-7496-4dfd-ac84-9557f18f36bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c8107c22c2440819d4e4e930873f1e6'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:29.077902 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-93a3f026-7496-4dfd-ac84-9557f18f36bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c8107c22c2440819d4e4e930873f1e6'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:29.086347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-93a3f026-7496-4dfd-ac84-9557f18f36bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c8107c22c2440819d4e4e930873f1e6'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:29.096275 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1121/2222] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:56:28 2022] DELETE /identity/v3/users/4c8107c22c2440819d4e4e930873f1e6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:56:29.098480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fea6e9-c404-4724-b564-ac1862422198 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:29.098946 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fea6e9-c404-4724-b564-ac1862422198 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:29.099047 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fea6e9-c404-4724-b564-ac1862422198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:29.118360 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-71fea6e9-c404-4724-b564-ac1862422198 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:29.119843 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-71fea6e9-c404-4724-b564-ac1862422198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:29.188823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1102/2223] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:56:29.198309 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3f026-7496-4dfd-ac84-9557f18f36bd admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:29.199897 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-93a3f026-7496-4dfd-ac84-9557f18f36bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:29.257504 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3f026-7496-4dfd-ac84-9557f18f36bd admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:29.261086 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84059da-8aa5-4b00-a662-0fa4ddf0da64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:29.261706 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84059da-8aa5-4b00-a662-0fa4ddf0da64 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:29.262004 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84059da-8aa5-4b00-a662-0fa4ddf0da64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:29.262251 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84059da-8aa5-4b00-a662-0fa4ddf0da64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:29.271730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84059da-8aa5-4b00-a662-0fa4ddf0da64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:29.273145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84059da-8aa5-4b00-a662-0fa4ddf0da64 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:29.282349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1122/2224] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:56:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 10:56:29.403731 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fea6e9-c404-4724-b564-ac1862422198 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:29.405157 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-71fea6e9-c404-4724-b564-ac1862422198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:29.418024 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fea6e9-c404-4724-b564-ac1862422198 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:29.422960 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e53fe-9d62-47fd-bf98-6d162a7a1265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:29.424349 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e53fe-9d62-47fd-bf98-6d162a7a1265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:29.424778 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e53fe-9d62-47fd-bf98-6d162a7a1265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:29.425071 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e53fe-9d62-47fd-bf98-6d162a7a1265 admin admin] PATH_INFO: `/v3/users/7501da56ad6a4aeea8f5546d196a887c` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:29.426257 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e53fe-9d62-47fd-bf98-6d162a7a1265 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7501da56ad6a4aeea8f5546d196a887c)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:29.428410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e53fe-9d62-47fd-bf98-6d162a7a1265 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:29.464239 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84059da-8aa5-4b00-a662-0fa4ddf0da64 service neutron] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:29.465879 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-a84059da-8aa5-4b00-a662-0fa4ddf0da64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:29.490963 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84059da-8aa5-4b00-a662-0fa4ddf0da64 service neutron] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:29.502164 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-694e53fe-9d62-47fd-bf98-6d162a7a1265 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7501da56ad6a4aeea8f5546d196a887c'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:29.502923 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61e244-8968-40d1-8497-98b0d22daa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:29.503565 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61e244-8968-40d1-8497-98b0d22daa03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:29.503865 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61e244-8968-40d1-8497-98b0d22daa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:29.504136 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61e244-8968-40d1-8497-98b0d22daa03 admin admin] PATH_INFO: `/v3/projects/0838ba0ef89e41968bd8dbf0b162da37` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:29.506433 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61e244-8968-40d1-8497-98b0d22daa03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0838ba0ef89e41968bd8dbf0b162da37)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:29.510855 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61e244-8968-40d1-8497-98b0d22daa03 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:29.516299 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-694e53fe-9d62-47fd-bf98-6d162a7a1265 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7501da56ad6a4aeea8f5546d196a887c'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:29.517053 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-694e53fe-9d62-47fd-bf98-6d162a7a1265 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7501da56ad6a4aeea8f5546d196a887c'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:29.525996 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-694e53fe-9d62-47fd-bf98-6d162a7a1265 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7501da56ad6a4aeea8f5546d196a887c'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:29.535988 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-694e53fe-9d62-47fd-bf98-6d162a7a1265 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7501da56ad6a4aeea8f5546d196a887c'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:29.538132 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:29.554697 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1103/2225] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:56:29 2022] DELETE /identity/v3/users/7501da56ad6a4aeea8f5546d196a887c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 10:56:29.559284 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428a861-c381-41ca-bbbb-ec5fa1c2c22d None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:29.560142 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428a861-c381-41ca-bbbb-ec5fa1c2c22d None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:29.560418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428a861-c381-41ca-bbbb-ec5fa1c2c22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:29.587156 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-f428a861-c381-41ca-bbbb-ec5fa1c2c22d None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:29.588504 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-f428a861-c381-41ca-bbbb-ec5fa1c2c22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:29.590738 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-1e61e244-8968-40d1-8497-98b0d22daa03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0838ba0ef89e41968bd8dbf0b162da37', 'request_id': 'req-1e61e244-8968-40d1-8497-98b0d22daa03'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:29.598848 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-1e61e244-8968-40d1-8497-98b0d22daa03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0838ba0ef89e41968bd8dbf0b162da37', 'request_id': 'req-1e61e244-8968-40d1-8497-98b0d22daa03'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:29.609695 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-1e61e244-8968-40d1-8497-98b0d22daa03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0838ba0ef89e41968bd8dbf0b162da37', 'request_id': 'req-1e61e244-8968-40d1-8497-98b0d22daa03'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:29.627816 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-1e61e244-8968-40d1-8497-98b0d22daa03 admin admin] The token cache is being invalidate because project 0838ba0ef89e41968bd8dbf0b162da37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:56:29.628334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-1e61e244-8968-40d1-8497-98b0d22daa03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:29.629249 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-1e61e244-8968-40d1-8497-98b0d22daa03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:29.631950 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1123/2226] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:56:29 2022] DELETE /identity/v3/projects/0838ba0ef89e41968bd8dbf0b162da37 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 10:56:29.637277 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f37a2-1689-4d6e-b1c4-b8d7764e9884 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:29.638824 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f37a2-1689-4d6e-b1c4-b8d7764e9884 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:29.639105 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f37a2-1689-4d6e-b1c4-b8d7764e9884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:29.663221 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1104/2227] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:56:29.672837 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428a861-c381-41ca-bbbb-ec5fa1c2c22d None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:29.674529 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-f428a861-c381-41ca-bbbb-ec5fa1c2c22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:29.676729 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-2c5f37a2-1689-4d6e-b1c4-b8d7764e9884 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:29.678168 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-2c5f37a2-1689-4d6e-b1c4-b8d7764e9884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:29.689794 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1124/2228] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:56:29.696893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c0ec2-84c4-49be-88a5-cb715dda0256 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:29.697174 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c0ec2-84c4-49be-88a5-cb715dda0256 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:29.697495 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c0ec2-84c4-49be-88a5-cb715dda0256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:29.728643 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-5c2c0ec2-84c4-49be-88a5-cb715dda0256 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:29.730229 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-5c2c0ec2-84c4-49be-88a5-cb715dda0256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:29.741081 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1125/2229] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:56:29.746827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c0ec2-84c4-49be-88a5-cb715dda0256 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:29.757808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c0ec2-84c4-49be-88a5-cb715dda0256 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:29.764022 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe13b5d-c9f0-45ad-8b31-66062bbd9b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:29.764635 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe13b5d-c9f0-45ad-8b31-66062bbd9b1f admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:29.764910 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe13b5d-c9f0-45ad-8b31-66062bbd9b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:29.765344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe13b5d-c9f0-45ad-8b31-66062bbd9b1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:29.766094 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe13b5d-c9f0-45ad-8b31-66062bbd9b1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:56:29.766692 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe13b5d-c9f0-45ad-8b31-66062bbd9b1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:29.768467 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe13b5d-c9f0-45ad-8b31-66062bbd9b1f admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:29.784344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1126/2230] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:56:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 10:56:29.789808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe13b5d-c9f0-45ad-8b31-66062bbd9b1f admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:29.794177 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428a861-c381-41ca-bbbb-ec5fa1c2c22d None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:29.804222 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe13b5d-c9f0-45ad-8b31-66062bbd9b1f admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:29.808297 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88174e0f-09bb-490a-a561-700204d495b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:29.808907 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88174e0f-09bb-490a-a561-700204d495b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:29.809182 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88174e0f-09bb-490a-a561-700204d495b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:29.809485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88174e0f-09bb-490a-a561-700204d495b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:29.810110 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88174e0f-09bb-490a-a561-700204d495b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:29.812290 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88174e0f-09bb-490a-a561-700204d495b4 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:29.814131 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b71693-92b3-4e5b-8197-7c932dfd292e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:29.815149 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b71693-92b3-4e5b-8197-7c932dfd292e service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:29.815643 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b71693-92b3-4e5b-8197-7c932dfd292e service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:29.816073 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b71693-92b3-4e5b-8197-7c932dfd292e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:29.829536 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b71693-92b3-4e5b-8197-7c932dfd292e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:29.831162 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b71693-92b3-4e5b-8197-7c932dfd292e service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:29.842934 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1105/2231] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:56:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:56:29.846655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1127/2232] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:56:29 2022] POST /identity/v3/projects => generated 391 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 10:56:29.855967 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b71693-92b3-4e5b-8197-7c932dfd292e service neutron] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:29.866415 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b71693-92b3-4e5b-8197-7c932dfd292e service neutron] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:29.940627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c54d4-5a77-4d05-afd3-9979b08bc919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:29.941187 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c54d4-5a77-4d05-afd3-9979b08bc919 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:29.942044 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c54d4-5a77-4d05-afd3-9979b08bc919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:29.942435 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c54d4-5a77-4d05-afd3-9979b08bc919 admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:29.943611 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c54d4-5a77-4d05-afd3-9979b08bc919 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:29.946463 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c54d4-5a77-4d05-afd3-9979b08bc919 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:29.976229 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1106/2233] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:56:29 2022] POST /identity/v3/users => generated 296 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 10:56:29.980667 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88174e0f-09bb-490a-a561-700204d495b4 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:29.991525 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88174e0f-09bb-490a-a561-700204d495b4 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:29.996377 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb9298-0864-4845-8f15-39415cdb1681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:29.996979 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb9298-0864-4845-8f15-39415cdb1681 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:29.997264 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb9298-0864-4845-8f15-39415cdb1681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:29.997600 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb9298-0864-4845-8f15-39415cdb1681 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:29.998913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb9298-0864-4845-8f15-39415cdb1681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:30.000701 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eb9298-0864-4845-8f15-39415cdb1681 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:30.003399 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:30.020145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1128/2234] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:56:30.021294 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c54d4-5a77-4d05-afd3-9979b08bc919 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:30.044609 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c54d4-5a77-4d05-afd3-9979b08bc919 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:30.059992 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9798a3-3fb6-4ae4-ac23-cbcf16bed8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:30.060639 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9798a3-3fb6-4ae4-ac23-cbcf16bed8e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:30.060915 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9798a3-3fb6-4ae4-ac23-cbcf16bed8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:30.061183 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9798a3-3fb6-4ae4-ac23-cbcf16bed8e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:30.061897 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9798a3-3fb6-4ae4-ac23-cbcf16bed8e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:30.063485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9798a3-3fb6-4ae4-ac23-cbcf16bed8e9 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:30.088192 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1107/2235] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:56:30.092891 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb9298-0864-4845-8f15-39415cdb1681 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:30.103641 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb9298-0864-4845-8f15-39415cdb1681 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:30.108621 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e475f4-22a6-4745-a9ae-9ed1398294c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:30.109417 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e475f4-22a6-4745-a9ae-9ed1398294c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:30.109811 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e475f4-22a6-4745-a9ae-9ed1398294c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:30.110182 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e475f4-22a6-4745-a9ae-9ed1398294c8 admin admin] PATH_INFO: `/v3/projects/c94d82d102a545b88bbec8f962d43504/users/3487b4db264a410196a8050d41a349fe/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:30.125751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e475f4-22a6-4745-a9ae-9ed1398294c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c94d82d102a545b88bbec8f962d43504, user_id=3487b4db264a410196a8050d41a349fe, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:30.128672 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e475f4-22a6-4745-a9ae-9ed1398294c8 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:30.148734 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1129/2236] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:56:30 2022] PUT /identity/v3/projects/c94d82d102a545b88bbec8f962d43504/users/3487b4db264a410196a8050d41a349fe/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:56:30.159621 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec428d-99fe-460d-9d08-b1f76618fa36 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:30.161285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec428d-99fe-460d-9d08-b1f76618fa36 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:30.161285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec428d-99fe-460d-9d08-b1f76618fa36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:30.197373 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-0aec428d-99fe-460d-9d08-b1f76618fa36 None None] MFA Rules not processed for user `3487b4db264a410196a8050d41a349fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:30.198548 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-0aec428d-99fe-460d-9d08-b1f76618fa36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:30.208184 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:30.257825 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e475f4-22a6-4745-a9ae-9ed1398294c8 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:30.259648 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-22e475f4-22a6-4745-a9ae-9ed1398294c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:30.312839 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1108/2237] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:56:30.340343 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec428d-99fe-460d-9d08-b1f76618fa36 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:30.350881 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-0aec428d-99fe-460d-9d08-b1f76618fa36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:30.371560 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e475f4-22a6-4745-a9ae-9ed1398294c8 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:30.380362 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891416cf-4f50-4ed9-90c0-a38ce4c060a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:30.381368 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891416cf-4f50-4ed9-90c0-a38ce4c060a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:30.381660 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891416cf-4f50-4ed9-90c0-a38ce4c060a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:30.381929 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891416cf-4f50-4ed9-90c0-a38ce4c060a9 admin admin] PATH_INFO: `/v3/projects/8c7b311db2e24b6c85367c9ceb0bda99` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:30.383931 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891416cf-4f50-4ed9-90c0-a38ce4c060a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c7b311db2e24b6c85367c9ceb0bda99)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:30.386665 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891416cf-4f50-4ed9-90c0-a38ce4c060a9 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:30.439349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-891416cf-4f50-4ed9-90c0-a38ce4c060a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c7b311db2e24b6c85367c9ceb0bda99', 'request_id': 'req-891416cf-4f50-4ed9-90c0-a38ce4c060a9'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:30.445645 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-891416cf-4f50-4ed9-90c0-a38ce4c060a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c7b311db2e24b6c85367c9ceb0bda99', 'request_id': 'req-891416cf-4f50-4ed9-90c0-a38ce4c060a9'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:30.446361 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec428d-99fe-460d-9d08-b1f76618fa36 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:30.454495 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-891416cf-4f50-4ed9-90c0-a38ce4c060a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c7b311db2e24b6c85367c9ceb0bda99', 'request_id': 'req-891416cf-4f50-4ed9-90c0-a38ce4c060a9'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:30.467072 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-891416cf-4f50-4ed9-90c0-a38ce4c060a9 admin admin] The token cache is being invalidate because project 8c7b311db2e24b6c85367c9ceb0bda99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:56:30.467350 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-891416cf-4f50-4ed9-90c0-a38ce4c060a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:30.468018 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-891416cf-4f50-4ed9-90c0-a38ce4c060a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:30.473456 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1130/2238] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:56:30 2022] DELETE /identity/v3/projects/8c7b311db2e24b6c85367c9ceb0bda99 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 10:56:30.474809 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84fddb-bb63-409f-9f31-faaaa1a1bb98 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:30.475085 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84fddb-bb63-409f-9f31-faaaa1a1bb98 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:30.475357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84fddb-bb63-409f-9f31-faaaa1a1bb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:30.497369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-fb84fddb-bb63-409f-9f31-faaaa1a1bb98 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:30.499041 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-fb84fddb-bb63-409f-9f31-faaaa1a1bb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:30.508339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253684c-8012-4b18-a8ee-8309f67f051b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:30.508946 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253684c-8012-4b18-a8ee-8309f67f051b service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:30.509264 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253684c-8012-4b18-a8ee-8309f67f051b service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:30.509566 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253684c-8012-4b18-a8ee-8309f67f051b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:30.511382 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-b253684c-8012-4b18-a8ee-8309f67f051b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:30.580696 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1131/2239] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:56:30.590426 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b4478-4ff7-4cb6-ba4f-57082d3d1125 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:30.590901 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b4478-4ff7-4cb6-ba4f-57082d3d1125 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:30.591391 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b4478-4ff7-4cb6-ba4f-57082d3d1125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:30.596004 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253684c-8012-4b18-a8ee-8309f67f051b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:30.596841 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253684c-8012-4b18-a8ee-8309f67f051b service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:30.603990 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:30.613122 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1109/2240] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:56:30 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:56:30.630030 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-f32b4478-4ff7-4cb6-ba4f-57082d3d1125 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:30.632436 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-f32b4478-4ff7-4cb6-ba4f-57082d3d1125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:30.642654 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1132/2241] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:56:30.646955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253684c-8012-4b18-a8ee-8309f67f051b service cinder] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:30.659116 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253684c-8012-4b18-a8ee-8309f67f051b service cinder] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:30.666121 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a7ab1-0de6-4f59-97da-8bc0ac5203a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:30.666940 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a7ab1-0de6-4f59-97da-8bc0ac5203a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:30.667369 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a7ab1-0de6-4f59-97da-8bc0ac5203a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:30.667789 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a7ab1-0de6-4f59-97da-8bc0ac5203a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:30.668656 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a7ab1-0de6-4f59-97da-8bc0ac5203a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:56:30.669107 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a7ab1-0de6-4f59-97da-8bc0ac5203a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:30.670884 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a7ab1-0de6-4f59-97da-8bc0ac5203a3 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:30.684442 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1110/2242] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:56:30.689221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b4478-4ff7-4cb6-ba4f-57082d3d1125 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:30.706610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b4478-4ff7-4cb6-ba4f-57082d3d1125 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:30.711810 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e2c09-1c43-4dc2-8824-f52fae791ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:30.712426 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e2c09-1c43-4dc2-8824-f52fae791ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:30.712702 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e2c09-1c43-4dc2-8824-f52fae791ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:30.712972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e2c09-1c43-4dc2-8824-f52fae791ec3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:30.713707 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e2c09-1c43-4dc2-8824-f52fae791ec3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:30.716048 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e2c09-1c43-4dc2-8824-f52fae791ec3 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:30.756832 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1133/2243] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:56:30 2022] POST /identity/v3/projects => generated 399 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:56:30.761241 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a7ab1-0de6-4f59-97da-8bc0ac5203a3 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:30.774779 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a7ab1-0de6-4f59-97da-8bc0ac5203a3 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:30.779322 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:30.861741 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94292a5-9585-4237-85fb-05a2bfce622f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:30.862401 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94292a5-9585-4237-85fb-05a2bfce622f admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:30.862682 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94292a5-9585-4237-85fb-05a2bfce622f admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:30.862947 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94292a5-9585-4237-85fb-05a2bfce622f admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:30.865780 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94292a5-9585-4237-85fb-05a2bfce622f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:30.869633 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94292a5-9585-4237-85fb-05a2bfce622f admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:30.902195 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1111/2244] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:56:30 2022] POST /identity/v3/users => generated 300 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:56:30.903641 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e2c09-1c43-4dc2-8824-f52fae791ec3 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:30.918904 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e2c09-1c43-4dc2-8824-f52fae791ec3 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:30.927119 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cefaa-fd8a-42ea-b26f-4da3f2710aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:30.929908 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cefaa-fd8a-42ea-b26f-4da3f2710aae admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:30.930264 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cefaa-fd8a-42ea-b26f-4da3f2710aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:30.930527 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cefaa-fd8a-42ea-b26f-4da3f2710aae admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:30.931179 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5cefaa-fd8a-42ea-b26f-4da3f2710aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:30.934627 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5cefaa-fd8a-42ea-b26f-4da3f2710aae admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:30.953364 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1134/2245] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:56:30.956122 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94292a5-9585-4237-85fb-05a2bfce622f admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:30.992766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94292a5-9585-4237-85fb-05a2bfce622f admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:31.038055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee6bee-b6d2-49dc-bf97-2fe1d3f943cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:31.038913 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee6bee-b6d2-49dc-bf97-2fe1d3f943cb admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:31.045756 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee6bee-b6d2-49dc-bf97-2fe1d3f943cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:31.046227 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee6bee-b6d2-49dc-bf97-2fe1d3f943cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:31.047121 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee6bee-b6d2-49dc-bf97-2fe1d3f943cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:31.049347 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee6bee-b6d2-49dc-bf97-2fe1d3f943cb admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:31.086699 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1112/2246] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:56:31.090599 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cefaa-fd8a-42ea-b26f-4da3f2710aae admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:31.122005 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cefaa-fd8a-42ea-b26f-4da3f2710aae admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:31.128951 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47caa26-a602-423d-9db3-ce1f45f0aca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:31.129666 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47caa26-a602-423d-9db3-ce1f45f0aca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:31.130123 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47caa26-a602-423d-9db3-ce1f45f0aca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:31.130226 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47caa26-a602-423d-9db3-ce1f45f0aca9 admin admin] PATH_INFO: `/v3/projects/5a55af1b8dec44f9ada0bacb4e271e82/users/64897a7847b84e9c80180c500a1f8dda/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:31.163344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47caa26-a602-423d-9db3-ce1f45f0aca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a55af1b8dec44f9ada0bacb4e271e82, user_id=64897a7847b84e9c80180c500a1f8dda, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:31.166071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47caa26-a602-423d-9db3-ce1f45f0aca9 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:31.182372 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1135/2247] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:56:31 2022] PUT /identity/v3/projects/5a55af1b8dec44f9ada0bacb4e271e82/users/64897a7847b84e9c80180c500a1f8dda/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:56:31.192903 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6331b0-9ff7-4346-8106-a0132c1cc8a8 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:31.193452 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6331b0-9ff7-4346-8106-a0132c1cc8a8 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:31.193452 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6331b0-9ff7-4346-8106-a0132c1cc8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:31.222968 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-ef6331b0-9ff7-4346-8106-a0132c1cc8a8 None None] MFA Rules not processed for user `64897a7847b84e9c80180c500a1f8dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:31.224293 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ef6331b0-9ff7-4346-8106-a0132c1cc8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:31.306920 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1113/2248] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:31 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:56:31.314577 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47caa26-a602-423d-9db3-ce1f45f0aca9 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:31.316285 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-f47caa26-a602-423d-9db3-ce1f45f0aca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:31.392017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47caa26-a602-423d-9db3-ce1f45f0aca9 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:31.399250 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66356cb7-ab8e-4527-b82e-b005151b25b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:31.399869 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66356cb7-ab8e-4527-b82e-b005151b25b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:31.400147 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66356cb7-ab8e-4527-b82e-b005151b25b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:31.400555 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66356cb7-ab8e-4527-b82e-b005151b25b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:31.410594 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66356cb7-ab8e-4527-b82e-b005151b25b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:31.412685 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66356cb7-ab8e-4527-b82e-b005151b25b3 service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:31.432972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1136/2249] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:56:31 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:56:36.448876 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6331b0-9ff7-4346-8106-a0132c1cc8a8 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:36.540603 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6331b0-9ff7-4346-8106-a0132c1cc8a8 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:36.545291 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d431097-d19a-4bad-8d75-830906c2cba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:36.546088 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d431097-d19a-4bad-8d75-830906c2cba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:36.546367 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d431097-d19a-4bad-8d75-830906c2cba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:36.546643 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d431097-d19a-4bad-8d75-830906c2cba1 admin admin] PATH_INFO: `/v3/users/64897a7847b84e9c80180c500a1f8dda` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:36.548018 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d431097-d19a-4bad-8d75-830906c2cba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64897a7847b84e9c80180c500a1f8dda)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:36.550093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d431097-d19a-4bad-8d75-830906c2cba1 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:36.570446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:36.607197 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-2d431097-d19a-4bad-8d75-830906c2cba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64897a7847b84e9c80180c500a1f8dda'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:36.621665 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-2d431097-d19a-4bad-8d75-830906c2cba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64897a7847b84e9c80180c500a1f8dda'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:36.622506 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-2d431097-d19a-4bad-8d75-830906c2cba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64897a7847b84e9c80180c500a1f8dda'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:36.629707 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-2d431097-d19a-4bad-8d75-830906c2cba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64897a7847b84e9c80180c500a1f8dda'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:36.638235 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-2d431097-d19a-4bad-8d75-830906c2cba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64897a7847b84e9c80180c500a1f8dda'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:36.644998 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1114/2250] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:56:36 2022] DELETE /identity/v3/users/64897a7847b84e9c80180c500a1f8dda => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:56:36.649388 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fdbe7-9f3d-4a4c-97b9-0c2e6ba56562 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:36.649901 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fdbe7-9f3d-4a4c-97b9-0c2e6ba56562 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:36.649981 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fdbe7-9f3d-4a4c-97b9-0c2e6ba56562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:36.669045 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-b82fdbe7-9f3d-4a4c-97b9-0c2e6ba56562 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:36.670278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-b82fdbe7-9f3d-4a4c-97b9-0c2e6ba56562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:36.727206 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1137/2251] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:56:36.736951 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d431097-d19a-4bad-8d75-830906c2cba1 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:36.739273 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-2d431097-d19a-4bad-8d75-830906c2cba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:36.798067 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d431097-d19a-4bad-8d75-830906c2cba1 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:36.801912 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa08365-b3b0-40ab-a42f-b3473b965772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:36.802585 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa08365-b3b0-40ab-a42f-b3473b965772 service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:36.802881 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa08365-b3b0-40ab-a42f-b3473b965772 service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:36.803153 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa08365-b3b0-40ab-a42f-b3473b965772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:36.812175 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa08365-b3b0-40ab-a42f-b3473b965772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:36.813637 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa08365-b3b0-40ab-a42f-b3473b965772 service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:36.823612 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1115/2252] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:56:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:56:37.106144 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fdbe7-9f3d-4a4c-97b9-0c2e6ba56562 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:37.107737 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-b82fdbe7-9f3d-4a4c-97b9-0c2e6ba56562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:37.121121 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fdbe7-9f3d-4a4c-97b9-0c2e6ba56562 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:37.127071 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd16c5-ece3-43a7-ad1f-92dfd1e1c137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:37.127704 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd16c5-ece3-43a7-ad1f-92dfd1e1c137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:37.127984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd16c5-ece3-43a7-ad1f-92dfd1e1c137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:37.128458 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd16c5-ece3-43a7-ad1f-92dfd1e1c137 admin admin] PATH_INFO: `/v3/projects/5a55af1b8dec44f9ada0bacb4e271e82` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:37.130684 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd16c5-ece3-43a7-ad1f-92dfd1e1c137 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a55af1b8dec44f9ada0bacb4e271e82)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:37.133213 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd16c5-ece3-43a7-ad1f-92dfd1e1c137 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:37.180145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:37.190886 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-02dd16c5-ece3-43a7-ad1f-92dfd1e1c137 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a55af1b8dec44f9ada0bacb4e271e82', 'request_id': 'req-02dd16c5-ece3-43a7-ad1f-92dfd1e1c137'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:37.197488 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-02dd16c5-ece3-43a7-ad1f-92dfd1e1c137 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a55af1b8dec44f9ada0bacb4e271e82', 'request_id': 'req-02dd16c5-ece3-43a7-ad1f-92dfd1e1c137'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:37.205722 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-02dd16c5-ece3-43a7-ad1f-92dfd1e1c137 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a55af1b8dec44f9ada0bacb4e271e82', 'request_id': 'req-02dd16c5-ece3-43a7-ad1f-92dfd1e1c137'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:37.217596 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-02dd16c5-ece3-43a7-ad1f-92dfd1e1c137 admin admin] The token cache is being invalidate because project 5a55af1b8dec44f9ada0bacb4e271e82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:56:37.217888 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-02dd16c5-ece3-43a7-ad1f-92dfd1e1c137 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:37.218533 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-02dd16c5-ece3-43a7-ad1f-92dfd1e1c137 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:37.220056 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1138/2253] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:56:37 2022] DELETE /identity/v3/projects/5a55af1b8dec44f9ada0bacb4e271e82 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:56:40.927270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa08365-b3b0-40ab-a42f-b3473b965772 service neutron] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:40.928764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-9aa08365-b3b0-40ab-a42f-b3473b965772 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:40.942547 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa08365-b3b0-40ab-a42f-b3473b965772 service neutron] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:40.997697 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd279af-9fbc-4bfb-8a04-fdf946e2b24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:40.998235 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd279af-9fbc-4bfb-8a04-fdf946e2b24e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:40.998538 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd279af-9fbc-4bfb-8a04-fdf946e2b24e admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:40.998802 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd279af-9fbc-4bfb-8a04-fdf946e2b24e admin admin] PATH_INFO: `/v3/users/3487b4db264a410196a8050d41a349fe` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:40.999903 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd279af-9fbc-4bfb-8a04-fdf946e2b24e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3487b4db264a410196a8050d41a349fe)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:41.001816 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd279af-9fbc-4bfb-8a04-fdf946e2b24e admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:41.044372 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:41.051248 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-bcd279af-9fbc-4bfb-8a04-fdf946e2b24e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3487b4db264a410196a8050d41a349fe'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:41.064404 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-bcd279af-9fbc-4bfb-8a04-fdf946e2b24e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3487b4db264a410196a8050d41a349fe'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:41.065064 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-bcd279af-9fbc-4bfb-8a04-fdf946e2b24e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3487b4db264a410196a8050d41a349fe'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:41.073963 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-bcd279af-9fbc-4bfb-8a04-fdf946e2b24e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3487b4db264a410196a8050d41a349fe'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:41.081394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-bcd279af-9fbc-4bfb-8a04-fdf946e2b24e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3487b4db264a410196a8050d41a349fe'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:41.088262 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1116/2254] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:56:40 2022] DELETE /identity/v3/users/3487b4db264a410196a8050d41a349fe => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:56:41.092763 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7a5e2-4314-45ac-b40b-f45b71d0b9f3 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:41.093231 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7a5e2-4314-45ac-b40b-f45b71d0b9f3 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:41.093361 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7a5e2-4314-45ac-b40b-f45b71d0b9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:41.112115 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-86c7a5e2-4314-45ac-b40b-f45b71d0b9f3 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:41.113483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-86c7a5e2-4314-45ac-b40b-f45b71d0b9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:41.177213 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1139/2255] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:56:41.186932 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd279af-9fbc-4bfb-8a04-fdf946e2b24e admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:41.188336 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-bcd279af-9fbc-4bfb-8a04-fdf946e2b24e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:41.244195 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd279af-9fbc-4bfb-8a04-fdf946e2b24e admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:41.247868 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de27c8-ffd1-431a-9f17-2165a8ee8b37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:41.248380 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de27c8-ffd1-431a-9f17-2165a8ee8b37 service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:41.248658 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de27c8-ffd1-431a-9f17-2165a8ee8b37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:41.248927 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de27c8-ffd1-431a-9f17-2165a8ee8b37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:41.258445 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de27c8-ffd1-431a-9f17-2165a8ee8b37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:41.259854 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de27c8-ffd1-431a-9f17-2165a8ee8b37 service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:41.269094 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1117/2256] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:56:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:56:41.536869 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7a5e2-4314-45ac-b40b-f45b71d0b9f3 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:41.538536 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-86c7a5e2-4314-45ac-b40b-f45b71d0b9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:41.554851 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7a5e2-4314-45ac-b40b-f45b71d0b9f3 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:41.559597 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13002095-3bed-4aad-978e-7de23dcdf5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:41.560390 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13002095-3bed-4aad-978e-7de23dcdf5cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:41.560484 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13002095-3bed-4aad-978e-7de23dcdf5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:41.560747 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13002095-3bed-4aad-978e-7de23dcdf5cb admin admin] PATH_INFO: `/v3/projects/c94d82d102a545b88bbec8f962d43504` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:41.561902 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13002095-3bed-4aad-978e-7de23dcdf5cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c94d82d102a545b88bbec8f962d43504)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:41.564005 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13002095-3bed-4aad-978e-7de23dcdf5cb admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:41.611964 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-13002095-3bed-4aad-978e-7de23dcdf5cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c94d82d102a545b88bbec8f962d43504', 'request_id': 'req-13002095-3bed-4aad-978e-7de23dcdf5cb'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:41.618200 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-13002095-3bed-4aad-978e-7de23dcdf5cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c94d82d102a545b88bbec8f962d43504', 'request_id': 'req-13002095-3bed-4aad-978e-7de23dcdf5cb'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:41.626181 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-13002095-3bed-4aad-978e-7de23dcdf5cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c94d82d102a545b88bbec8f962d43504', 'request_id': 'req-13002095-3bed-4aad-978e-7de23dcdf5cb'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:41.638292 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-13002095-3bed-4aad-978e-7de23dcdf5cb admin admin] The token cache is being invalidate because project c94d82d102a545b88bbec8f962d43504 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:56:41.638577 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-13002095-3bed-4aad-978e-7de23dcdf5cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:41.639204 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-13002095-3bed-4aad-978e-7de23dcdf5cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:56:41.640681 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1140/2257] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:56:41 2022] DELETE /identity/v3/projects/c94d82d102a545b88bbec8f962d43504 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:56:41.645792 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784d249-0e97-4287-8b7e-9c6e8c903b26 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:41.646080 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784d249-0e97-4287-8b7e-9c6e8c903b26 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:41.646349 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784d249-0e97-4287-8b7e-9c6e8c903b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:41.665545 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-8784d249-0e97-4287-8b7e-9c6e8c903b26 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:41.666775 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-8784d249-0e97-4287-8b7e-9c6e8c903b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:41.726417 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1118/2258] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:56:41.736160 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf249f-a83d-4cfa-a7ee-b9f4c26ee5ef None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:41.736444 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf249f-a83d-4cfa-a7ee-b9f4c26ee5ef None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:41.736727 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf249f-a83d-4cfa-a7ee-b9f4c26ee5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:41.759987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-47cf249f-a83d-4cfa-a7ee-b9f4c26ee5ef None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:41.761230 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-47cf249f-a83d-4cfa-a7ee-b9f4c26ee5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:41.769562 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1141/2259] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:56:41.773833 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784d249-0e97-4287-8b7e-9c6e8c903b26 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:41.783972 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784d249-0e97-4287-8b7e-9c6e8c903b26 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:41.788978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4318176-2deb-48ef-95ba-ee863c0e6b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:41.789609 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4318176-2deb-48ef-95ba-ee863c0e6b3b admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:41.789886 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4318176-2deb-48ef-95ba-ee863c0e6b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:41.790159 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4318176-2deb-48ef-95ba-ee863c0e6b3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:41.790835 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4318176-2deb-48ef-95ba-ee863c0e6b3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 10:56:41.791131 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4318176-2deb-48ef-95ba-ee863c0e6b3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:41.792728 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4318176-2deb-48ef-95ba-ee863c0e6b3b admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:41.804713 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1119/2260] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 10:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 10:56:41.808906 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf249f-a83d-4cfa-a7ee-b9f4c26ee5ef None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:41.818322 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf249f-a83d-4cfa-a7ee-b9f4c26ee5ef None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:41.823232 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b6521-e579-41c8-b8c8-843223075eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:41.823820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b6521-e579-41c8-b8c8-843223075eb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:41.824100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b6521-e579-41c8-b8c8-843223075eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:41.824370 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b6521-e579-41c8-b8c8-843223075eb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:41.824997 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b6521-e579-41c8-b8c8-843223075eb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:41.826925 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b6521-e579-41c8-b8c8-843223075eb0 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:41.855028 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1142/2261] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:56:41 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 10:56:41.913925 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4318176-2deb-48ef-95ba-ee863c0e6b3b admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:41.923944 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4318176-2deb-48ef-95ba-ee863c0e6b3b admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:41.971463 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:41.989384 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c54f9-fb83-44ad-9da9-5487b008f12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:41.990369 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c54f9-fb83-44ad-9da9-5487b008f12d admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:41.990674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c54f9-fb83-44ad-9da9-5487b008f12d admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:41.990974 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c54f9-fb83-44ad-9da9-5487b008f12d admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:41.991666 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c54f9-fb83-44ad-9da9-5487b008f12d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:41.993664 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c54f9-fb83-44ad-9da9-5487b008f12d admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:42.023216 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1120/2262] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:56:41 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:56:42.024486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b6521-e579-41c8-b8c8-843223075eb0 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:42.036014 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b6521-e579-41c8-b8c8-843223075eb0 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:42.041503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be3ac1-bf7c-4309-8f1a-3bf39c46a8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:42.042186 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be3ac1-bf7c-4309-8f1a-3bf39c46a8df admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:42.042545 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be3ac1-bf7c-4309-8f1a-3bf39c46a8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:42.042822 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be3ac1-bf7c-4309-8f1a-3bf39c46a8df admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:42.043475 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be3ac1-bf7c-4309-8f1a-3bf39c46a8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:42.045256 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be3ac1-bf7c-4309-8f1a-3bf39c46a8df admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:42.057793 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1143/2263] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:56:42.061744 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c54f9-fb83-44ad-9da9-5487b008f12d admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:42.074836 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c54f9-fb83-44ad-9da9-5487b008f12d admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:42.080406 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6b70d-b9f1-4b44-86ab-a8f540ca8d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:42.081111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6b70d-b9f1-4b44-86ab-a8f540ca8d00 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:42.081520 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6b70d-b9f1-4b44-86ab-a8f540ca8d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:42.082366 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6b70d-b9f1-4b44-86ab-a8f540ca8d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:42.083266 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6b70d-b9f1-4b44-86ab-a8f540ca8d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:42.085148 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6b70d-b9f1-4b44-86ab-a8f540ca8d00 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:42.096570 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1121/2264] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:56:42.101389 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be3ac1-bf7c-4309-8f1a-3bf39c46a8df admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:42.112220 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be3ac1-bf7c-4309-8f1a-3bf39c46a8df admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:42.117249 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b13f3-eafc-42c2-b2cf-98e6270bc078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:42.118400 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b13f3-eafc-42c2-b2cf-98e6270bc078 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:42.118400 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b13f3-eafc-42c2-b2cf-98e6270bc078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:42.118596 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b13f3-eafc-42c2-b2cf-98e6270bc078 admin admin] PATH_INFO: `/v3/projects/aa4cbb40c6044de8bee366555c493dd7/users/6f36e072f3274b399c6c19948f9862b2/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:42.126819 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:42.135648 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b13f3-eafc-42c2-b2cf-98e6270bc078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa4cbb40c6044de8bee366555c493dd7, user_id=6f36e072f3274b399c6c19948f9862b2, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:42.139093 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b13f3-eafc-42c2-b2cf-98e6270bc078 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:42.153750 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1144/2265] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:56:42 2022] PUT /identity/v3/projects/aa4cbb40c6044de8bee366555c493dd7/users/6f36e072f3274b399c6c19948f9862b2/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:56:42.158747 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0b06e-ba9f-47da-a91c-b23c46e5fee1 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:42.161574 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0b06e-ba9f-47da-a91c-b23c46e5fee1 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:42.162002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0b06e-ba9f-47da-a91c-b23c46e5fee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:42.184330 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-0fe0b06e-ba9f-47da-a91c-b23c46e5fee1 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:42.185666 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-0fe0b06e-ba9f-47da-a91c-b23c46e5fee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:42.276849 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1122/2266] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:56:42.295745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b13f3-eafc-42c2-b2cf-98e6270bc078 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:42.297503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-f17b13f3-eafc-42c2-b2cf-98e6270bc078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:42.383834 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b13f3-eafc-42c2-b2cf-98e6270bc078 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:42.388254 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7ac5d-c392-46ab-a9f4-d001b4c69f71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:42.388833 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7ac5d-c392-46ab-a9f4-d001b4c69f71 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:42.389116 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7ac5d-c392-46ab-a9f4-d001b4c69f71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:42.389427 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7ac5d-c392-46ab-a9f4-d001b4c69f71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:42.399938 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7ac5d-c392-46ab-a9f4-d001b4c69f71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:42.401393 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7ac5d-c392-46ab-a9f4-d001b4c69f71 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:42.415156 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1145/2267] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:56:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 10:56:44.526811 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b18c5-95f4-49bc-8061-9a2ea9c1970e None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:44.527505 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b18c5-95f4-49bc-8061-9a2ea9c1970e None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:44.529282 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b18c5-95f4-49bc-8061-9a2ea9c1970e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:44.549732 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-666b18c5-95f4-49bc-8061-9a2ea9c1970e None None] MFA Rules not processed for user `5f3264f99c3345eb85930e7818f16cde`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:44.551480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-666b18c5-95f4-49bc-8061-9a2ea9c1970e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:44.615865 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1123/2268] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:56:48.552302 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c507c7-7d09-4333-81d4-12db7f823038 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:48.552783 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c507c7-7d09-4333-81d4-12db7f823038 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:48.552964 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c507c7-7d09-4333-81d4-12db7f823038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:48.582802 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-78c507c7-7d09-4333-81d4-12db7f823038 None None] MFA Rules not processed for user `6f36e072f3274b399c6c19948f9862b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:48.584234 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-78c507c7-7d09-4333-81d4-12db7f823038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:48.677451 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1146/2269] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:56:48.679567 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b18c5-95f4-49bc-8061-9a2ea9c1970e None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:48.702103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b18c5-95f4-49bc-8061-9a2ea9c1970e None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:48.709751 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e0908-992f-4b7e-949c-0f90b27f125a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:48.710371 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e0908-992f-4b7e-949c-0f90b27f125a admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:48.710889 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e0908-992f-4b7e-949c-0f90b27f125a admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:48.711174 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e0908-992f-4b7e-949c-0f90b27f125a admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:48.711862 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e0908-992f-4b7e-949c-0f90b27f125a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:48.713783 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e0908-992f-4b7e-949c-0f90b27f125a admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:48.749385 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1124/2270] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 10:56:48 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:56:48.753357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c507c7-7d09-4333-81d4-12db7f823038 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:48.770444 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c507c7-7d09-4333-81d4-12db7f823038 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:48.845936 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c267de-095a-441b-8efc-45d2d9be1d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:48.846628 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c267de-095a-441b-8efc-45d2d9be1d36 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:48.847006 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c267de-095a-441b-8efc-45d2d9be1d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:48.847406 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c267de-095a-441b-8efc-45d2d9be1d36 admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:48.848144 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c267de-095a-441b-8efc-45d2d9be1d36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:48.850765 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c267de-095a-441b-8efc-45d2d9be1d36 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:48.881106 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1147/2271] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 10:56:48 2022] POST /identity/v3/users => generated 299 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 10:56:48.882708 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e0908-992f-4b7e-949c-0f90b27f125a admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:48.901072 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e0908-992f-4b7e-949c-0f90b27f125a admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:48.907612 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977adb3-2b13-4eda-8acd-2c8fb4d01077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:48.908517 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977adb3-2b13-4eda-8acd-2c8fb4d01077 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:48.908991 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977adb3-2b13-4eda-8acd-2c8fb4d01077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:48.910000 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977adb3-2b13-4eda-8acd-2c8fb4d01077 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:48.910873 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977adb3-2b13-4eda-8acd-2c8fb4d01077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:48.916993 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977adb3-2b13-4eda-8acd-2c8fb4d01077 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:48.929876 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1125/2272] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:56:48.934125 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c267de-095a-441b-8efc-45d2d9be1d36 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:48.946645 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c267de-095a-441b-8efc-45d2d9be1d36 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:48.952458 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d3b8d-7e45-4325-a790-14d17b119c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:48.953717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d3b8d-7e45-4325-a790-14d17b119c43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:48.954205 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d3b8d-7e45-4325-a790-14d17b119c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:48.954841 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d3b8d-7e45-4325-a790-14d17b119c43 admin admin] PATH_INFO: `/v3/projects/14216df28b0f40b19d304d822a12ce08/users/d98ba11e90624c149c73744226ad38c1/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:48.960428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:48.989788 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d3b8d-7e45-4325-a790-14d17b119c43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14216df28b0f40b19d304d822a12ce08, user_id=d98ba11e90624c149c73744226ad38c1, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:48.989788 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d3b8d-7e45-4325-a790-14d17b119c43 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:49.009566 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1148/2273] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:56:48 2022] PUT /identity/v3/projects/14216df28b0f40b19d304d822a12ce08/users/d98ba11e90624c149c73744226ad38c1/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 10:56:49.010485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977adb3-2b13-4eda-8acd-2c8fb4d01077 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:49.021365 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977adb3-2b13-4eda-8acd-2c8fb4d01077 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:49.063879 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:56:49.102240 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a29cbc-483d-4d26-8349-b269af59cc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:49.103023 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a29cbc-483d-4d26-8349-b269af59cc8b admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:49.103299 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a29cbc-483d-4d26-8349-b269af59cc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:49.103566 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a29cbc-483d-4d26-8349-b269af59cc8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:49.104399 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a29cbc-483d-4d26-8349-b269af59cc8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:49.106439 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a29cbc-483d-4d26-8349-b269af59cc8b admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:49.122258 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1126/2274] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 10:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 10:56:49.125900 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d3b8d-7e45-4325-a790-14d17b119c43 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:49.137942 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d3b8d-7e45-4325-a790-14d17b119c43 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:49.148224 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902e57c-5426-43f9-a29a-2e1c682be519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:49.149295 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902e57c-5426-43f9-a29a-2e1c682be519 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:49.149295 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902e57c-5426-43f9-a29a-2e1c682be519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:49.149664 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902e57c-5426-43f9-a29a-2e1c682be519 admin admin] PATH_INFO: `/v3/projects/14216df28b0f40b19d304d822a12ce08/users/d98ba11e90624c149c73744226ad38c1/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:49.151996 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902e57c-5426-43f9-a29a-2e1c682be519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14216df28b0f40b19d304d822a12ce08, user_id=d98ba11e90624c149c73744226ad38c1, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:49.157139 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902e57c-5426-43f9-a29a-2e1c682be519 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:49.180063 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1149/2275] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 10:56:49 2022] PUT /identity/v3/projects/14216df28b0f40b19d304d822a12ce08/users/d98ba11e90624c149c73744226ad38c1/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:56:53.831581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207169b-6df7-428f-8a91-7bb4df400022 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:53.832582 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207169b-6df7-428f-8a91-7bb4df400022 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:53.833020 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207169b-6df7-428f-8a91-7bb4df400022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:53.876278 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-b207169b-6df7-428f-8a91-7bb4df400022 None None] MFA Rules not processed for user `d98ba11e90624c149c73744226ad38c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:53.877954 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-b207169b-6df7-428f-8a91-7bb4df400022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:53.957220 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1127/2276] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:56:53 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:56:53.969658 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902e57c-5426-43f9-a29a-2e1c682be519 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:53.972184 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-9902e57c-5426-43f9-a29a-2e1c682be519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:54.038872 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902e57c-5426-43f9-a29a-2e1c682be519 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:54.042761 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e001f7-4380-4c73-a31d-b97ca46cabd8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a462a891b30847c0aeadbd697652011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:54.043379 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e001f7-4380-4c73-a31d-b97ca46cabd8 service glance] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:54.043658 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e001f7-4380-4c73-a31d-b97ca46cabd8 service glance] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:54.043929 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e001f7-4380-4c73-a31d-b97ca46cabd8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:54.106229 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e001f7-4380-4c73-a31d-b97ca46cabd8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:54.107804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e001f7-4380-4c73-a31d-b97ca46cabd8 service glance] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:54.119808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1150/2277] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:56:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:56:54.248690 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc9e28-f4ef-458b-9d7e-520360041d5e None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:54.248983 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc9e28-f4ef-458b-9d7e-520360041d5e None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:54.249305 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc9e28-f4ef-458b-9d7e-520360041d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:54.269378 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-0ddc9e28-f4ef-458b-9d7e-520360041d5e None None] MFA Rules not processed for user `e7eebb4bd7e04ff8bc4304a40cf6ba35`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:56:54.270811 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-0ddc9e28-f4ef-458b-9d7e-520360041d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:54.361583 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1128/2278] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 7 10:56:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:56:54.376965 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e001f7-4380-4c73-a31d-b97ca46cabd8 service glance] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:56:54.382080 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-e3e001f7-4380-4c73-a31d-b97ca46cabd8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:56:54.463391 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e001f7-4380-4c73-a31d-b97ca46cabd8 service glance] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:56:54.476429 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc6030-c234-4380-81c9-69a36417f59e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7181e5118c547a3a31d2e080c25ff01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:56:54.477454 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc6030-c234-4380-81c9-69a36417f59e service swift] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:56:54.477454 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc6030-c234-4380-81c9-69a36417f59e service swift] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:56:54.477657 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc6030-c234-4380-81c9-69a36417f59e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:56:54.487686 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc6030-c234-4380-81c9-69a36417f59e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:56:54.489465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc6030-c234-4380-81c9-69a36417f59e service swift] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:56:54.505654 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1151/2279] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 7 10:56:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 10:57:03.805443 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985d99e-31d1-4e72-ba40-575d4be6d5c7 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:57:03.806031 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985d99e-31d1-4e72-ba40-575d4be6d5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:57:03.806031 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985d99e-31d1-4e72-ba40-575d4be6d5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:57:03.824480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-2985d99e-31d1-4e72-ba40-575d4be6d5c7 None None] MFA Rules not processed for user `6f36e072f3274b399c6c19948f9862b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:57:03.825746 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-2985d99e-31d1-4e72-ba40-575d4be6d5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:57:03.832982 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1129/2280] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:57:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:57:04.495512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=91,keystone:INSERT=2 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:57:06.380627 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fab79-90d4-45ab-a706-681b9714d010 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:57:06.381233 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fab79-90d4-45ab-a706-681b9714d010 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:57:06.381233 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fab79-90d4-45ab-a706-681b9714d010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:57:06.402247 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-2e3fab79-90d4-45ab-a706-681b9714d010 None None] MFA Rules not processed for user `e7eebb4bd7e04ff8bc4304a40cf6ba35`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:57:06.403511 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-2e3fab79-90d4-45ab-a706-681b9714d010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:57:06.412274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1152/2281] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 7 10:57:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:57:06.426099 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985d99e-31d1-4e72-ba40-575d4be6d5c7 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:57:06.438077 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985d99e-31d1-4e72-ba40-575d4be6d5c7 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:57:06.443787 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf17c18-99b6-46cf-9a75-16831950126c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7181e5118c547a3a31d2e080c25ff01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:57:06.444384 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf17c18-99b6-46cf-9a75-16831950126c service swift] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:57:06.444660 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf17c18-99b6-46cf-9a75-16831950126c service swift] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:57:06.444931 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf17c18-99b6-46cf-9a75-16831950126c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:57:06.452934 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf17c18-99b6-46cf-9a75-16831950126c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:57:06.454554 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf17c18-99b6-46cf-9a75-16831950126c service swift] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:57:06.463944 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1130/2282] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 7 10:57:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 10:57:07.397178 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381796d1-0fdf-434f-8c22-41a75efee6bb None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:57:07.397837 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381796d1-0fdf-434f-8c22-41a75efee6bb None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:57:07.398242 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381796d1-0fdf-434f-8c22-41a75efee6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:57:07.433714 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-381796d1-0fdf-434f-8c22-41a75efee6bb None None] MFA Rules not processed for user `e7eebb4bd7e04ff8bc4304a40cf6ba35`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:57:07.435899 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-381796d1-0fdf-434f-8c22-41a75efee6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:57:07.448330 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1153/2283] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 7 10:57:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:57:07.461056 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf17c18-99b6-46cf-9a75-16831950126c service swift] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:57:07.471900 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf17c18-99b6-46cf-9a75-16831950126c service swift] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:57:07.494457 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c57e3-b130-4411-ad5f-5fd4a10bffe3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7181e5118c547a3a31d2e080c25ff01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:57:07.496881 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c57e3-b130-4411-ad5f-5fd4a10bffe3 service swift] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:57:07.497836 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c57e3-b130-4411-ad5f-5fd4a10bffe3 service swift] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:57:07.506088 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c57e3-b130-4411-ad5f-5fd4a10bffe3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:57:07.522709 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c57e3-b130-4411-ad5f-5fd4a10bffe3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:57:07.525006 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c57e3-b130-4411-ad5f-5fd4a10bffe3 service swift] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:57:07.539721 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1131/2284] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 7 10:57:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 07 10:57:09.990225 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f01a6-61a2-4af2-ab01-eabfdc3fc9d8 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:57:09.991455 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f01a6-61a2-4af2-ab01-eabfdc3fc9d8 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:57:09.992009 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f01a6-61a2-4af2-ab01-eabfdc3fc9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:57:10.049896 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-ad9f01a6-61a2-4af2-ab01-eabfdc3fc9d8 None None] MFA Rules not processed for user `cba1a3bf0e1f49e885e4c833549be406`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:57:10.051547 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-ad9f01a6-61a2-4af2-ab01-eabfdc3fc9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:57:10.169406 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1154/2285] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:57:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:57:17.532315 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=86 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:57:20.141893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=31 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:57:21.794598 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c57e3-b130-4411-ad5f-5fd4a10bffe3 service swift] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:57:21.796616 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-207c57e3-b130-4411-ad5f-5fd4a10bffe3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:57:21.911718 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c57e3-b130-4411-ad5f-5fd4a10bffe3 service swift] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:57:21.918121 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58107000-b723-4884-b4fc-2fe33f056833 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b33f797a9af946a4b296d973388891be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:57:21.918768 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58107000-b723-4884-b4fc-2fe33f056833 service placement] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:57:21.919087 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58107000-b723-4884-b4fc-2fe33f056833 service placement] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:57:21.919363 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58107000-b723-4884-b4fc-2fe33f056833 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:57:21.936542 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-58107000-b723-4884-b4fc-2fe33f056833 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:57:21.977612 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58107000-b723-4884-b4fc-2fe33f056833 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:57:21.979247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58107000-b723-4884-b4fc-2fe33f056833 service placement] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:57:22.023601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1132/2286] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:57:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:57:23.126452 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd059b8-98a6-42b8-ad45-8937541af123 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:57:23.127185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd059b8-98a6-42b8-ad45-8937541af123 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:57:23.127185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd059b8-98a6-42b8-ad45-8937541af123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:57:23.150502 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-2fd059b8-98a6-42b8-ad45-8937541af123 None None] MFA Rules not processed for user `e7eebb4bd7e04ff8bc4304a40cf6ba35`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:57:23.151846 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-2fd059b8-98a6-42b8-ad45-8937541af123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:57:23.175767 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1155/2287] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 7 10:57:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:57:23.176188 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58107000-b723-4884-b4fc-2fe33f056833 service placement] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:57:23.191306 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58107000-b723-4884-b4fc-2fe33f056833 service placement] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:57:23.200202 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9fc96-9b07-41db-824a-50eaf757fcdc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7181e5118c547a3a31d2e080c25ff01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:57:23.200834 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9fc96-9b07-41db-824a-50eaf757fcdc service swift] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:57:23.201203 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9fc96-9b07-41db-824a-50eaf757fcdc service swift] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:57:23.202031 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9fc96-9b07-41db-824a-50eaf757fcdc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:57:23.214386 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9fc96-9b07-41db-824a-50eaf757fcdc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:57:23.215997 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9fc96-9b07-41db-824a-50eaf757fcdc service swift] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:57:23.229517 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1133/2288] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 7 10:57:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 07 10:57:25.171952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd059b8-98a6-42b8-ad45-8937541af123 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:57:25.174467 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-2fd059b8-98a6-42b8-ad45-8937541af123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:57:25.243447 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd059b8-98a6-42b8-ad45-8937541af123 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:57:25.247906 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f3a8e-1fb1-4e0a-8416-5a40fe1278a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:57:25.248530 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f3a8e-1fb1-4e0a-8416-5a40fe1278a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:57:25.248808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f3a8e-1fb1-4e0a-8416-5a40fe1278a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:57:25.249080 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f3a8e-1fb1-4e0a-8416-5a40fe1278a4 admin admin] PATH_INFO: `/v3/users/5f3264f99c3345eb85930e7818f16cde` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:57:25.250246 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f3a8e-1fb1-4e0a-8416-5a40fe1278a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f3264f99c3345eb85930e7818f16cde)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:57:25.252125 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f3a8e-1fb1-4e0a-8416-5a40fe1278a4 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:57:25.304677 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-388f3a8e-1fb1-4e0a-8416-5a40fe1278a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f3264f99c3345eb85930e7818f16cde'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:57:25.316947 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-388f3a8e-1fb1-4e0a-8416-5a40fe1278a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f3264f99c3345eb85930e7818f16cde'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:57:25.317763 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-388f3a8e-1fb1-4e0a-8416-5a40fe1278a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f3264f99c3345eb85930e7818f16cde'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:57:25.324990 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-388f3a8e-1fb1-4e0a-8416-5a40fe1278a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f3264f99c3345eb85930e7818f16cde'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:57:25.334019 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-388f3a8e-1fb1-4e0a-8416-5a40fe1278a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f3264f99c3345eb85930e7818f16cde'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:57:25.340206 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1156/2289] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 10:57:25 2022] DELETE /identity/v3/users/5f3264f99c3345eb85930e7818f16cde => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:57:25.514267 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9fc96-9b07-41db-824a-50eaf757fcdc service swift] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:57:25.526852 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9fc96-9b07-41db-824a-50eaf757fcdc service swift] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:57:25.590767 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df579916-e09c-43fc-9e6d-e1e380d5ff92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:57:25.591575 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df579916-e09c-43fc-9e6d-e1e380d5ff92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:57:25.591925 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df579916-e09c-43fc-9e6d-e1e380d5ff92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:57:25.592264 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df579916-e09c-43fc-9e6d-e1e380d5ff92 admin admin] PATH_INFO: `/v3/projects/8d66a455c35944a0a181b303da79f261` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:57:25.593489 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df579916-e09c-43fc-9e6d-e1e380d5ff92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d66a455c35944a0a181b303da79f261)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:57:25.595509 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df579916-e09c-43fc-9e6d-e1e380d5ff92 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:57:25.645703 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-df579916-e09c-43fc-9e6d-e1e380d5ff92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d66a455c35944a0a181b303da79f261', 'request_id': 'req-df579916-e09c-43fc-9e6d-e1e380d5ff92'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:57:25.651608 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-df579916-e09c-43fc-9e6d-e1e380d5ff92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d66a455c35944a0a181b303da79f261', 'request_id': 'req-df579916-e09c-43fc-9e6d-e1e380d5ff92'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:57:25.658056 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-df579916-e09c-43fc-9e6d-e1e380d5ff92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d66a455c35944a0a181b303da79f261', 'request_id': 'req-df579916-e09c-43fc-9e6d-e1e380d5ff92'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:57:25.679363 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-df579916-e09c-43fc-9e6d-e1e380d5ff92 admin admin] The token cache is being invalidate because project 8d66a455c35944a0a181b303da79f261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 10:57:25.679656 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-df579916-e09c-43fc-9e6d-e1e380d5ff92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:57:25.680313 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-df579916-e09c-43fc-9e6d-e1e380d5ff92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 10:57:25.691899 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1134/2290] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 10:57:25 2022] DELETE /identity/v3/projects/8d66a455c35944a0a181b303da79f261 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 10:57:35.336725 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=56,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:57:35.674602 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:57:41.352020 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f3a8e-1fb1-4e0a-8416-5a40fe1278a4 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:57:41.353769 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-388f3a8e-1fb1-4e0a-8416-5a40fe1278a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:57:41.410790 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f3a8e-1fb1-4e0a-8416-5a40fe1278a4 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:57:41.458681 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e2901-026b-4ac6-85f9-b348e8dfd9ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:57:41.459280 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e2901-026b-4ac6-85f9-b348e8dfd9ae service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:57:41.459556 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e2901-026b-4ac6-85f9-b348e8dfd9ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:57:41.459825 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e2901-026b-4ac6-85f9-b348e8dfd9ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:57:41.461566 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-9a7e2901-026b-4ac6-85f9-b348e8dfd9ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:57:41.522906 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e2901-026b-4ac6-85f9-b348e8dfd9ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:57:41.524239 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e2901-026b-4ac6-85f9-b348e8dfd9ae service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:57:41.534171 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1157/2291] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:57:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:57:46.161680 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97b312-40d2-46a6-bfbd-9d026d018e20 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:57:46.162763 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97b312-40d2-46a6-bfbd-9d026d018e20 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:57:46.163108 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97b312-40d2-46a6-bfbd-9d026d018e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:57:46.187022 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-4a97b312-40d2-46a6-bfbd-9d026d018e20 None None] MFA Rules not processed for user `e7eebb4bd7e04ff8bc4304a40cf6ba35`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:57:46.188500 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-4a97b312-40d2-46a6-bfbd-9d026d018e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:57:46.253898 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1135/2292] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 7 10:57:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 10:57:46.283182 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e2901-026b-4ac6-85f9-b348e8dfd9ae service neutron] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:57:46.285699 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-9a7e2901-026b-4ac6-85f9-b348e8dfd9ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:57:46.384560 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e2901-026b-4ac6-85f9-b348e8dfd9ae service neutron] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:57:46.389575 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523fbb0-096d-45a6-b956-19a2437b9bf5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7181e5118c547a3a31d2e080c25ff01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:57:46.390170 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523fbb0-096d-45a6-b956-19a2437b9bf5 service swift] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:57:46.390446 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523fbb0-096d-45a6-b956-19a2437b9bf5 service swift] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:57:46.390711 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523fbb0-096d-45a6-b956-19a2437b9bf5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:57:46.396549 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:57:46.398940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523fbb0-096d-45a6-b956-19a2437b9bf5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:57:46.400826 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523fbb0-096d-45a6-b956-19a2437b9bf5 service swift] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:57:46.410039 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1158/2293] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 7 10:57:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 10:57:56.247915 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=25 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:57:56.406067 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=2 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:58:00.767211 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14eb8e-f53b-4af3-94f7-9239918c8d1b None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:58:00.767768 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14eb8e-f53b-4af3-94f7-9239918c8d1b None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:58:00.767768 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14eb8e-f53b-4af3-94f7-9239918c8d1b None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:58:00.769369 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1136/2294] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 7 10:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:58:00.776007 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d90be-1909-40d5-bbd5-e3f0772dd8f4 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:58:00.776448 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d90be-1909-40d5-bbd5-e3f0772dd8f4 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:58:00.776674 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d90be-1909-40d5-bbd5-e3f0772dd8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:58:00.800168 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-d16d90be-1909-40d5-bbd5-e3f0772dd8f4 None None] MFA Rules not processed for user `f98cb7abbb8942cebb71aa98da80a05a`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:58:00.801477 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-d16d90be-1909-40d5-bbd5-e3f0772dd8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:58:00.873583 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1159/2295] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 7 10:58:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:58:00.885981 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14eb8e-f53b-4af3-94f7-9239918c8d1b None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:58:00.887822 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-1d14eb8e-f53b-4af3-94f7-9239918c8d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:58:00.944196 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14eb8e-f53b-4af3-94f7-9239918c8d1b None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:58:00.947710 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2289e4-48d5-4c86-8c60-d4cff28430c4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a462a891b30847c0aeadbd697652011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:58:00.948308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2289e4-48d5-4c86-8c60-d4cff28430c4 service glance] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:58:00.948586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2289e4-48d5-4c86-8c60-d4cff28430c4 service glance] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:58:00.948858 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2289e4-48d5-4c86-8c60-d4cff28430c4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:58:00.959028 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2289e4-48d5-4c86-8c60-d4cff28430c4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:58:00.960442 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2289e4-48d5-4c86-8c60-d4cff28430c4 service glance] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:58:00.970864 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1137/2296] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:58:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:58:01.038734 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7719f-7365-461e-b14d-51ad84ea6fd0 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:58:01.039023 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7719f-7365-461e-b14d-51ad84ea6fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:58:01.039296 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7719f-7365-461e-b14d-51ad84ea6fd0 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:58:01.040658 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1160/2297] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 7 10:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:58:01.045452 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ca49a-a460-4814-8296-8b5028796d96 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:58:01.045736 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ca49a-a460-4814-8296-8b5028796d96 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:58:01.046000 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ca49a-a460-4814-8296-8b5028796d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:58:01.067286 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-631ca49a-a460-4814-8296-8b5028796d96 None None] MFA Rules not processed for user `9b03428b48264b9da9800283496de2e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:58:01.069065 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-631ca49a-a460-4814-8296-8b5028796d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:58:01.076024 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1138/2298] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 7 10:58:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:58:01.090023 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7719f-7365-461e-b14d-51ad84ea6fd0 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:58:01.091748 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-75a7719f-7365-461e-b14d-51ad84ea6fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:58:01.105483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7719f-7365-461e-b14d-51ad84ea6fd0 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:58:01.109106 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e899ef-06c7-47c0-92f2-c3e90cf97370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:58:01.109772 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e899ef-06c7-47c0-92f2-c3e90cf97370 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:58:01.110048 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e899ef-06c7-47c0-92f2-c3e90cf97370 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:58:01.110318 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e899ef-06c7-47c0-92f2-c3e90cf97370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:58:01.118113 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e899ef-06c7-47c0-92f2-c3e90cf97370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:58:01.119527 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e899ef-06c7-47c0-92f2-c3e90cf97370 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:58:01.127686 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1161/2299] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:58:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:58:01.220691 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27905125-ae28-414f-86d6-b1ce1111b06a None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:58:01.220971 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27905125-ae28-414f-86d6-b1ce1111b06a None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:58:01.221269 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27905125-ae28-414f-86d6-b1ce1111b06a None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:58:01.222725 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1139/2300] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 7 10:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 10:58:01.228950 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c954fd-6182-4ac6-baaa-f0796b931720 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:58:01.229250 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c954fd-6182-4ac6-baaa-f0796b931720 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:58:01.229568 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c954fd-6182-4ac6-baaa-f0796b931720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:58:01.249210 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-f1c954fd-6182-4ac6-baaa-f0796b931720 None None] MFA Rules not processed for user `f98cb7abbb8942cebb71aa98da80a05a`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:58:01.250415 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-f1c954fd-6182-4ac6-baaa-f0796b931720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:58:01.260621 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1162/2301] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 7 10:58:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:58:01.271108 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27905125-ae28-414f-86d6-b1ce1111b06a None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:58:01.273371 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-27905125-ae28-414f-86d6-b1ce1111b06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:58:01.286990 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27905125-ae28-414f-86d6-b1ce1111b06a None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:58:01.290708 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbcae0-0264-4fe1-8606-f8f5741dc767 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:58:01.291288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbcae0-0264-4fe1-8606-f8f5741dc767 service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:58:01.291563 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbcae0-0264-4fe1-8606-f8f5741dc767 service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:58:01.291832 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbcae0-0264-4fe1-8606-f8f5741dc767 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:58:01.301827 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbcae0-0264-4fe1-8606-f8f5741dc767 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:58:01.303342 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbcae0-0264-4fe1-8606-f8f5741dc767 service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:58:01.314529 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1140/2302] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:58:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:58:03.546077 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed62eb-9eec-416e-92de-83457119bf1f None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:58:03.546556 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed62eb-9eec-416e-92de-83457119bf1f None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:58:03.546658 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed62eb-9eec-416e-92de-83457119bf1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:58:03.565225 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-baed62eb-9eec-416e-92de-83457119bf1f None None] MFA Rules not processed for user `e7eebb4bd7e04ff8bc4304a40cf6ba35`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:58:03.566430 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-baed62eb-9eec-416e-92de-83457119bf1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:58:03.574034 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1163/2303] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 7 10:58:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:58:03.586398 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbcae0-0264-4fe1-8606-f8f5741dc767 service neutron] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:58:03.597493 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbcae0-0264-4fe1-8606-f8f5741dc767 service neutron] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:58:03.602419 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54796ff6-01c2-4fc7-b41e-5862a4c87c78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7181e5118c547a3a31d2e080c25ff01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:58:03.602995 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54796ff6-01c2-4fc7-b41e-5862a4c87c78 service swift] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:58:03.603270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54796ff6-01c2-4fc7-b41e-5862a4c87c78 service swift] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:58:03.603536 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54796ff6-01c2-4fc7-b41e-5862a4c87c78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:58:03.611471 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54796ff6-01c2-4fc7-b41e-5862a4c87c78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:58:03.613076 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54796ff6-01c2-4fc7-b41e-5862a4c87c78 service swift] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:58:03.621117 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1141/2304] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 7 10:58:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 10:58:13.559923 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=43 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:58:13.618112 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=41 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:58:27.516713 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5ce4f-e921-4992-a343-d7fb46976f8c None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:58:27.517263 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5ce4f-e921-4992-a343-d7fb46976f8c None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:58:27.517263 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5ce4f-e921-4992-a343-d7fb46976f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:58:27.538295 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-add5ce4f-e921-4992-a343-d7fb46976f8c None None] MFA Rules not processed for user `e7eebb4bd7e04ff8bc4304a40cf6ba35`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:58:27.539499 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-add5ce4f-e921-4992-a343-d7fb46976f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:58:27.546855 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1164/2305] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 7 10:58:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:58:27.559651 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54796ff6-01c2-4fc7-b41e-5862a4c87c78 service swift] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:58:27.570648 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54796ff6-01c2-4fc7-b41e-5862a4c87c78 service swift] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:58:27.576162 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef9889-f2bc-4bc6-84ed-25e3c82ac098 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7181e5118c547a3a31d2e080c25ff01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:58:27.576776 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef9889-f2bc-4bc6-84ed-25e3c82ac098 service swift] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:58:27.577059 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef9889-f2bc-4bc6-84ed-25e3c82ac098 service swift] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:58:27.577410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef9889-f2bc-4bc6-84ed-25e3c82ac098 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:58:27.586436 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef9889-f2bc-4bc6-84ed-25e3c82ac098 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:58:27.588397 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef9889-f2bc-4bc6-84ed-25e3c82ac098 service swift] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:58:27.598919 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1142/2306] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 7 10:58:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 10:58:37.531237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:58:37.595073 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=6 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:58:46.123206 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08974056-0c9f-482e-9673-f4622a2ff9b4 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:58:46.123817 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08974056-0c9f-482e-9673-f4622a2ff9b4 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:58:46.123817 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08974056-0c9f-482e-9673-f4622a2ff9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:58:46.144214 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-08974056-0c9f-482e-9673-f4622a2ff9b4 None None] MFA Rules not processed for user `7696bfdd618a47eb91753adb60ea7812`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:58:46.145431 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-08974056-0c9f-482e-9673-f4622a2ff9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:58:46.198895 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1165/2307] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:58:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:58:56.192205 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=25 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:59:17.978463 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef9889-f2bc-4bc6-84ed-25e3c82ac098 service swift] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:59:17.987507 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef9889-f2bc-4bc6-84ed-25e3c82ac098 service swift] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:59:17.991541 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992945bd-6952-4b9b-873f-1530196a518c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:59:17.992110 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992945bd-6952-4b9b-873f-1530196a518c service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:59:17.992380 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992945bd-6952-4b9b-873f-1530196a518c service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:59:17.992641 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992945bd-6952-4b9b-873f-1530196a518c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:59:17.994361 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-992945bd-6952-4b9b-873f-1530196a518c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:59:18.007627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992945bd-6952-4b9b-873f-1530196a518c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:59:18.009044 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992945bd-6952-4b9b-873f-1530196a518c service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:59:18.019818 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1143/2308] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:59:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:59:19.207989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08974056-0c9f-482e-9673-f4622a2ff9b4 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:59:19.217506 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08974056-0c9f-482e-9673-f4622a2ff9b4 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:59:19.220987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244bce4-f331-4196-a26f-7f8c2a830348 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:59:19.221598 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244bce4-f331-4196-a26f-7f8c2a830348 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:59:19.221870 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244bce4-f331-4196-a26f-7f8c2a830348 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:59:19.222132 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244bce4-f331-4196-a26f-7f8c2a830348 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:59:19.223804 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-1244bce4-f331-4196-a26f-7f8c2a830348 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:59:19.236493 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244bce4-f331-4196-a26f-7f8c2a830348 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:59:19.237929 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244bce4-f331-4196-a26f-7f8c2a830348 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:59:19.248853 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1166/2309] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:59:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:59:27.652236 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992945bd-6952-4b9b-873f-1530196a518c service neutron] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:59:27.653693 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-992945bd-6952-4b9b-873f-1530196a518c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:59:27.667772 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992945bd-6952-4b9b-873f-1530196a518c service neutron] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:59:27.673228 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10d254-3a7a-4a73-8782-bcb94456f070 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:59:27.673837 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10d254-3a7a-4a73-8782-bcb94456f070 service nova] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:59:27.674114 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10d254-3a7a-4a73-8782-bcb94456f070 service nova] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:59:27.674384 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10d254-3a7a-4a73-8782-bcb94456f070 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:59:27.676446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-6f10d254-3a7a-4a73-8782-bcb94456f070 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:59:27.733417 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f10d254-3a7a-4a73-8782-bcb94456f070 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:59:27.734992 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f10d254-3a7a-4a73-8782-bcb94456f070 service nova] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:59:27.743720 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1144/2310] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:59:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:59:29.244180 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=6 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:59:34.839275 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8c985-3b63-4856-9adc-d8cc060d481d None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:59:34.839879 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8c985-3b63-4856-9adc-d8cc060d481d None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:59:34.839879 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8c985-3b63-4856-9adc-d8cc060d481d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:59:34.858628 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-aba8c985-3b63-4856-9adc-d8cc060d481d None None] MFA Rules not processed for user `cba1a3bf0e1f49e885e4c833549be406`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 10:59:34.859809 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-aba8c985-3b63-4856-9adc-d8cc060d481d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:59:34.866484 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1167/2311] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 10:59:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 10:59:37.739630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=34 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:59:38.622180 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10d254-3a7a-4a73-8782-bcb94456f070 service nova] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:59:38.631527 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10d254-3a7a-4a73-8782-bcb94456f070 service nova] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:59:38.635228 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e8fea-c4b2-4450-942a-b7724792f431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:59:38.636077 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e8fea-c4b2-4450-942a-b7724792f431 service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:59:38.636350 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e8fea-c4b2-4450-942a-b7724792f431 service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:59:38.636614 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e8fea-c4b2-4450-942a-b7724792f431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:59:38.638530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-848e8fea-c4b2-4450-942a-b7724792f431 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:59:38.697380 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e8fea-c4b2-4450-942a-b7724792f431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:59:38.698805 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e8fea-c4b2-4450-942a-b7724792f431 service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:59:38.707865 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1145/2312] 10.222.0.27 () {60 vars in 1396 bytes} [Sun Aug 7 10:59:38 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3266 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:59:44.853840 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:59:48.703538 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=28 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 10:59:51.754793 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8c985-3b63-4856-9adc-d8cc060d481d None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:59:51.765149 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8c985-3b63-4856-9adc-d8cc060d481d None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:59:51.768677 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a0faf-91f6-4a00-8cf4-54e9f3f6f3e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:59:51.769268 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a0faf-91f6-4a00-8cf4-54e9f3f6f3e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:59:51.769575 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a0faf-91f6-4a00-8cf4-54e9f3f6f3e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:59:51.769842 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a0faf-91f6-4a00-8cf4-54e9f3f6f3e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:59:51.771531 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-553a0faf-91f6-4a00-8cf4-54e9f3f6f3e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:59:51.782203 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a0faf-91f6-4a00-8cf4-54e9f3f6f3e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:59:51.783570 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a0faf-91f6-4a00-8cf4-54e9f3f6f3e6 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:59:51.792495 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1168/2313] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:59:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 10:59:55.076320 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e8fea-c4b2-4450-942a-b7724792f431 service neutron] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 10:59:55.077818 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-848e8fea-c4b2-4450-942a-b7724792f431 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:59:55.134561 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e8fea-c4b2-4450-942a-b7724792f431 service neutron] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 10:59:55.138391 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a55691-64f3-4952-82cb-129b51d61a87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 10:59:55.138981 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a55691-64f3-4952-82cb-129b51d61a87 service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 10:59:55.139256 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a55691-64f3-4952-82cb-129b51d61a87 service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 10:59:55.139526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a55691-64f3-4952-82cb-129b51d61a87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 10:59:55.141239 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-84a55691-64f3-4952-82cb-129b51d61a87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 10:59:55.152557 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a55691-64f3-4952-82cb-129b51d61a87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 10:59:55.154007 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a55691-64f3-4952-82cb-129b51d61a87 service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 10:59:55.162706 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1146/2314] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 10:59:55 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:00:01.688423 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a0faf-91f6-4a00-8cf4-54e9f3f6f3e6 service neutron] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:01.706613 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a0faf-91f6-4a00-8cf4-54e9f3f6f3e6 service neutron] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:01.713376 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829034af-851e-424d-a8e4-dff9b159c05a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:01.714209 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829034af-851e-424d-a8e4-dff9b159c05a service nova] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:01.714680 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829034af-851e-424d-a8e4-dff9b159c05a service nova] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:01.715161 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829034af-851e-424d-a8e4-dff9b159c05a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:01.717144 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-829034af-851e-424d-a8e4-dff9b159c05a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:01.731096 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829034af-851e-424d-a8e4-dff9b159c05a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:01.732983 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829034af-851e-424d-a8e4-dff9b159c05a service nova] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:01.744571 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1169/2315] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:00:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:00:05.158668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=26 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:00:11.739742 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=12 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:00:15.227075 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a55691-64f3-4952-82cb-129b51d61a87 service cinder] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:15.236241 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a55691-64f3-4952-82cb-129b51d61a87 service cinder] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:15.239828 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d4636-5171-45c8-854c-a64a803d74b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:15.240408 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d4636-5171-45c8-854c-a64a803d74b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:15.240685 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d4636-5171-45c8-854c-a64a803d74b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:15.240954 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d4636-5171-45c8-854c-a64a803d74b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:15.242739 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-c04d4636-5171-45c8-854c-a64a803d74b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:15.305212 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d4636-5171-45c8-854c-a64a803d74b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:15.306684 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d4636-5171-45c8-854c-a64a803d74b5 service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:15.316649 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1147/2316] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:00:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:00:18.477571 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829034af-851e-424d-a8e4-dff9b159c05a service nova] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:18.479878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-829034af-851e-424d-a8e4-dff9b159c05a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:18.545819 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d4636-5171-45c8-854c-a64a803d74b5 service neutron] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:18.547927 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-c04d4636-5171-45c8-854c-a64a803d74b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:18.562319 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d4636-5171-45c8-854c-a64a803d74b5 service neutron] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:18.568447 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b61e3-eef6-48e7-bc9d-a28fbefc6985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:18.574852 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b61e3-eef6-48e7-bc9d-a28fbefc6985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:18.575137 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b61e3-eef6-48e7-bc9d-a28fbefc6985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:18.575413 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b61e3-eef6-48e7-bc9d-a28fbefc6985 admin admin] PATH_INFO: `/v3/users/7696bfdd618a47eb91753adb60ea7812` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:18.577405 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b61e3-eef6-48e7-bc9d-a28fbefc6985 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7696bfdd618a47eb91753adb60ea7812)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:18.579354 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b61e3-eef6-48e7-bc9d-a28fbefc6985 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:18.593735 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829034af-851e-424d-a8e4-dff9b159c05a service nova] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:18.598744 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1ea60-ea55-4a32-9597-170af5625961 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b33f797a9af946a4b296d973388891be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:18.599420 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1ea60-ea55-4a32-9597-170af5625961 service placement] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:18.599762 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1ea60-ea55-4a32-9597-170af5625961 service placement] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:18.600097 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1ea60-ea55-4a32-9597-170af5625961 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:18.601914 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-3ef1ea60-ea55-4a32-9597-170af5625961 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:18.614093 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1ea60-ea55-4a32-9597-170af5625961 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:18.615944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1ea60-ea55-4a32-9597-170af5625961 service placement] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:18.628017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1170/2317] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:00:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:00:18.642712 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-544b61e3-eef6-48e7-bc9d-a28fbefc6985 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7696bfdd618a47eb91753adb60ea7812'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:18.658684 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-544b61e3-eef6-48e7-bc9d-a28fbefc6985 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7696bfdd618a47eb91753adb60ea7812'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:18.659508 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-544b61e3-eef6-48e7-bc9d-a28fbefc6985 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7696bfdd618a47eb91753adb60ea7812'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:18.666240 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-544b61e3-eef6-48e7-bc9d-a28fbefc6985 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7696bfdd618a47eb91753adb60ea7812'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:18.673688 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-544b61e3-eef6-48e7-bc9d-a28fbefc6985 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7696bfdd618a47eb91753adb60ea7812'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:18.680266 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1148/2318] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:00:18 2022] DELETE /identity/v3/users/7696bfdd618a47eb91753adb60ea7812 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 11:00:18.863043 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1ea60-ea55-4a32-9597-170af5625961 service placement] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:18.876182 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1ea60-ea55-4a32-9597-170af5625961 service placement] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:18.936298 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a6779-d8ce-4ffe-a4ba-33b966c378ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:18.936908 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a6779-d8ce-4ffe-a4ba-33b966c378ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:18.937178 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a6779-d8ce-4ffe-a4ba-33b966c378ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:18.937737 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a6779-d8ce-4ffe-a4ba-33b966c378ba admin admin] PATH_INFO: `/v3/projects/7b8d68f42ef648299012b855fb485190` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:18.939213 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a6779-d8ce-4ffe-a4ba-33b966c378ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b8d68f42ef648299012b855fb485190)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:18.941123 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a6779-d8ce-4ffe-a4ba-33b966c378ba admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:18.987663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-291a6779-d8ce-4ffe-a4ba-33b966c378ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b8d68f42ef648299012b855fb485190', 'request_id': 'req-291a6779-d8ce-4ffe-a4ba-33b966c378ba'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:18.997002 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-291a6779-d8ce-4ffe-a4ba-33b966c378ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b8d68f42ef648299012b855fb485190', 'request_id': 'req-291a6779-d8ce-4ffe-a4ba-33b966c378ba'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:19.005197 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-291a6779-d8ce-4ffe-a4ba-33b966c378ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b8d68f42ef648299012b855fb485190', 'request_id': 'req-291a6779-d8ce-4ffe-a4ba-33b966c378ba'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:19.017628 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-291a6779-d8ce-4ffe-a4ba-33b966c378ba admin admin] The token cache is being invalidate because project 7b8d68f42ef648299012b855fb485190 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:00:19.017916 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-291a6779-d8ce-4ffe-a4ba-33b966c378ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:19.018555 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-291a6779-d8ce-4ffe-a4ba-33b966c378ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:19.020037 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1171/2319] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:00:18 2022] DELETE /identity/v3/projects/7b8d68f42ef648299012b855fb485190 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:00:19.025520 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc4353-f889-4d4b-a862-76b4cb4f9b3c None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:19.025803 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc4353-f889-4d4b-a862-76b4cb4f9b3c None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:19.026094 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc4353-f889-4d4b-a862-76b4cb4f9b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:19.045341 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-72cc4353-f889-4d4b-a862-76b4cb4f9b3c None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:00:19.046538 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-72cc4353-f889-4d4b-a862-76b4cb4f9b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:19.105346 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1149/2320] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:00:19.113796 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb1097-b628-434a-a2b3-b0f157ee7bb5 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:19.114076 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb1097-b628-434a-a2b3-b0f157ee7bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:19.114342 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb1097-b628-434a-a2b3-b0f157ee7bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:19.134592 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-6cfb1097-b628-434a-a2b3-b0f157ee7bb5 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:00:19.135777 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-6cfb1097-b628-434a-a2b3-b0f157ee7bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:19.143774 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1172/2321] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:00:19.147840 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc4353-f889-4d4b-a862-76b4cb4f9b3c None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:19.157453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc4353-f889-4d4b-a862-76b4cb4f9b3c None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:19.162000 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6483bf9-cc0a-425e-b020-e0dd4a884be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:19.162576 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6483bf9-cc0a-425e-b020-e0dd4a884be3 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:19.162855 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6483bf9-cc0a-425e-b020-e0dd4a884be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:19.163122 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6483bf9-cc0a-425e-b020-e0dd4a884be3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:19.163757 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6483bf9-cc0a-425e-b020-e0dd4a884be3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 11:00:19.164080 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6483bf9-cc0a-425e-b020-e0dd4a884be3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:19.165685 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6483bf9-cc0a-425e-b020-e0dd4a884be3 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:19.167148 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:00:19.180858 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1150/2322] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 11:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 11:00:19.184698 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb1097-b628-434a-a2b3-b0f157ee7bb5 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:19.193847 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb1097-b628-434a-a2b3-b0f157ee7bb5 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:19.199125 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370beda7-32d8-41cf-9a49-43c2c9263917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:19.199703 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370beda7-32d8-41cf-9a49-43c2c9263917 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:19.199974 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370beda7-32d8-41cf-9a49-43c2c9263917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:19.200246 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370beda7-32d8-41cf-9a49-43c2c9263917 admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:19.200857 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370beda7-32d8-41cf-9a49-43c2c9263917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:19.202742 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370beda7-32d8-41cf-9a49-43c2c9263917 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:19.213646 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:00:19.231407 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1173/2323] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:00:19 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:00:19.235585 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6483bf9-cc0a-425e-b020-e0dd4a884be3 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:19.246207 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6483bf9-cc0a-425e-b020-e0dd4a884be3 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:19.302662 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34d6e4-da8d-4020-875e-eb4b5755e744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:19.303626 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34d6e4-da8d-4020-875e-eb4b5755e744 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:19.304006 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34d6e4-da8d-4020-875e-eb4b5755e744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:19.304271 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34d6e4-da8d-4020-875e-eb4b5755e744 admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:19.305432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34d6e4-da8d-4020-875e-eb4b5755e744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:19.307375 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34d6e4-da8d-4020-875e-eb4b5755e744 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:19.332050 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1151/2324] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:00:19 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:00:19.336477 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370beda7-32d8-41cf-9a49-43c2c9263917 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:19.347174 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370beda7-32d8-41cf-9a49-43c2c9263917 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:19.351892 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cefd2f-743e-401b-a66a-6c86cba91f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:19.352480 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cefd2f-743e-401b-a66a-6c86cba91f23 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:19.352751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cefd2f-743e-401b-a66a-6c86cba91f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:19.353017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cefd2f-743e-401b-a66a-6c86cba91f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:19.353750 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cefd2f-743e-401b-a66a-6c86cba91f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:19.355327 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cefd2f-743e-401b-a66a-6c86cba91f23 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:19.365041 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1174/2325] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 11:00:19.369730 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34d6e4-da8d-4020-875e-eb4b5755e744 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:19.379529 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34d6e4-da8d-4020-875e-eb4b5755e744 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:19.385148 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8dcb1-9dd7-439d-9dbf-e882ab67fbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:19.385781 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8dcb1-9dd7-439d-9dbf-e882ab67fbe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:19.386054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8dcb1-9dd7-439d-9dbf-e882ab67fbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:19.386316 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8dcb1-9dd7-439d-9dbf-e882ab67fbe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:19.387210 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8dcb1-9dd7-439d-9dbf-e882ab67fbe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:19.388816 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8dcb1-9dd7-439d-9dbf-e882ab67fbe5 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:19.400431 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1152/2326] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:00:19.404649 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cefd2f-743e-401b-a66a-6c86cba91f23 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:19.414346 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cefd2f-743e-401b-a66a-6c86cba91f23 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:19.418879 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8634bd0-a2e4-4b2a-9cb8-80b0aea97c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:19.419507 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8634bd0-a2e4-4b2a-9cb8-80b0aea97c83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:19.419784 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8634bd0-a2e4-4b2a-9cb8-80b0aea97c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:19.420053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8634bd0-a2e4-4b2a-9cb8-80b0aea97c83 admin admin] PATH_INFO: `/v3/projects/be2ee6a9d8f044cebc66367fd5922394/users/705b6c6411cd4aa2b0b78be47c0cbb66/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:19.434487 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8634bd0-a2e4-4b2a-9cb8-80b0aea97c83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2ee6a9d8f044cebc66367fd5922394, user_id=705b6c6411cd4aa2b0b78be47c0cbb66, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:19.437111 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8634bd0-a2e4-4b2a-9cb8-80b0aea97c83 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:19.450114 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1175/2327] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:00:19 2022] PUT /identity/v3/projects/be2ee6a9d8f044cebc66367fd5922394/users/705b6c6411cd4aa2b0b78be47c0cbb66/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 11:00:19.459962 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ab24c-66b7-4b3a-abf7-ded199c845f2 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:19.460240 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ab24c-66b7-4b3a-abf7-ded199c845f2 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:19.460504 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ab24c-66b7-4b3a-abf7-ded199c845f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:19.487270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-850ab24c-66b7-4b3a-abf7-ded199c845f2 None None] MFA Rules not processed for user `705b6c6411cd4aa2b0b78be47c0cbb66`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:00:19.488448 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-850ab24c-66b7-4b3a-abf7-ded199c845f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:19.551840 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1153/2328] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:00:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:00:19.556862 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8634bd0-a2e4-4b2a-9cb8-80b0aea97c83 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:19.616483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8634bd0-a2e4-4b2a-9cb8-80b0aea97c83 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:19.621123 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6c8d0-788b-4662-81d6-e1614599faec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:19.621857 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6c8d0-788b-4662-81d6-e1614599faec admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:19.622138 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6c8d0-788b-4662-81d6-e1614599faec admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:19.622410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6c8d0-788b-4662-81d6-e1614599faec admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:19.623025 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6c8d0-788b-4662-81d6-e1614599faec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:19.624904 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6c8d0-788b-4662-81d6-e1614599faec admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:19.651873 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1176/2329] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:00:19 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:00:19.655846 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ab24c-66b7-4b3a-abf7-ded199c845f2 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:19.666323 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ab24c-66b7-4b3a-abf7-ded199c845f2 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:19.721390 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0556817-4a4c-474a-822e-a5a61f6b01fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:19.721984 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0556817-4a4c-474a-822e-a5a61f6b01fa admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:19.722258 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0556817-4a4c-474a-822e-a5a61f6b01fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:19.722527 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0556817-4a4c-474a-822e-a5a61f6b01fa admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:19.723200 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0556817-4a4c-474a-822e-a5a61f6b01fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:19.725088 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0556817-4a4c-474a-822e-a5a61f6b01fa admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:19.733660 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:00:19.745819 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1154/2330] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:00:19 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:00:19.749902 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6c8d0-788b-4662-81d6-e1614599faec admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:19.760347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6c8d0-788b-4662-81d6-e1614599faec admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:19.765110 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa6ae2-139d-404b-8d16-1713b26d70c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:19.765717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa6ae2-139d-404b-8d16-1713b26d70c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:19.765992 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa6ae2-139d-404b-8d16-1713b26d70c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:19.766258 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa6ae2-139d-404b-8d16-1713b26d70c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:19.766995 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa6ae2-139d-404b-8d16-1713b26d70c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:19.768557 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa6ae2-139d-404b-8d16-1713b26d70c0 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:19.779799 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1177/2331] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:00:19.783330 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0556817-4a4c-474a-822e-a5a61f6b01fa admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:19.793197 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0556817-4a4c-474a-822e-a5a61f6b01fa admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:19.797795 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f6db7-7f83-4524-9e32-6a540a99f8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:19.798426 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f6db7-7f83-4524-9e32-6a540a99f8dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:19.798703 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f6db7-7f83-4524-9e32-6a540a99f8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:19.798975 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f6db7-7f83-4524-9e32-6a540a99f8dd admin admin] PATH_INFO: `/v3/projects/5e5ef8d1de12449897075fe92def4cae/users/64d8f972e28d4e89b8393e88289d463a/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:19.813336 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f6db7-7f83-4524-9e32-6a540a99f8dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e5ef8d1de12449897075fe92def4cae, user_id=64d8f972e28d4e89b8393e88289d463a, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:19.816267 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f6db7-7f83-4524-9e32-6a540a99f8dd admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:19.829934 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1155/2332] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:00:19 2022] PUT /identity/v3/projects/5e5ef8d1de12449897075fe92def4cae/users/64d8f972e28d4e89b8393e88289d463a/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:00:19.833769 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa6ae2-139d-404b-8d16-1713b26d70c0 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:19.844362 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa6ae2-139d-404b-8d16-1713b26d70c0 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:19.900236 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76998b3-f4bd-43ec-a2a0-e87b79c852a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:19.900755 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76998b3-f4bd-43ec-a2a0-e87b79c852a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:19.901026 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76998b3-f4bd-43ec-a2a0-e87b79c852a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:19.901291 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76998b3-f4bd-43ec-a2a0-e87b79c852a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:19.901953 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76998b3-f4bd-43ec-a2a0-e87b79c852a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:19.903510 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76998b3-f4bd-43ec-a2a0-e87b79c852a8 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:19.913639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1178/2333] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 11:00:19.917967 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f6db7-7f83-4524-9e32-6a540a99f8dd admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:19.928954 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f6db7-7f83-4524-9e32-6a540a99f8dd admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:19.935051 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143994c-65cf-425e-a7e9-cf355b734430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:19.935838 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143994c-65cf-425e-a7e9-cf355b734430 admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:19.936062 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143994c-65cf-425e-a7e9-cf355b734430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:19.936393 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143994c-65cf-425e-a7e9-cf355b734430 admin admin] PATH_INFO: `/v3/projects/5e5ef8d1de12449897075fe92def4cae/users/64d8f972e28d4e89b8393e88289d463a/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:19.938669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143994c-65cf-425e-a7e9-cf355b734430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e5ef8d1de12449897075fe92def4cae, user_id=64d8f972e28d4e89b8393e88289d463a, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:19.941352 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143994c-65cf-425e-a7e9-cf355b734430 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:19.952432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1156/2334] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:00:19 2022] PUT /identity/v3/projects/5e5ef8d1de12449897075fe92def4cae/users/64d8f972e28d4e89b8393e88289d463a/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 11:00:19.962686 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfed8cd-c6da-434f-a0c4-11d26338d78f None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:19.962974 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfed8cd-c6da-434f-a0c4-11d26338d78f None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:19.963250 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfed8cd-c6da-434f-a0c4-11d26338d78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:19.991763 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-9cfed8cd-c6da-434f-a0c4-11d26338d78f None None] MFA Rules not processed for user `64d8f972e28d4e89b8393e88289d463a`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:00:19.993565 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-9cfed8cd-c6da-434f-a0c4-11d26338d78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:20.006275 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:00:20.063821 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1179/2335] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:00:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:00:20.076667 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143994c-65cf-425e-a7e9-cf355b734430 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:20.078630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a143994c-65cf-425e-a7e9-cf355b734430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:20.137803 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143994c-65cf-425e-a7e9-cf355b734430 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:20.141450 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd655919-922e-42f4-a0e5-c2bb336273d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:20.142069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd655919-922e-42f4-a0e5-c2bb336273d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:20.142435 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd655919-922e-42f4-a0e5-c2bb336273d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:20.142798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd655919-922e-42f4-a0e5-c2bb336273d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:20.151720 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd655919-922e-42f4-a0e5-c2bb336273d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:20.153081 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd655919-922e-42f4-a0e5-c2bb336273d8 service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:20.162527 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1157/2336] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:00:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:00:20.237814 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfed8cd-c6da-434f-a0c4-11d26338d78f None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:20.247972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfed8cd-c6da-434f-a0c4-11d26338d78f None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:20.251592 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9454e-e54e-479d-8325-8c9347261b9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:20.252178 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9454e-e54e-479d-8325-8c9347261b9d service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:20.252452 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9454e-e54e-479d-8325-8c9347261b9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:20.252722 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9454e-e54e-479d-8325-8c9347261b9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:20.309047 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9454e-e54e-479d-8325-8c9347261b9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:20.310520 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9454e-e54e-479d-8325-8c9347261b9d service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:20.320370 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1180/2337] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:00:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:00:30.158217 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:INSERT=4,keystone:SELECT=43 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:00:30.315514 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=50 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:00:30.492545 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd655919-922e-42f4-a0e5-c2bb336273d8 service cinder] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:30.494148 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-cd655919-922e-42f4-a0e5-c2bb336273d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:30.611351 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd655919-922e-42f4-a0e5-c2bb336273d8 service cinder] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:30.618112 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8319b55-96a8-4af7-bff7-e1b6aa9bf382 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:30.618735 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8319b55-96a8-4af7-bff7-e1b6aa9bf382 service nova] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:30.619013 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8319b55-96a8-4af7-bff7-e1b6aa9bf382 service nova] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:30.619286 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8319b55-96a8-4af7-bff7-e1b6aa9bf382 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:30.621095 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a8319b55-96a8-4af7-bff7-e1b6aa9bf382 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:30.637942 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8319b55-96a8-4af7-bff7-e1b6aa9bf382 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:30.639632 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8319b55-96a8-4af7-bff7-e1b6aa9bf382 service nova] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:30.652771 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1158/2338] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:00:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:00:37.844235 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0ee00-134c-4b35-a03c-f4d9998c98fd None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:37.844664 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0ee00-134c-4b35-a03c-f4d9998c98fd None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:37.844820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0ee00-134c-4b35-a03c-f4d9998c98fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:37.864721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-60a0ee00-134c-4b35-a03c-f4d9998c98fd None None] MFA Rules not processed for user `e7eebb4bd7e04ff8bc4304a40cf6ba35`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:00:37.865957 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-60a0ee00-134c-4b35-a03c-f4d9998c98fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:37.919946 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1181/2339] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 7 11:00:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:00:37.967144 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8319b55-96a8-4af7-bff7-e1b6aa9bf382 service nova] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:37.968583 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a8319b55-96a8-4af7-bff7-e1b6aa9bf382 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:38.036447 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8319b55-96a8-4af7-bff7-e1b6aa9bf382 service nova] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:38.042023 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c375ff9-4ee1-4745-8e8d-6b6fa1f0c632 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7181e5118c547a3a31d2e080c25ff01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:38.042613 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c375ff9-4ee1-4745-8e8d-6b6fa1f0c632 service swift] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:38.042889 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c375ff9-4ee1-4745-8e8d-6b6fa1f0c632 service swift] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:38.043160 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c375ff9-4ee1-4745-8e8d-6b6fa1f0c632 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:38.051054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c375ff9-4ee1-4745-8e8d-6b6fa1f0c632 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:38.052617 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c375ff9-4ee1-4745-8e8d-6b6fa1f0c632 service swift] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:38.060504 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1159/2340] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 7 11:00:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 11:00:43.029784 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b881d-e6bd-45c6-b2bf-ae4220cb3545 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:43.030328 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b881d-e6bd-45c6-b2bf-ae4220cb3545 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:43.030328 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b881d-e6bd-45c6-b2bf-ae4220cb3545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:43.049835 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-a39b881d-e6bd-45c6-b2bf-ae4220cb3545 None None] MFA Rules not processed for user `ca2075ca15d44405a71e24955ec99da4`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:00:43.051063 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-a39b881d-e6bd-45c6-b2bf-ae4220cb3545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:43.127964 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1182/2341] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:00:43 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:00:43.479433 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c375ff9-4ee1-4745-8e8d-6b6fa1f0c632 service swift] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:43.480869 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-8c375ff9-4ee1-4745-8e8d-6b6fa1f0c632 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:43.540773 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c375ff9-4ee1-4745-8e8d-6b6fa1f0c632 service swift] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:43.544638 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2983b6-b0d2-49ca-8bd5-fd8959b4ddab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:43.545231 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2983b6-b0d2-49ca-8bd5-fd8959b4ddab service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:43.545552 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2983b6-b0d2-49ca-8bd5-fd8959b4ddab service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:43.545820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2983b6-b0d2-49ca-8bd5-fd8959b4ddab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:43.547545 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ab2983b6-b0d2-49ca-8bd5-fd8959b4ddab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:43.557478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2983b6-b0d2-49ca-8bd5-fd8959b4ddab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:43.558840 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2983b6-b0d2-49ca-8bd5-fd8959b4ddab service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:43.566878 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1160/2342] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:00:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:00:44.904147 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b881d-e6bd-45c6-b2bf-ae4220cb3545 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:44.905772 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-a39b881d-e6bd-45c6-b2bf-ae4220cb3545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:44.981254 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b881d-e6bd-45c6-b2bf-ae4220cb3545 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:44.986875 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8d158-4c3a-4b9a-8157-5a6542cc082e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b33f797a9af946a4b296d973388891be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:44.987486 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8d158-4c3a-4b9a-8157-5a6542cc082e service placement] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:44.987770 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8d158-4c3a-4b9a-8157-5a6542cc082e service placement] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:44.988035 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8d158-4c3a-4b9a-8157-5a6542cc082e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:44.989818 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-72e8d158-4c3a-4b9a-8157-5a6542cc082e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:45.003947 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8d158-4c3a-4b9a-8157-5a6542cc082e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:45.005803 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8d158-4c3a-4b9a-8157-5a6542cc082e service placement] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:45.020854 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1183/2343] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:00:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 11:00:45.599142 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2983b6-b0d2-49ca-8bd5-fd8959b4ddab service neutron] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:45.600576 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ab2983b6-b0d2-49ca-8bd5-fd8959b4ddab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:45.618521 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2983b6-b0d2-49ca-8bd5-fd8959b4ddab service neutron] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:45.624300 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7b119-ec92-4f11-8435-ea7e30564bab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b33f797a9af946a4b296d973388891be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:45.624904 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7b119-ec92-4f11-8435-ea7e30564bab service placement] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:45.625188 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7b119-ec92-4f11-8435-ea7e30564bab service placement] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:45.625599 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7b119-ec92-4f11-8435-ea7e30564bab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:45.627408 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-fab7b119-ec92-4f11-8435-ea7e30564bab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:45.640516 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7b119-ec92-4f11-8435-ea7e30564bab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:45.642218 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7b119-ec92-4f11-8435-ea7e30564bab service placement] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:45.656087 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8d158-4c3a-4b9a-8157-5a6542cc082e service placement] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:45.656228 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1161/2344] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:00:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:00:45.658012 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-72e8d158-4c3a-4b9a-8157-5a6542cc082e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:45.720065 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:00:45.743465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8d158-4c3a-4b9a-8157-5a6542cc082e service placement] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:45.748205 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a51b0-21bd-4130-96df-b7e39aeecb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:45.748821 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a51b0-21bd-4130-96df-b7e39aeecb2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:45.749095 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a51b0-21bd-4130-96df-b7e39aeecb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:45.749387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a51b0-21bd-4130-96df-b7e39aeecb2a admin admin] PATH_INFO: `/v3/users/6f36e072f3274b399c6c19948f9862b2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:45.750512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a51b0-21bd-4130-96df-b7e39aeecb2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f36e072f3274b399c6c19948f9862b2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:45.752415 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a51b0-21bd-4130-96df-b7e39aeecb2a admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:45.801625 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-a18a51b0-21bd-4130-96df-b7e39aeecb2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f36e072f3274b399c6c19948f9862b2'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:45.817066 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-a18a51b0-21bd-4130-96df-b7e39aeecb2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f36e072f3274b399c6c19948f9862b2'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:45.818014 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-a18a51b0-21bd-4130-96df-b7e39aeecb2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f36e072f3274b399c6c19948f9862b2'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:45.826337 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-a18a51b0-21bd-4130-96df-b7e39aeecb2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f36e072f3274b399c6c19948f9862b2'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:45.833663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-a18a51b0-21bd-4130-96df-b7e39aeecb2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f36e072f3274b399c6c19948f9862b2'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:45.839879 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1184/2345] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:00:45 2022] DELETE /identity/v3/users/6f36e072f3274b399c6c19948f9862b2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:00:46.021465 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7b119-ec92-4f11-8435-ea7e30564bab service placement] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:46.029434 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:00:46.039201 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7b119-ec92-4f11-8435-ea7e30564bab service placement] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:46.099912 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0ee3b-2766-4269-bc02-1c6defa91689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:46.100530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0ee3b-2766-4269-bc02-1c6defa91689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:46.100809 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0ee3b-2766-4269-bc02-1c6defa91689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:46.101178 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0ee3b-2766-4269-bc02-1c6defa91689 admin admin] PATH_INFO: `/v3/projects/aa4cbb40c6044de8bee366555c493dd7` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:46.102936 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a0ee3b-2766-4269-bc02-1c6defa91689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa4cbb40c6044de8bee366555c493dd7)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:46.104850 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a0ee3b-2766-4269-bc02-1c6defa91689 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:46.154536 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-f6a0ee3b-2766-4269-bc02-1c6defa91689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa4cbb40c6044de8bee366555c493dd7', 'request_id': 'req-f6a0ee3b-2766-4269-bc02-1c6defa91689'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:46.160358 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-f6a0ee3b-2766-4269-bc02-1c6defa91689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa4cbb40c6044de8bee366555c493dd7', 'request_id': 'req-f6a0ee3b-2766-4269-bc02-1c6defa91689'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:46.166497 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-f6a0ee3b-2766-4269-bc02-1c6defa91689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa4cbb40c6044de8bee366555c493dd7', 'request_id': 'req-f6a0ee3b-2766-4269-bc02-1c6defa91689'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:46.180267 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-f6a0ee3b-2766-4269-bc02-1c6defa91689 admin admin] The token cache is being invalidate because project aa4cbb40c6044de8bee366555c493dd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:00:46.180628 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-f6a0ee3b-2766-4269-bc02-1c6defa91689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:46.181187 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-f6a0ee3b-2766-4269-bc02-1c6defa91689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:46.182755 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1162/2346] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:00:46 2022] DELETE /identity/v3/projects/aa4cbb40c6044de8bee366555c493dd7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:00:46.186708 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a51b0-21bd-4130-96df-b7e39aeecb2a admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:46.188132 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-a18a51b0-21bd-4130-96df-b7e39aeecb2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:46.202332 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a51b0-21bd-4130-96df-b7e39aeecb2a admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:46.280222 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc99fb-486a-45d5-9c99-1cbf3d79ccdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:46.280946 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc99fb-486a-45d5-9c99-1cbf3d79ccdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:46.281218 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc99fb-486a-45d5-9c99-1cbf3d79ccdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:46.281664 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc99fb-486a-45d5-9c99-1cbf3d79ccdc admin admin] PATH_INFO: `/v3/users/d98ba11e90624c149c73744226ad38c1` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:46.282895 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc99fb-486a-45d5-9c99-1cbf3d79ccdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d98ba11e90624c149c73744226ad38c1)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:46.284903 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc99fb-486a-45d5-9c99-1cbf3d79ccdc admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:46.335303 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-54bc99fb-486a-45d5-9c99-1cbf3d79ccdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd98ba11e90624c149c73744226ad38c1'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:46.345517 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:00:46.347898 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-54bc99fb-486a-45d5-9c99-1cbf3d79ccdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd98ba11e90624c149c73744226ad38c1'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:46.349290 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-54bc99fb-486a-45d5-9c99-1cbf3d79ccdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd98ba11e90624c149c73744226ad38c1'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:46.357807 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-54bc99fb-486a-45d5-9c99-1cbf3d79ccdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd98ba11e90624c149c73744226ad38c1'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:46.364989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-54bc99fb-486a-45d5-9c99-1cbf3d79ccdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd98ba11e90624c149c73744226ad38c1'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:46.371858 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1185/2347] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:00:46 2022] DELETE /identity/v3/users/d98ba11e90624c149c73744226ad38c1 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:00:46.542110 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0ee3b-2766-4269-bc02-1c6defa91689 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:46.543851 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-f6a0ee3b-2766-4269-bc02-1c6defa91689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:46.557996 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0ee3b-2766-4269-bc02-1c6defa91689 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:46.615195 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900ff1b-0188-4ae4-905f-187393832c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:46.615813 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900ff1b-0188-4ae4-905f-187393832c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:46.616083 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900ff1b-0188-4ae4-905f-187393832c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:46.616355 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900ff1b-0188-4ae4-905f-187393832c25 admin admin] PATH_INFO: `/v3/projects/14216df28b0f40b19d304d822a12ce08` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:46.618103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900ff1b-0188-4ae4-905f-187393832c25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14216df28b0f40b19d304d822a12ce08)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:46.620014 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900ff1b-0188-4ae4-905f-187393832c25 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:46.656661 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:00:46.667295 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-3900ff1b-0188-4ae4-905f-187393832c25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14216df28b0f40b19d304d822a12ce08', 'request_id': 'req-3900ff1b-0188-4ae4-905f-187393832c25'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:46.672694 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-3900ff1b-0188-4ae4-905f-187393832c25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14216df28b0f40b19d304d822a12ce08', 'request_id': 'req-3900ff1b-0188-4ae4-905f-187393832c25'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:46.678690 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-3900ff1b-0188-4ae4-905f-187393832c25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14216df28b0f40b19d304d822a12ce08', 'request_id': 'req-3900ff1b-0188-4ae4-905f-187393832c25'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:46.691568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-3900ff1b-0188-4ae4-905f-187393832c25 admin admin] The token cache is being invalidate because project 14216df28b0f40b19d304d822a12ce08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:00:46.691859 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-3900ff1b-0188-4ae4-905f-187393832c25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:46.692486 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-3900ff1b-0188-4ae4-905f-187393832c25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:46.693995 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1163/2348] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:00:46 2022] DELETE /identity/v3/projects/14216df28b0f40b19d304d822a12ce08 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:00:50.012741 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc99fb-486a-45d5-9c99-1cbf3d79ccdc admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:50.014163 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-54bc99fb-486a-45d5-9c99-1cbf3d79ccdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:50.027362 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc99fb-486a-45d5-9c99-1cbf3d79ccdc admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:50.082275 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2108f34-fafb-4f23-8c80-452f4f17c4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:50.082888 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2108f34-fafb-4f23-8c80-452f4f17c4d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:50.083159 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2108f34-fafb-4f23-8c80-452f4f17c4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:50.083424 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2108f34-fafb-4f23-8c80-452f4f17c4d2 admin admin] PATH_INFO: `/v3/users/705b6c6411cd4aa2b0b78be47c0cbb66` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:50.084528 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2108f34-fafb-4f23-8c80-452f4f17c4d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=705b6c6411cd4aa2b0b78be47c0cbb66)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:50.086959 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2108f34-fafb-4f23-8c80-452f4f17c4d2 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:50.132395 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-b2108f34-fafb-4f23-8c80-452f4f17c4d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '705b6c6411cd4aa2b0b78be47c0cbb66'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:50.144440 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-b2108f34-fafb-4f23-8c80-452f4f17c4d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '705b6c6411cd4aa2b0b78be47c0cbb66'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:50.145122 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-b2108f34-fafb-4f23-8c80-452f4f17c4d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '705b6c6411cd4aa2b0b78be47c0cbb66'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:50.152485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-b2108f34-fafb-4f23-8c80-452f4f17c4d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '705b6c6411cd4aa2b0b78be47c0cbb66'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:50.159822 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-b2108f34-fafb-4f23-8c80-452f4f17c4d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '705b6c6411cd4aa2b0b78be47c0cbb66'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:50.166327 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1186/2349] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:00:50 2022] DELETE /identity/v3/users/705b6c6411cd4aa2b0b78be47c0cbb66 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:00:50.170802 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bb853-ad75-4961-99d1-aa066fd84327 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:50.171312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bb853-ad75-4961-99d1-aa066fd84327 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:50.171429 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bb853-ad75-4961-99d1-aa066fd84327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:50.191270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-710bb853-ad75-4961-99d1-aa066fd84327 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:00:50.193162 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-710bb853-ad75-4961-99d1-aa066fd84327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:50.263282 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1164/2350] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:00:50.272879 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2108f34-fafb-4f23-8c80-452f4f17c4d2 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:50.274863 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-b2108f34-fafb-4f23-8c80-452f4f17c4d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:50.330854 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2108f34-fafb-4f23-8c80-452f4f17c4d2 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:50.334720 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49ed30-ba02-4485-aff4-5f3bd8be623a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:50.335482 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49ed30-ba02-4485-aff4-5f3bd8be623a service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:50.336270 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49ed30-ba02-4485-aff4-5f3bd8be623a service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:50.336543 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49ed30-ba02-4485-aff4-5f3bd8be623a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:50.347971 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49ed30-ba02-4485-aff4-5f3bd8be623a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:50.349424 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49ed30-ba02-4485-aff4-5f3bd8be623a service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:50.354420 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:00:50.359751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1187/2351] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:00:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:00:50.633237 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710bb853-ad75-4961-99d1-aa066fd84327 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:50.634690 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-710bb853-ad75-4961-99d1-aa066fd84327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:50.661827 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710bb853-ad75-4961-99d1-aa066fd84327 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:50.667068 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddccadc-c168-4d8e-babc-847cc3e28a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:50.667708 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddccadc-c168-4d8e-babc-847cc3e28a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:50.667990 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddccadc-c168-4d8e-babc-847cc3e28a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:50.668260 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddccadc-c168-4d8e-babc-847cc3e28a5f admin admin] PATH_INFO: `/v3/projects/be2ee6a9d8f044cebc66367fd5922394` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:50.669460 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddccadc-c168-4d8e-babc-847cc3e28a5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=be2ee6a9d8f044cebc66367fd5922394)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:50.671373 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddccadc-c168-4d8e-babc-847cc3e28a5f admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:50.719934 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-7ddccadc-c168-4d8e-babc-847cc3e28a5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be2ee6a9d8f044cebc66367fd5922394', 'request_id': 'req-7ddccadc-c168-4d8e-babc-847cc3e28a5f'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:50.725324 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-7ddccadc-c168-4d8e-babc-847cc3e28a5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be2ee6a9d8f044cebc66367fd5922394', 'request_id': 'req-7ddccadc-c168-4d8e-babc-847cc3e28a5f'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:50.731496 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-7ddccadc-c168-4d8e-babc-847cc3e28a5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be2ee6a9d8f044cebc66367fd5922394', 'request_id': 'req-7ddccadc-c168-4d8e-babc-847cc3e28a5f'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:50.744848 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-7ddccadc-c168-4d8e-babc-847cc3e28a5f admin admin] The token cache is being invalidate because project be2ee6a9d8f044cebc66367fd5922394 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:00:50.745181 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-7ddccadc-c168-4d8e-babc-847cc3e28a5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:50.745873 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-7ddccadc-c168-4d8e-babc-847cc3e28a5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:50.747406 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1165/2352] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:00:50 2022] DELETE /identity/v3/projects/be2ee6a9d8f044cebc66367fd5922394 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:00:50.751362 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49ed30-ba02-4485-aff4-5f3bd8be623a service neutron] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:50.761293 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49ed30-ba02-4485-aff4-5f3bd8be623a service neutron] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:50.816604 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c6715-0af9-4875-88d5-0c717034803d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:50.817218 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c6715-0af9-4875-88d5-0c717034803d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:50.817529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c6715-0af9-4875-88d5-0c717034803d admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:50.817801 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c6715-0af9-4875-88d5-0c717034803d admin admin] PATH_INFO: `/v3/users/64d8f972e28d4e89b8393e88289d463a` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:50.818913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c6715-0af9-4875-88d5-0c717034803d admin admin] RBAC: Authorizing `identity:delete_user(user_id=64d8f972e28d4e89b8393e88289d463a)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:50.821607 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c6715-0af9-4875-88d5-0c717034803d admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:50.864672 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-b96c6715-0af9-4875-88d5-0c717034803d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64d8f972e28d4e89b8393e88289d463a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:50.877584 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-b96c6715-0af9-4875-88d5-0c717034803d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64d8f972e28d4e89b8393e88289d463a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:50.878223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-b96c6715-0af9-4875-88d5-0c717034803d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64d8f972e28d4e89b8393e88289d463a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:50.885704 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-b96c6715-0af9-4875-88d5-0c717034803d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64d8f972e28d4e89b8393e88289d463a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:50.893158 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-b96c6715-0af9-4875-88d5-0c717034803d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64d8f972e28d4e89b8393e88289d463a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:50.898907 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1188/2353] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:00:50 2022] DELETE /identity/v3/users/64d8f972e28d4e89b8393e88289d463a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:00:51.058553 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddccadc-c168-4d8e-babc-847cc3e28a5f admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:51.060044 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-7ddccadc-c168-4d8e-babc-847cc3e28a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:51.117837 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:00:51.122094 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddccadc-c168-4d8e-babc-847cc3e28a5f admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:51.166826 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c6715-0af9-4875-88d5-0c717034803d admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:51.168256 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-b96c6715-0af9-4875-88d5-0c717034803d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:51.181224 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8bfcd4-ce9c-4616-800d-f40cb005c9e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:51.181870 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8bfcd4-ce9c-4616-800d-f40cb005c9e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:51.182146 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8bfcd4-ce9c-4616-800d-f40cb005c9e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:51.182413 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8bfcd4-ce9c-4616-800d-f40cb005c9e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:51.184304 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ab8bfcd4-ce9c-4616-800d-f40cb005c9e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:51.237140 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c6715-0af9-4875-88d5-0c717034803d admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:51.242323 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56309608-6f1a-4982-a671-9fe49d21c6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:51.242945 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56309608-6f1a-4982-a671-9fe49d21c6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:51.243235 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56309608-6f1a-4982-a671-9fe49d21c6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:51.243504 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56309608-6f1a-4982-a671-9fe49d21c6aa admin admin] PATH_INFO: `/v3/projects/5e5ef8d1de12449897075fe92def4cae` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:51.244613 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56309608-6f1a-4982-a671-9fe49d21c6aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e5ef8d1de12449897075fe92def4cae)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:51.246518 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56309608-6f1a-4982-a671-9fe49d21c6aa admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:51.247975 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8bfcd4-ce9c-4616-800d-f40cb005c9e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:51.249879 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8bfcd4-ce9c-4616-800d-f40cb005c9e4 service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:51.261045 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1166/2354] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:00:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:00:51.269875 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:00:51.296170 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-56309608-6f1a-4982-a671-9fe49d21c6aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e5ef8d1de12449897075fe92def4cae', 'request_id': 'req-56309608-6f1a-4982-a671-9fe49d21c6aa'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:51.301920 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-56309608-6f1a-4982-a671-9fe49d21c6aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e5ef8d1de12449897075fe92def4cae', 'request_id': 'req-56309608-6f1a-4982-a671-9fe49d21c6aa'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:51.310616 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-56309608-6f1a-4982-a671-9fe49d21c6aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e5ef8d1de12449897075fe92def4cae', 'request_id': 'req-56309608-6f1a-4982-a671-9fe49d21c6aa'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:51.321874 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-56309608-6f1a-4982-a671-9fe49d21c6aa admin admin] The token cache is being invalidate because project 5e5ef8d1de12449897075fe92def4cae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:00:51.322160 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-56309608-6f1a-4982-a671-9fe49d21c6aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:51.322793 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-56309608-6f1a-4982-a671-9fe49d21c6aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:00:51.324278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1189/2355] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:00:51 2022] DELETE /identity/v3/projects/5e5ef8d1de12449897075fe92def4cae => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 11:00:51.329099 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f167a3-f29c-4cf6-9fa7-4b5149b2cd09 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:51.329423 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f167a3-f29c-4cf6-9fa7-4b5149b2cd09 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:51.329699 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f167a3-f29c-4cf6-9fa7-4b5149b2cd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:51.352567 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-82f167a3-f29c-4cf6-9fa7-4b5149b2cd09 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:00:51.353884 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-82f167a3-f29c-4cf6-9fa7-4b5149b2cd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:51.414568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1167/2356] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:00:51.421985 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a449ad-d0d0-471c-aef8-eee411f5c55b None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:51.422328 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a449ad-d0d0-471c-aef8-eee411f5c55b None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:51.422666 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a449ad-d0d0-471c-aef8-eee411f5c55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:51.442455 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-85a449ad-d0d0-471c-aef8-eee411f5c55b None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:00:51.444378 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-85a449ad-d0d0-471c-aef8-eee411f5c55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:51.452668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1190/2357] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 11:00:51.457073 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f167a3-f29c-4cf6-9fa7-4b5149b2cd09 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:51.467687 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f167a3-f29c-4cf6-9fa7-4b5149b2cd09 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:51.472406 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8e3d7-9726-487c-97ed-779be67e6d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:51.472999 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8e3d7-9726-487c-97ed-779be67e6d04 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:51.473335 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8e3d7-9726-487c-97ed-779be67e6d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:51.473619 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8e3d7-9726-487c-97ed-779be67e6d04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:51.474274 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8e3d7-9726-487c-97ed-779be67e6d04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 11:00:51.474576 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8e3d7-9726-487c-97ed-779be67e6d04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:51.476708 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b8e3d7-9726-487c-97ed-779be67e6d04 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:51.489596 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1168/2358] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 11:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 11:00:51.494041 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a449ad-d0d0-471c-aef8-eee411f5c55b None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:51.503338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a449ad-d0d0-471c-aef8-eee411f5c55b None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:51.508181 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13360aa-4753-4dc4-8a3b-8f32b313ba67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:51.508886 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13360aa-4753-4dc4-8a3b-8f32b313ba67 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:51.509120 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13360aa-4753-4dc4-8a3b-8f32b313ba67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:51.509454 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13360aa-4753-4dc4-8a3b-8f32b313ba67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:51.510087 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13360aa-4753-4dc4-8a3b-8f32b313ba67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:51.511958 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13360aa-4753-4dc4-8a3b-8f32b313ba67 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:51.541349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1191/2359] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:00:51 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 11:00:51.545756 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8e3d7-9726-487c-97ed-779be67e6d04 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:51.556144 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8e3d7-9726-487c-97ed-779be67e6d04 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:51.600918 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:00:51.615001 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eeac88-2a7f-4328-8bfd-6569dc8e3c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:51.615770 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eeac88-2a7f-4328-8bfd-6569dc8e3c39 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:51.616150 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eeac88-2a7f-4328-8bfd-6569dc8e3c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:51.616529 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eeac88-2a7f-4328-8bfd-6569dc8e3c39 admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:51.617323 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eeac88-2a7f-4328-8bfd-6569dc8e3c39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:51.619326 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eeac88-2a7f-4328-8bfd-6569dc8e3c39 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:51.645070 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1169/2360] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:00:51 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 11:00:51.646280 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13360aa-4753-4dc4-8a3b-8f32b313ba67 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:51.657197 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13360aa-4753-4dc4-8a3b-8f32b313ba67 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:51.661844 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230a9a7-4e87-475f-8f32-c5f818d10011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:51.662425 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230a9a7-4e87-475f-8f32-c5f818d10011 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:51.662750 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230a9a7-4e87-475f-8f32-c5f818d10011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:51.662963 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230a9a7-4e87-475f-8f32-c5f818d10011 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:51.663657 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f230a9a7-4e87-475f-8f32-c5f818d10011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:51.665739 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f230a9a7-4e87-475f-8f32-c5f818d10011 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:51.678838 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1192/2361] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:00:51.680583 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eeac88-2a7f-4328-8bfd-6569dc8e3c39 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:51.690710 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eeac88-2a7f-4328-8bfd-6569dc8e3c39 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:51.695933 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78034f-5f4c-43d0-85ef-b24d5dbaf197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:51.696556 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78034f-5f4c-43d0-85ef-b24d5dbaf197 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:51.696836 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78034f-5f4c-43d0-85ef-b24d5dbaf197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:51.697106 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78034f-5f4c-43d0-85ef-b24d5dbaf197 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:51.697802 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78034f-5f4c-43d0-85ef-b24d5dbaf197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:51.699399 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78034f-5f4c-43d0-85ef-b24d5dbaf197 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:51.711196 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1170/2362] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:00:51.715393 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230a9a7-4e87-475f-8f32-c5f818d10011 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:51.725342 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230a9a7-4e87-475f-8f32-c5f818d10011 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:51.729931 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb554edb-09d0-4d89-b712-adc065a7c40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:51.730564 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb554edb-09d0-4d89-b712-adc065a7c40e admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:51.730837 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb554edb-09d0-4d89-b712-adc065a7c40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:51.731133 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb554edb-09d0-4d89-b712-adc065a7c40e admin admin] PATH_INFO: `/v3/projects/1e9150f007ba4f438012def559648638/users/d3c19e64d926467f8a7d2fb8f4697e0f/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:51.745781 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb554edb-09d0-4d89-b712-adc065a7c40e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e9150f007ba4f438012def559648638, user_id=d3c19e64d926467f8a7d2fb8f4697e0f, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:51.748731 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb554edb-09d0-4d89-b712-adc065a7c40e admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:51.761977 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1193/2363] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:00:51 2022] PUT /identity/v3/projects/1e9150f007ba4f438012def559648638/users/d3c19e64d926467f8a7d2fb8f4697e0f/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 11:00:51.774121 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e2baa-a3dd-42e3-bdae-73e640bc8a1c None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:51.774400 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e2baa-a3dd-42e3-bdae-73e640bc8a1c None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:51.774669 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e2baa-a3dd-42e3-bdae-73e640bc8a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:51.803355 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-3f2e2baa-a3dd-42e3-bdae-73e640bc8a1c None None] MFA Rules not processed for user `d3c19e64d926467f8a7d2fb8f4697e0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:00:51.804556 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-3f2e2baa-a3dd-42e3-bdae-73e640bc8a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:51.868425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1171/2364] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:00:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:00:51.873037 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb554edb-09d0-4d89-b712-adc065a7c40e admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:51.935428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb554edb-09d0-4d89-b712-adc065a7c40e admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:51.940161 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf0528-0b64-483d-9b1d-f1d35f16de0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:51.940756 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf0528-0b64-483d-9b1d-f1d35f16de0b admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:51.941028 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf0528-0b64-483d-9b1d-f1d35f16de0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:51.941295 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf0528-0b64-483d-9b1d-f1d35f16de0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:51.941955 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf0528-0b64-483d-9b1d-f1d35f16de0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:51.943812 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf0528-0b64-483d-9b1d-f1d35f16de0b admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:51.970406 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1194/2365] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:00:51 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:00:51.974759 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e2baa-a3dd-42e3-bdae-73e640bc8a1c None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:51.985216 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e2baa-a3dd-42e3-bdae-73e640bc8a1c None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:52.039550 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3124e-950f-4a72-b8d7-4b33c35cbb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:52.040174 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3124e-950f-4a72-b8d7-4b33c35cbb2c admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:52.040452 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3124e-950f-4a72-b8d7-4b33c35cbb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:52.040726 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3124e-950f-4a72-b8d7-4b33c35cbb2c admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:52.041367 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3124e-950f-4a72-b8d7-4b33c35cbb2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:52.043370 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3124e-950f-4a72-b8d7-4b33c35cbb2c admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:52.063860 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1172/2366] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:00:51 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:00:52.067837 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf0528-0b64-483d-9b1d-f1d35f16de0b admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:52.078625 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf0528-0b64-483d-9b1d-f1d35f16de0b admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:52.083177 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7e450-c7ff-4e33-9142-3bfba2b7bac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:52.083761 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7e450-c7ff-4e33-9142-3bfba2b7bac1 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:52.084037 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7e450-c7ff-4e33-9142-3bfba2b7bac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:52.084307 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7e450-c7ff-4e33-9142-3bfba2b7bac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:52.084943 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7e450-c7ff-4e33-9142-3bfba2b7bac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:52.087185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7e450-c7ff-4e33-9142-3bfba2b7bac1 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:52.098863 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1195/2367] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:00:52.102961 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3124e-950f-4a72-b8d7-4b33c35cbb2c admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:52.112710 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3124e-950f-4a72-b8d7-4b33c35cbb2c admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:52.117703 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0a3d6-a795-463e-8c14-a5da9459bc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:52.118281 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0a3d6-a795-463e-8c14-a5da9459bc17 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:52.118551 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0a3d6-a795-463e-8c14-a5da9459bc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:52.118814 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0a3d6-a795-463e-8c14-a5da9459bc17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:52.119447 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0a3d6-a795-463e-8c14-a5da9459bc17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:52.121012 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0a3d6-a795-463e-8c14-a5da9459bc17 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:52.130642 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1173/2368] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:00:52.135078 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7e450-c7ff-4e33-9142-3bfba2b7bac1 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:52.145091 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7e450-c7ff-4e33-9142-3bfba2b7bac1 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:52.149695 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529fa7d-79ed-4358-8dea-c8ca640ecd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:52.150342 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529fa7d-79ed-4358-8dea-c8ca640ecd54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:52.150618 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529fa7d-79ed-4358-8dea-c8ca640ecd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:52.150886 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529fa7d-79ed-4358-8dea-c8ca640ecd54 admin admin] PATH_INFO: `/v3/projects/b3904e00a48a42e38e46341eaab1017b/users/f597d1112210420fab5b67bb73227c2a/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:52.164827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529fa7d-79ed-4358-8dea-c8ca640ecd54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3904e00a48a42e38e46341eaab1017b, user_id=f597d1112210420fab5b67bb73227c2a, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:52.167447 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529fa7d-79ed-4358-8dea-c8ca640ecd54 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:52.170465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:00:52.183502 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1196/2369] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:00:52 2022] PUT /identity/v3/projects/b3904e00a48a42e38e46341eaab1017b/users/f597d1112210420fab5b67bb73227c2a/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:00:52.193653 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe866bfe-d10c-44f2-af29-ac20c1ff7031 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:52.194086 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe866bfe-d10c-44f2-af29-ac20c1ff7031 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:52.194189 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe866bfe-d10c-44f2-af29-ac20c1ff7031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:52.225536 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-fe866bfe-d10c-44f2-af29-ac20c1ff7031 None None] MFA Rules not processed for user `f597d1112210420fab5b67bb73227c2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:00:52.227008 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-fe866bfe-d10c-44f2-af29-ac20c1ff7031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:52.251660 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:00:52.308996 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1174/2370] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:00:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:00:52.313623 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529fa7d-79ed-4358-8dea-c8ca640ecd54 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:52.375277 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529fa7d-79ed-4358-8dea-c8ca640ecd54 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:52.380096 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171cdd19-2ada-4702-91ac-ed4652b5aabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:52.380681 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171cdd19-2ada-4702-91ac-ed4652b5aabe admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:52.380952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171cdd19-2ada-4702-91ac-ed4652b5aabe admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:52.381215 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171cdd19-2ada-4702-91ac-ed4652b5aabe admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:52.381855 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171cdd19-2ada-4702-91ac-ed4652b5aabe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:52.384403 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171cdd19-2ada-4702-91ac-ed4652b5aabe admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:52.410444 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1197/2371] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:00:52 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:00:52.414517 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe866bfe-d10c-44f2-af29-ac20c1ff7031 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:52.425175 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe866bfe-d10c-44f2-af29-ac20c1ff7031 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:52.481115 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d803c6-51e9-4676-bc49-e152048d8bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:52.481677 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d803c6-51e9-4676-bc49-e152048d8bbd admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:52.481956 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d803c6-51e9-4676-bc49-e152048d8bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:52.482225 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d803c6-51e9-4676-bc49-e152048d8bbd admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:52.482848 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d803c6-51e9-4676-bc49-e152048d8bbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:52.484765 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d803c6-51e9-4676-bc49-e152048d8bbd admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:52.505790 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1175/2372] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:00:52 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:00:52.509874 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171cdd19-2ada-4702-91ac-ed4652b5aabe admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:52.520323 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171cdd19-2ada-4702-91ac-ed4652b5aabe admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:52.524818 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee328e-bd9a-4f01-bdbd-7bc182a3308f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:52.525428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee328e-bd9a-4f01-bdbd-7bc182a3308f admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:52.525707 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee328e-bd9a-4f01-bdbd-7bc182a3308f admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:52.525978 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee328e-bd9a-4f01-bdbd-7bc182a3308f admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:52.526614 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee328e-bd9a-4f01-bdbd-7bc182a3308f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:52.528183 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee328e-bd9a-4f01-bdbd-7bc182a3308f admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:52.538419 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1198/2373] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:00:52.542780 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d803c6-51e9-4676-bc49-e152048d8bbd admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:52.552962 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d803c6-51e9-4676-bc49-e152048d8bbd admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:52.559361 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470ef3b-fd43-4c50-a8cb-e6d00f82fe5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:52.560010 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470ef3b-fd43-4c50-a8cb-e6d00f82fe5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:52.560286 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470ef3b-fd43-4c50-a8cb-e6d00f82fe5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:52.560578 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470ef3b-fd43-4c50-a8cb-e6d00f82fe5e admin admin] PATH_INFO: `/v3/projects/e281dd4feb934fd0a6aa6b628ae6b17f/users/92132e45b7ce4f4298ebfedc96dd7ea3/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:52.575702 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470ef3b-fd43-4c50-a8cb-e6d00f82fe5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e281dd4feb934fd0a6aa6b628ae6b17f, user_id=92132e45b7ce4f4298ebfedc96dd7ea3, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:52.578475 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470ef3b-fd43-4c50-a8cb-e6d00f82fe5e admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:52.590846 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1176/2374] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:00:52 2022] PUT /identity/v3/projects/e281dd4feb934fd0a6aa6b628ae6b17f/users/92132e45b7ce4f4298ebfedc96dd7ea3/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:00:52.594957 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee328e-bd9a-4f01-bdbd-7bc182a3308f admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:52.605647 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee328e-bd9a-4f01-bdbd-7bc182a3308f admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:52.661006 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d3bae-9e44-4bec-9eb7-64ae1482c327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:52.661632 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d3bae-9e44-4bec-9eb7-64ae1482c327 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:52.661913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d3bae-9e44-4bec-9eb7-64ae1482c327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:52.662182 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d3bae-9e44-4bec-9eb7-64ae1482c327 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:52.662815 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d3bae-9e44-4bec-9eb7-64ae1482c327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:52.664455 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d3bae-9e44-4bec-9eb7-64ae1482c327 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:52.674604 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1199/2375] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:00:52.678871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470ef3b-fd43-4c50-a8cb-e6d00f82fe5e admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:52.689831 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470ef3b-fd43-4c50-a8cb-e6d00f82fe5e admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:52.694397 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132c7b7-4cd6-4fed-bd79-b4a440efa354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:52.695025 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132c7b7-4cd6-4fed-bd79-b4a440efa354 admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:52.695303 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132c7b7-4cd6-4fed-bd79-b4a440efa354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:52.695574 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132c7b7-4cd6-4fed-bd79-b4a440efa354 admin admin] PATH_INFO: `/v3/projects/e281dd4feb934fd0a6aa6b628ae6b17f/users/92132e45b7ce4f4298ebfedc96dd7ea3/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:52.697514 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132c7b7-4cd6-4fed-bd79-b4a440efa354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e281dd4feb934fd0a6aa6b628ae6b17f, user_id=92132e45b7ce4f4298ebfedc96dd7ea3, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:52.700111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132c7b7-4cd6-4fed-bd79-b4a440efa354 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:52.710016 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1177/2376] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:00:52 2022] PUT /identity/v3/projects/e281dd4feb934fd0a6aa6b628ae6b17f/users/92132e45b7ce4f4298ebfedc96dd7ea3/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 11:00:52.719824 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadf835-5fe7-48a7-9dc2-4be3d5995f19 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:52.720180 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadf835-5fe7-48a7-9dc2-4be3d5995f19 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:52.720548 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadf835-5fe7-48a7-9dc2-4be3d5995f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:52.749740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-8cadf835-5fe7-48a7-9dc2-4be3d5995f19 None None] MFA Rules not processed for user `92132e45b7ce4f4298ebfedc96dd7ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:00:52.751083 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-8cadf835-5fe7-48a7-9dc2-4be3d5995f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:52.802624 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:00:52.822184 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1200/2377] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:00:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:00:52.833035 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132c7b7-4cd6-4fed-bd79-b4a440efa354 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:52.834760 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-b132c7b7-4cd6-4fed-bd79-b4a440efa354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:52.892887 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132c7b7-4cd6-4fed-bd79-b4a440efa354 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:52.896574 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31b8ed-4afd-4ece-8017-ee44e3c90c7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:52.897170 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31b8ed-4afd-4ece-8017-ee44e3c90c7f service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:52.897492 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31b8ed-4afd-4ece-8017-ee44e3c90c7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:52.897764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31b8ed-4afd-4ece-8017-ee44e3c90c7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:52.912482 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31b8ed-4afd-4ece-8017-ee44e3c90c7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:52.913975 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31b8ed-4afd-4ece-8017-ee44e3c90c7f service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:52.925000 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1178/2378] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:00:52 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:00:53.421640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadf835-5fe7-48a7-9dc2-4be3d5995f19 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:53.423045 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-8cadf835-5fe7-48a7-9dc2-4be3d5995f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:53.434567 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cadf835-5fe7-48a7-9dc2-4be3d5995f19 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:53.438024 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ee26c-3aa7-4848-9c87-6b6bc4ea88b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:53.438605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ee26c-3aa7-4848-9c87-6b6bc4ea88b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:53.438877 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ee26c-3aa7-4848-9c87-6b6bc4ea88b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:53.439143 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ee26c-3aa7-4848-9c87-6b6bc4ea88b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:53.493918 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ee26c-3aa7-4848-9c87-6b6bc4ea88b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:53.495326 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ee26c-3aa7-4848-9c87-6b6bc4ea88b0 service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:53.505297 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1201/2379] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:00:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:00:56.107039 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31b8ed-4afd-4ece-8017-ee44e3c90c7f service cinder] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:56.110432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-fe31b8ed-4afd-4ece-8017-ee44e3c90c7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:56.139233 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:00:56.204809 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31b8ed-4afd-4ece-8017-ee44e3c90c7f service cinder] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:56.210727 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698940f-1cf8-4508-ae38-a70903ae5250 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:56.211552 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698940f-1cf8-4508-ae38-a70903ae5250 service nova] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:56.212018 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698940f-1cf8-4508-ae38-a70903ae5250 service nova] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:56.212355 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698940f-1cf8-4508-ae38-a70903ae5250 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:56.214221 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-3698940f-1cf8-4508-ae38-a70903ae5250 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:56.230329 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698940f-1cf8-4508-ae38-a70903ae5250 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:56.232127 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698940f-1cf8-4508-ae38-a70903ae5250 service nova] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:56.244794 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1179/2380] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:00:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:00:57.626399 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ee26c-3aa7-4848-9c87-6b6bc4ea88b0 service cinder] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:00:57.636276 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ee26c-3aa7-4848-9c87-6b6bc4ea88b0 service cinder] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:00:57.641460 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e07405-5a83-49e5-a838-6048e1a89e2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:00:57.642065 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e07405-5a83-49e5-a838-6048e1a89e2d service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:57.642341 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e07405-5a83-49e5-a838-6048e1a89e2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:57.642620 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e07405-5a83-49e5-a838-6048e1a89e2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:57.706288 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e07405-5a83-49e5-a838-6048e1a89e2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:00:57.707627 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e07405-5a83-49e5-a838-6048e1a89e2d service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:00:57.718377 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1202/2381] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:00:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 11:00:58.570089 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364dfc6-5277-4c72-89ed-99dbed4154f0 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:00:58.570574 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364dfc6-5277-4c72-89ed-99dbed4154f0 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:00:58.570684 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364dfc6-5277-4c72-89ed-99dbed4154f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:00:58.590532 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-1364dfc6-5277-4c72-89ed-99dbed4154f0 None None] MFA Rules not processed for user `2f9976b79f2840bf90eeba66eb999e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:00:58.591709 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-1364dfc6-5277-4c72-89ed-99dbed4154f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:00:58.645476 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1180/2382] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:00:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:00:59.935467 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e07405-5a83-49e5-a838-6048e1a89e2d service cinder] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:00.004249 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e07405-5a83-49e5-a838-6048e1a89e2d service cinder] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:00.009873 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc11bbf-5fb0-47be-976d-10f0830362b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:00.010544 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc11bbf-5fb0-47be-976d-10f0830362b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:00.010865 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc11bbf-5fb0-47be-976d-10f0830362b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:00.011057 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc11bbf-5fb0-47be-976d-10f0830362b4 admin admin] PATH_INFO: `/v3/users/d3c19e64d926467f8a7d2fb8f4697e0f` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:00.012296 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc11bbf-5fb0-47be-976d-10f0830362b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3c19e64d926467f8a7d2fb8f4697e0f)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:00.014515 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc11bbf-5fb0-47be-976d-10f0830362b4 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:00.051411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:00.066286 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-5cc11bbf-5fb0-47be-976d-10f0830362b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3c19e64d926467f8a7d2fb8f4697e0f'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:00.079479 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-5cc11bbf-5fb0-47be-976d-10f0830362b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3c19e64d926467f8a7d2fb8f4697e0f'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:00.080258 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-5cc11bbf-5fb0-47be-976d-10f0830362b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3c19e64d926467f8a7d2fb8f4697e0f'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:00.088712 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-5cc11bbf-5fb0-47be-976d-10f0830362b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3c19e64d926467f8a7d2fb8f4697e0f'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:00.099640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-5cc11bbf-5fb0-47be-976d-10f0830362b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3c19e64d926467f8a7d2fb8f4697e0f'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:00.107965 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1203/2383] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:00:59 2022] DELETE /identity/v3/users/d3c19e64d926467f8a7d2fb8f4697e0f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:01:00.112223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8d80e-3111-4593-90d0-ca582430e35f None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:00.112724 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8d80e-3111-4593-90d0-ca582430e35f None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:00.112832 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8d80e-3111-4593-90d0-ca582430e35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:00.135119 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-80f8d80e-3111-4593-90d0-ca582430e35f None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:01:00.136524 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-80f8d80e-3111-4593-90d0-ca582430e35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:01:00.209209 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1181/2384] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:01:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 11:01:00.219780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc11bbf-5fb0-47be-976d-10f0830362b4 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:00.222014 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-5cc11bbf-5fb0-47be-976d-10f0830362b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:01:00.297751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc11bbf-5fb0-47be-976d-10f0830362b4 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:00.302078 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d34ac-adba-4c06-b757-63401e17ea6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:00.302980 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d34ac-adba-4c06-b757-63401e17ea6e service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:00.302980 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d34ac-adba-4c06-b757-63401e17ea6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:00.303221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d34ac-adba-4c06-b757-63401e17ea6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:00.315955 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d34ac-adba-4c06-b757-63401e17ea6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:00.317411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d34ac-adba-4c06-b757-63401e17ea6e service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:00.332085 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1204/2385] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:01:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:01:00.650963 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8d80e-3111-4593-90d0-ca582430e35f None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:00.652400 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-80f8d80e-3111-4593-90d0-ca582430e35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:01:00.665533 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8d80e-3111-4593-90d0-ca582430e35f None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:00.671043 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f633890-e9aa-4f65-a66d-689c293993c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:00.671673 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f633890-e9aa-4f65-a66d-689c293993c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:00.671953 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f633890-e9aa-4f65-a66d-689c293993c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:00.672224 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f633890-e9aa-4f65-a66d-689c293993c0 admin admin] PATH_INFO: `/v3/projects/1e9150f007ba4f438012def559648638` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:00.673377 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f633890-e9aa-4f65-a66d-689c293993c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e9150f007ba4f438012def559648638)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:00.675281 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f633890-e9aa-4f65-a66d-689c293993c0 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:00.722566 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:00.727877 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0f633890-e9aa-4f65-a66d-689c293993c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e9150f007ba4f438012def559648638', 'request_id': 'req-0f633890-e9aa-4f65-a66d-689c293993c0'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:00.735271 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0f633890-e9aa-4f65-a66d-689c293993c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e9150f007ba4f438012def559648638', 'request_id': 'req-0f633890-e9aa-4f65-a66d-689c293993c0'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:00.741516 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0f633890-e9aa-4f65-a66d-689c293993c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e9150f007ba4f438012def559648638', 'request_id': 'req-0f633890-e9aa-4f65-a66d-689c293993c0'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:00.758289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0f633890-e9aa-4f65-a66d-689c293993c0 admin admin] The token cache is being invalidate because project 1e9150f007ba4f438012def559648638 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:01:00.758289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0f633890-e9aa-4f65-a66d-689c293993c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:00.758964 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0f633890-e9aa-4f65-a66d-689c293993c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:00.761164 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1182/2386] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:01:00 2022] DELETE /identity/v3/projects/1e9150f007ba4f438012def559648638 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:01:00.765164 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d34ac-adba-4c06-b757-63401e17ea6e service neutron] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:00.776984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d34ac-adba-4c06-b757-63401e17ea6e service neutron] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:00.848637 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2155554-935c-4a23-b2f5-12707f8abf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:00.849300 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2155554-935c-4a23-b2f5-12707f8abf0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:00.849605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2155554-935c-4a23-b2f5-12707f8abf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:00.849870 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2155554-935c-4a23-b2f5-12707f8abf0b admin admin] PATH_INFO: `/v3/users/f597d1112210420fab5b67bb73227c2a` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:00.851013 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2155554-935c-4a23-b2f5-12707f8abf0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f597d1112210420fab5b67bb73227c2a)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:00.854103 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2155554-935c-4a23-b2f5-12707f8abf0b admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:00.916732 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d2155554-935c-4a23-b2f5-12707f8abf0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f597d1112210420fab5b67bb73227c2a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:00.921775 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:00.934344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d2155554-935c-4a23-b2f5-12707f8abf0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f597d1112210420fab5b67bb73227c2a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:00.935251 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d2155554-935c-4a23-b2f5-12707f8abf0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f597d1112210420fab5b67bb73227c2a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:00.943466 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d2155554-935c-4a23-b2f5-12707f8abf0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f597d1112210420fab5b67bb73227c2a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:00.953164 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d2155554-935c-4a23-b2f5-12707f8abf0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f597d1112210420fab5b67bb73227c2a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:00.960060 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1205/2387] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:01:00 2022] DELETE /identity/v3/users/f597d1112210420fab5b67bb73227c2a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:01:01.269466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f633890-e9aa-4f65-a66d-689c293993c0 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:01.274536 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-0f633890-e9aa-4f65-a66d-689c293993c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:01:01.292565 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f633890-e9aa-4f65-a66d-689c293993c0 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:01.372933 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db6876-b91e-4e79-8591-80242fbc6c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:01.373927 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db6876-b91e-4e79-8591-80242fbc6c82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:01.374387 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db6876-b91e-4e79-8591-80242fbc6c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:01.374658 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db6876-b91e-4e79-8591-80242fbc6c82 admin admin] PATH_INFO: `/v3/projects/b3904e00a48a42e38e46341eaab1017b` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:01.375947 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db6876-b91e-4e79-8591-80242fbc6c82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3904e00a48a42e38e46341eaab1017b)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:01.377897 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db6876-b91e-4e79-8591-80242fbc6c82 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:01.451480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-45db6876-b91e-4e79-8591-80242fbc6c82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3904e00a48a42e38e46341eaab1017b', 'request_id': 'req-45db6876-b91e-4e79-8591-80242fbc6c82'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:01.462571 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-45db6876-b91e-4e79-8591-80242fbc6c82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3904e00a48a42e38e46341eaab1017b', 'request_id': 'req-45db6876-b91e-4e79-8591-80242fbc6c82'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:01.473947 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-45db6876-b91e-4e79-8591-80242fbc6c82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3904e00a48a42e38e46341eaab1017b', 'request_id': 'req-45db6876-b91e-4e79-8591-80242fbc6c82'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:01.500188 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-45db6876-b91e-4e79-8591-80242fbc6c82 admin admin] The token cache is being invalidate because project b3904e00a48a42e38e46341eaab1017b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:01:01.500641 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-45db6876-b91e-4e79-8591-80242fbc6c82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:01.501599 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-45db6876-b91e-4e79-8591-80242fbc6c82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:01.504789 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1183/2388] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:01:01 2022] DELETE /identity/v3/projects/b3904e00a48a42e38e46341eaab1017b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:01:01.510044 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2155554-935c-4a23-b2f5-12707f8abf0b admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:01.511955 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-d2155554-935c-4a23-b2f5-12707f8abf0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:01:01.530069 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2155554-935c-4a23-b2f5-12707f8abf0b admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:01.609683 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7775f8-fef1-40d9-97f1-9e1d772c2cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:01.610905 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7775f8-fef1-40d9-97f1-9e1d772c2cfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:01.611443 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7775f8-fef1-40d9-97f1-9e1d772c2cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:01.612202 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7775f8-fef1-40d9-97f1-9e1d772c2cfd admin admin] PATH_INFO: `/v3/users/92132e45b7ce4f4298ebfedc96dd7ea3` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:01.614930 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7775f8-fef1-40d9-97f1-9e1d772c2cfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=92132e45b7ce4f4298ebfedc96dd7ea3)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:01.618554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7775f8-fef1-40d9-97f1-9e1d772c2cfd admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:01.714495 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-9d7775f8-fef1-40d9-97f1-9e1d772c2cfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92132e45b7ce4f4298ebfedc96dd7ea3'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:01.730937 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-9d7775f8-fef1-40d9-97f1-9e1d772c2cfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92132e45b7ce4f4298ebfedc96dd7ea3'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:01.732716 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-9d7775f8-fef1-40d9-97f1-9e1d772c2cfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92132e45b7ce4f4298ebfedc96dd7ea3'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:01.743295 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-9d7775f8-fef1-40d9-97f1-9e1d772c2cfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92132e45b7ce4f4298ebfedc96dd7ea3'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:01.753963 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-9d7775f8-fef1-40d9-97f1-9e1d772c2cfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92132e45b7ce4f4298ebfedc96dd7ea3'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:01.767017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1206/2389] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:01:01 2022] DELETE /identity/v3/users/92132e45b7ce4f4298ebfedc96dd7ea3 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:01:02.357645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db6876-b91e-4e79-8591-80242fbc6c82 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:02.359066 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-45db6876-b91e-4e79-8591-80242fbc6c82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:01:02.374739 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db6876-b91e-4e79-8591-80242fbc6c82 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:02.450895 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d16441-0694-4a82-af3d-946f44e22941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:02.451627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d16441-0694-4a82-af3d-946f44e22941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:02.451906 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d16441-0694-4a82-af3d-946f44e22941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:02.452178 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d16441-0694-4a82-af3d-946f44e22941 admin admin] PATH_INFO: `/v3/projects/e281dd4feb934fd0a6aa6b628ae6b17f` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:02.453339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d16441-0694-4a82-af3d-946f44e22941 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e281dd4feb934fd0a6aa6b628ae6b17f)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:02.455453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d16441-0694-4a82-af3d-946f44e22941 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:02.462976 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:02.508588 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-b7d16441-0694-4a82-af3d-946f44e22941 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e281dd4feb934fd0a6aa6b628ae6b17f', 'request_id': 'req-b7d16441-0694-4a82-af3d-946f44e22941'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:02.515361 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-b7d16441-0694-4a82-af3d-946f44e22941 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e281dd4feb934fd0a6aa6b628ae6b17f', 'request_id': 'req-b7d16441-0694-4a82-af3d-946f44e22941'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:02.521634 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-b7d16441-0694-4a82-af3d-946f44e22941 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e281dd4feb934fd0a6aa6b628ae6b17f', 'request_id': 'req-b7d16441-0694-4a82-af3d-946f44e22941'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:02.534285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-b7d16441-0694-4a82-af3d-946f44e22941 admin admin] The token cache is being invalidate because project e281dd4feb934fd0a6aa6b628ae6b17f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:01:02.534598 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-b7d16441-0694-4a82-af3d-946f44e22941 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:02.535225 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-b7d16441-0694-4a82-af3d-946f44e22941 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:02.536749 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1184/2390] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:01:02 2022] DELETE /identity/v3/projects/e281dd4feb934fd0a6aa6b628ae6b17f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:01:02.543072 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91475cc3-92de-4285-a003-e4eb099ecef9 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:02.543541 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91475cc3-92de-4285-a003-e4eb099ecef9 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:02.543636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91475cc3-92de-4285-a003-e4eb099ecef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:02.564036 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-91475cc3-92de-4285-a003-e4eb099ecef9 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:01:02.565257 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-91475cc3-92de-4285-a003-e4eb099ecef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:01:02.614081 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:02.630826 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1207/2391] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:01:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:01:02.639968 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b9f8c-a9dc-441b-bfc1-3af08f5bd932 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:02.640329 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b9f8c-a9dc-441b-bfc1-3af08f5bd932 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:02.640844 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b9f8c-a9dc-441b-bfc1-3af08f5bd932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:02.661832 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-ab4b9f8c-a9dc-441b-bfc1-3af08f5bd932 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:01:02.663245 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ab4b9f8c-a9dc-441b-bfc1-3af08f5bd932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:01:02.675746 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1185/2392] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:01:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:01:02.677125 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91475cc3-92de-4285-a003-e4eb099ecef9 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:02.689262 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91475cc3-92de-4285-a003-e4eb099ecef9 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:02.693882 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed59992-a9a0-46a1-8884-4739aac12657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:02.694480 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed59992-a9a0-46a1-8884-4739aac12657 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:02.694754 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed59992-a9a0-46a1-8884-4739aac12657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:02.695023 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed59992-a9a0-46a1-8884-4739aac12657 admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:02.695707 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed59992-a9a0-46a1-8884-4739aac12657 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 11:01:02.695999 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed59992-a9a0-46a1-8884-4739aac12657 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:02.698454 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed59992-a9a0-46a1-8884-4739aac12657 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:02.710941 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1208/2393] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 11:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 11:01:02.715910 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b9f8c-a9dc-441b-bfc1-3af08f5bd932 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:02.724988 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b9f8c-a9dc-441b-bfc1-3af08f5bd932 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:02.730324 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969f429-77a9-4f1f-9d5b-fb439ff12bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:02.730922 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969f429-77a9-4f1f-9d5b-fb439ff12bd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:02.731192 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969f429-77a9-4f1f-9d5b-fb439ff12bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:02.731457 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969f429-77a9-4f1f-9d5b-fb439ff12bd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:02.732080 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6969f429-77a9-4f1f-9d5b-fb439ff12bd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:02.733990 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6969f429-77a9-4f1f-9d5b-fb439ff12bd7 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:02.765043 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1186/2394] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:01:02 2022] POST /identity/v3/projects => generated 409 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:01:02.766160 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed59992-a9a0-46a1-8884-4739aac12657 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:02.776700 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed59992-a9a0-46a1-8884-4739aac12657 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:02.834493 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7901cf-560f-4e30-b513-7f26d115bf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:02.835106 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7901cf-560f-4e30-b513-7f26d115bf74 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:02.835384 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7901cf-560f-4e30-b513-7f26d115bf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:02.835655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7901cf-560f-4e30-b513-7f26d115bf74 admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:02.836284 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7901cf-560f-4e30-b513-7f26d115bf74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:02.838908 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7901cf-560f-4e30-b513-7f26d115bf74 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:02.873878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1209/2395] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:01:02 2022] POST /identity/v3/users => generated 305 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 11:01:02.874313 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969f429-77a9-4f1f-9d5b-fb439ff12bd7 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:02.886263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969f429-77a9-4f1f-9d5b-fb439ff12bd7 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:02.892063 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5def68-503b-4942-87bd-fe28ddd6325b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:02.892754 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5def68-503b-4942-87bd-fe28ddd6325b admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:02.893098 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5def68-503b-4942-87bd-fe28ddd6325b admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:02.893474 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5def68-503b-4942-87bd-fe28ddd6325b admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:02.894209 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5def68-503b-4942-87bd-fe28ddd6325b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:02.895885 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5def68-503b-4942-87bd-fe28ddd6325b admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:02.908321 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1187/2396] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:01:02.912463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7901cf-560f-4e30-b513-7f26d115bf74 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:02.923835 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7901cf-560f-4e30-b513-7f26d115bf74 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:02.928699 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfcc1d-d907-48ff-b9f0-19a77ad2c0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:02.929439 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfcc1d-d907-48ff-b9f0-19a77ad2c0df admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:02.929758 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfcc1d-d907-48ff-b9f0-19a77ad2c0df admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:02.930176 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfcc1d-d907-48ff-b9f0-19a77ad2c0df admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:02.931009 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfcc1d-d907-48ff-b9f0-19a77ad2c0df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:02.933421 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfcc1d-d907-48ff-b9f0-19a77ad2c0df admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:02.947393 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1210/2397] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:01:02.951604 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5def68-503b-4942-87bd-fe28ddd6325b admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:02.963511 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5def68-503b-4942-87bd-fe28ddd6325b admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:02.969193 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf6ccb-26ad-47e9-ac84-c378acbaf4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:02.970259 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf6ccb-26ad-47e9-ac84-c378acbaf4ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:02.970259 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf6ccb-26ad-47e9-ac84-c378acbaf4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:02.970625 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf6ccb-26ad-47e9-ac84-c378acbaf4ff admin admin] PATH_INFO: `/v3/projects/fa51b0edd8974d50b5976100468f0aae/users/cb1bdcfe82724648b2b75374d5747806/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:02.988122 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf6ccb-26ad-47e9-ac84-c378acbaf4ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa51b0edd8974d50b5976100468f0aae, user_id=cb1bdcfe82724648b2b75374d5747806, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:02.991188 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf6ccb-26ad-47e9-ac84-c378acbaf4ff admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:03.007872 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1188/2398] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:01:02 2022] PUT /identity/v3/projects/fa51b0edd8974d50b5976100468f0aae/users/cb1bdcfe82724648b2b75374d5747806/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:01:03.019842 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d6b43-71c4-4dea-844e-14480e191671 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:03.020193 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d6b43-71c4-4dea-844e-14480e191671 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:03.020540 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d6b43-71c4-4dea-844e-14480e191671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:03.064870 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-aa6d6b43-71c4-4dea-844e-14480e191671 None None] MFA Rules not processed for user `cb1bdcfe82724648b2b75374d5747806`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:01:03.066188 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-aa6d6b43-71c4-4dea-844e-14480e191671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:01:03.140574 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1211/2399] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:01:03 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:01:03.145084 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf6ccb-26ad-47e9-ac84-c378acbaf4ff admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:03.206797 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf6ccb-26ad-47e9-ac84-c378acbaf4ff admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:03.212252 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173daaa0-4902-41c0-b59a-8a9712b75131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:03.212928 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173daaa0-4902-41c0-b59a-8a9712b75131 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:03.213204 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173daaa0-4902-41c0-b59a-8a9712b75131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:03.213524 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173daaa0-4902-41c0-b59a-8a9712b75131 admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:03.214180 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173daaa0-4902-41c0-b59a-8a9712b75131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:03.216100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173daaa0-4902-41c0-b59a-8a9712b75131 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:03.241916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1189/2400] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:01:03 2022] POST /identity/v3/projects => generated 409 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:01:03.246127 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d6b43-71c4-4dea-844e-14480e191671 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:03.256904 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d6b43-71c4-4dea-844e-14480e191671 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:03.297866 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:03.313850 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261fd98-bba0-4d26-bc88-4f6e431e8d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:03.314447 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261fd98-bba0-4d26-bc88-4f6e431e8d2f admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:03.314721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261fd98-bba0-4d26-bc88-4f6e431e8d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:03.314986 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261fd98-bba0-4d26-bc88-4f6e431e8d2f admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:03.315589 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261fd98-bba0-4d26-bc88-4f6e431e8d2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:03.317503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261fd98-bba0-4d26-bc88-4f6e431e8d2f admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:03.341474 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1212/2401] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:01:03 2022] POST /identity/v3/users => generated 311 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:01:03.346270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173daaa0-4902-41c0-b59a-8a9712b75131 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:03.357639 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173daaa0-4902-41c0-b59a-8a9712b75131 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:03.362236 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66608a87-9c3d-4b11-9315-fb53a3de162b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:03.362816 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66608a87-9c3d-4b11-9315-fb53a3de162b admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:03.363091 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66608a87-9c3d-4b11-9315-fb53a3de162b admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:03.363362 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66608a87-9c3d-4b11-9315-fb53a3de162b admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:03.364040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66608a87-9c3d-4b11-9315-fb53a3de162b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:03.365706 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66608a87-9c3d-4b11-9315-fb53a3de162b admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:03.376861 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1190/2402] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:01:03.381202 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261fd98-bba0-4d26-bc88-4f6e431e8d2f admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:03.392098 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261fd98-bba0-4d26-bc88-4f6e431e8d2f admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:03.397058 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441becf-72b6-4af4-aa26-767425d413f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:03.397731 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441becf-72b6-4af4-aa26-767425d413f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:03.398009 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441becf-72b6-4af4-aa26-767425d413f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:03.398278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441becf-72b6-4af4-aa26-767425d413f7 admin admin] PATH_INFO: `/v3/projects/50450ccefa1c4e32b1e81c88f51b5d8d/users/f860a634cbe34da898c4f232d61277b8/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:03.412631 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441becf-72b6-4af4-aa26-767425d413f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50450ccefa1c4e32b1e81c88f51b5d8d, user_id=f860a634cbe34da898c4f232d61277b8, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:03.415313 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441becf-72b6-4af4-aa26-767425d413f7 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:03.428610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1213/2403] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:01:03 2022] PUT /identity/v3/projects/50450ccefa1c4e32b1e81c88f51b5d8d/users/f860a634cbe34da898c4f232d61277b8/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:01:03.433006 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66608a87-9c3d-4b11-9315-fb53a3de162b admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:03.438110 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:03.444376 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66608a87-9c3d-4b11-9315-fb53a3de162b admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:03.501328 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d937b-a726-43f4-af61-496a5122df21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:03.501991 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d937b-a726-43f4-af61-496a5122df21 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:03.502272 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d937b-a726-43f4-af61-496a5122df21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:03.502542 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d937b-a726-43f4-af61-496a5122df21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:03.503204 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d937b-a726-43f4-af61-496a5122df21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:03.504810 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d937b-a726-43f4-af61-496a5122df21 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:03.515308 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1191/2404] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:01:03.519392 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441becf-72b6-4af4-aa26-767425d413f7 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:03.529749 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441becf-72b6-4af4-aa26-767425d413f7 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:03.534392 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4472857-be3b-4c29-aeac-c891a9817b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:03.535035 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4472857-be3b-4c29-aeac-c891a9817b2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:03.535315 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4472857-be3b-4c29-aeac-c891a9817b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:03.535589 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4472857-be3b-4c29-aeac-c891a9817b2c admin admin] PATH_INFO: `/v3/projects/50450ccefa1c4e32b1e81c88f51b5d8d/users/f860a634cbe34da898c4f232d61277b8/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:03.537540 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4472857-be3b-4c29-aeac-c891a9817b2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=50450ccefa1c4e32b1e81c88f51b5d8d, user_id=f860a634cbe34da898c4f232d61277b8, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:03.540137 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4472857-be3b-4c29-aeac-c891a9817b2c admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:03.550269 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1214/2405] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:01:03 2022] PUT /identity/v3/projects/50450ccefa1c4e32b1e81c88f51b5d8d/users/f860a634cbe34da898c4f232d61277b8/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:01:03.561609 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac8518-f82c-424a-82b9-07d88d919aec None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:03.561893 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac8518-f82c-424a-82b9-07d88d919aec None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:03.562167 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac8518-f82c-424a-82b9-07d88d919aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:03.589410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-1aac8518-f82c-424a-82b9-07d88d919aec None None] MFA Rules not processed for user `f860a634cbe34da898c4f232d61277b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:01:03.590601 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-1aac8518-f82c-424a-82b9-07d88d919aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:01:03.662515 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1192/2406] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:01:03 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:01:03.673711 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4472857-be3b-4c29-aeac-c891a9817b2c admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:03.675517 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-f4472857-be3b-4c29-aeac-c891a9817b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:01:03.738450 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4472857-be3b-4c29-aeac-c891a9817b2c admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:03.742189 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88cc361-9c3d-4588-886d-47a89f2f5bbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:03.743465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cc361-9c3d-4588-886d-47a89f2f5bbd service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:03.743744 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cc361-9c3d-4588-886d-47a89f2f5bbd service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:03.744012 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cc361-9c3d-4588-886d-47a89f2f5bbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:03.752994 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88cc361-9c3d-4588-886d-47a89f2f5bbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:03.754449 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88cc361-9c3d-4588-886d-47a89f2f5bbd service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:03.764011 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1215/2407] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:01:03 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:01:03.911406 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac8518-f82c-424a-82b9-07d88d919aec None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:03.921269 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac8518-f82c-424a-82b9-07d88d919aec None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:03.924817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4cb40-c50d-4ddf-98a9-6c4c9ae12e59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:03.925435 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4cb40-c50d-4ddf-98a9-6c4c9ae12e59 service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:03.925715 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4cb40-c50d-4ddf-98a9-6c4c9ae12e59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:03.925986 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4cb40-c50d-4ddf-98a9-6c4c9ae12e59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:03.995352 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e4cb40-c50d-4ddf-98a9-6c4c9ae12e59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:03.997635 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e4cb40-c50d-4ddf-98a9-6c4c9ae12e59 service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:04.010666 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1193/2408] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:01:03 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:01:09.296727 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88cc361-9c3d-4588-886d-47a89f2f5bbd service cinder] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:09.358963 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88cc361-9c3d-4588-886d-47a89f2f5bbd service cinder] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:09.363544 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18aa0c-858f-4713-b5f7-212e164380ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:09.364262 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18aa0c-858f-4713-b5f7-212e164380ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:09.364542 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18aa0c-858f-4713-b5f7-212e164380ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:09.364809 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18aa0c-858f-4713-b5f7-212e164380ae admin admin] PATH_INFO: `/v3/users/cb1bdcfe82724648b2b75374d5747806` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:09.365941 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18aa0c-858f-4713-b5f7-212e164380ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb1bdcfe82724648b2b75374d5747806)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:09.367841 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18aa0c-858f-4713-b5f7-212e164380ae admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:09.407908 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:09.413538 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-cf18aa0c-858f-4713-b5f7-212e164380ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb1bdcfe82724648b2b75374d5747806'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:09.426947 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-cf18aa0c-858f-4713-b5f7-212e164380ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb1bdcfe82724648b2b75374d5747806'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:09.427605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-cf18aa0c-858f-4713-b5f7-212e164380ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb1bdcfe82724648b2b75374d5747806'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:09.435550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-cf18aa0c-858f-4713-b5f7-212e164380ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb1bdcfe82724648b2b75374d5747806'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:09.443820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-cf18aa0c-858f-4713-b5f7-212e164380ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb1bdcfe82724648b2b75374d5747806'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:09.450126 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1216/2409] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:01:09 2022] DELETE /identity/v3/users/cb1bdcfe82724648b2b75374d5747806 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 11:01:09.454714 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5bed7-6929-4645-88d6-f17282562703 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:09.455173 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5bed7-6929-4645-88d6-f17282562703 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:09.455290 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5bed7-6929-4645-88d6-f17282562703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:09.475211 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-c9a5bed7-6929-4645-88d6-f17282562703 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:01:09.476390 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-c9a5bed7-6929-4645-88d6-f17282562703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:01:09.494218 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:09.545138 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1194/2410] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:01:09.554899 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18aa0c-858f-4713-b5f7-212e164380ae admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:09.556313 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-cf18aa0c-858f-4713-b5f7-212e164380ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:01:09.616085 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18aa0c-858f-4713-b5f7-212e164380ae admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:09.619846 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f312b3-7895-41b7-b506-5e54302d2d50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:09.620444 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f312b3-7895-41b7-b506-5e54302d2d50 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:09.620717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f312b3-7895-41b7-b506-5e54302d2d50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:09.620989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f312b3-7895-41b7-b506-5e54302d2d50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:09.631732 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f312b3-7895-41b7-b506-5e54302d2d50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:09.633230 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f312b3-7895-41b7-b506-5e54302d2d50 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:09.644684 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1217/2411] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:01:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:01:09.929835 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5bed7-6929-4645-88d6-f17282562703 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:09.931885 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-c9a5bed7-6929-4645-88d6-f17282562703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:01:09.945488 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5bed7-6929-4645-88d6-f17282562703 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:09.951168 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1c0d1-843a-4e85-82a2-ac5d82c10252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:09.951798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1c0d1-843a-4e85-82a2-ac5d82c10252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:09.952072 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1c0d1-843a-4e85-82a2-ac5d82c10252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:09.952338 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1c0d1-843a-4e85-82a2-ac5d82c10252 admin admin] PATH_INFO: `/v3/projects/fa51b0edd8974d50b5976100468f0aae` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:09.953522 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1c0d1-843a-4e85-82a2-ac5d82c10252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa51b0edd8974d50b5976100468f0aae)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:09.955413 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1c0d1-843a-4e85-82a2-ac5d82c10252 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:10.007276 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-94a1c0d1-843a-4e85-82a2-ac5d82c10252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa51b0edd8974d50b5976100468f0aae', 'request_id': 'req-94a1c0d1-843a-4e85-82a2-ac5d82c10252'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:10.013638 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-94a1c0d1-843a-4e85-82a2-ac5d82c10252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa51b0edd8974d50b5976100468f0aae', 'request_id': 'req-94a1c0d1-843a-4e85-82a2-ac5d82c10252'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:10.020667 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-94a1c0d1-843a-4e85-82a2-ac5d82c10252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa51b0edd8974d50b5976100468f0aae', 'request_id': 'req-94a1c0d1-843a-4e85-82a2-ac5d82c10252'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:10.034039 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-94a1c0d1-843a-4e85-82a2-ac5d82c10252 admin admin] The token cache is being invalidate because project fa51b0edd8974d50b5976100468f0aae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:01:10.034330 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-94a1c0d1-843a-4e85-82a2-ac5d82c10252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:10.034948 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-94a1c0d1-843a-4e85-82a2-ac5d82c10252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:10.036466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1195/2412] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:01:09 2022] DELETE /identity/v3/projects/fa51b0edd8974d50b5976100468f0aae => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:01:10.041103 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f312b3-7895-41b7-b506-5e54302d2d50 service neutron] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:10.051241 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f312b3-7895-41b7-b506-5e54302d2d50 service neutron] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:10.113567 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76015349-bf21-447f-a112-0634eb4f15ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:10.114192 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76015349-bf21-447f-a112-0634eb4f15ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:10.114467 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76015349-bf21-447f-a112-0634eb4f15ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:10.114733 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76015349-bf21-447f-a112-0634eb4f15ee admin admin] PATH_INFO: `/v3/users/f860a634cbe34da898c4f232d61277b8` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:10.115849 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76015349-bf21-447f-a112-0634eb4f15ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=f860a634cbe34da898c4f232d61277b8)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:10.117834 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76015349-bf21-447f-a112-0634eb4f15ee admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:10.162221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-76015349-bf21-447f-a112-0634eb4f15ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f860a634cbe34da898c4f232d61277b8'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:10.174727 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:10.175924 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-76015349-bf21-447f-a112-0634eb4f15ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f860a634cbe34da898c4f232d61277b8'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:10.176789 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-76015349-bf21-447f-a112-0634eb4f15ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f860a634cbe34da898c4f232d61277b8'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:10.185149 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-76015349-bf21-447f-a112-0634eb4f15ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f860a634cbe34da898c4f232d61277b8'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:10.193290 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-76015349-bf21-447f-a112-0634eb4f15ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f860a634cbe34da898c4f232d61277b8'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:10.199205 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1218/2413] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:01:10 2022] DELETE /identity/v3/users/f860a634cbe34da898c4f232d61277b8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:01:10.519244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1c0d1-843a-4e85-82a2-ac5d82c10252 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:10.520847 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-94a1c0d1-843a-4e85-82a2-ac5d82c10252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:01:10.534845 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1c0d1-843a-4e85-82a2-ac5d82c10252 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:10.592621 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e737816-1d4c-41bc-96af-04afabd1c5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:10.593232 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e737816-1d4c-41bc-96af-04afabd1c5d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:10.593543 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e737816-1d4c-41bc-96af-04afabd1c5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:10.593817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e737816-1d4c-41bc-96af-04afabd1c5d7 admin admin] PATH_INFO: `/v3/projects/50450ccefa1c4e32b1e81c88f51b5d8d` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:10.595006 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e737816-1d4c-41bc-96af-04afabd1c5d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50450ccefa1c4e32b1e81c88f51b5d8d)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:10.596903 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e737816-1d4c-41bc-96af-04afabd1c5d7 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:10.643471 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:10.644785 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-6e737816-1d4c-41bc-96af-04afabd1c5d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50450ccefa1c4e32b1e81c88f51b5d8d', 'request_id': 'req-6e737816-1d4c-41bc-96af-04afabd1c5d7'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:10.652499 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-6e737816-1d4c-41bc-96af-04afabd1c5d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50450ccefa1c4e32b1e81c88f51b5d8d', 'request_id': 'req-6e737816-1d4c-41bc-96af-04afabd1c5d7'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:10.659167 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-6e737816-1d4c-41bc-96af-04afabd1c5d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50450ccefa1c4e32b1e81c88f51b5d8d', 'request_id': 'req-6e737816-1d4c-41bc-96af-04afabd1c5d7'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:10.671759 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-6e737816-1d4c-41bc-96af-04afabd1c5d7 admin admin] The token cache is being invalidate because project 50450ccefa1c4e32b1e81c88f51b5d8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:01:10.672045 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-6e737816-1d4c-41bc-96af-04afabd1c5d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:10.672665 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-6e737816-1d4c-41bc-96af-04afabd1c5d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:10.674211 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1196/2414] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:01:10 2022] DELETE /identity/v3/projects/50450ccefa1c4e32b1e81c88f51b5d8d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:01:10.680031 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e665d-169f-4ac0-979b-23505639210e None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:10.681042 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e665d-169f-4ac0-979b-23505639210e None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:10.681165 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e665d-169f-4ac0-979b-23505639210e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:10.700727 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-768e665d-169f-4ac0-979b-23505639210e None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:01:10.701925 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-768e665d-169f-4ac0-979b-23505639210e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:01:10.759181 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1219/2415] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:01:10.767465 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e75da-4f06-40df-ae8e-c74fdba94e18 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:10.767753 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e75da-4f06-40df-ae8e-c74fdba94e18 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:10.768140 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e75da-4f06-40df-ae8e-c74fdba94e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:10.787646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-772e75da-4f06-40df-ae8e-c74fdba94e18 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:01:10.788836 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-772e75da-4f06-40df-ae8e-c74fdba94e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:01:10.797265 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1197/2416] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:01:10.801479 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e665d-169f-4ac0-979b-23505639210e None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:10.811830 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e665d-169f-4ac0-979b-23505639210e None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:10.816412 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d8c4f-dea5-4710-ae1d-9e5489d922fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:10.816998 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d8c4f-dea5-4710-ae1d-9e5489d922fc admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:10.817272 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d8c4f-dea5-4710-ae1d-9e5489d922fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:10.817577 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d8c4f-dea5-4710-ae1d-9e5489d922fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:10.818216 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d8c4f-dea5-4710-ae1d-9e5489d922fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 11:01:10.818538 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d8c4f-dea5-4710-ae1d-9e5489d922fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:10.820109 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d8c4f-dea5-4710-ae1d-9e5489d922fc admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:10.834948 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1220/2417] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 11:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 11:01:10.836849 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e75da-4f06-40df-ae8e-c74fdba94e18 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:10.846054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e75da-4f06-40df-ae8e-c74fdba94e18 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:10.850645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4caec-9a6f-4b5a-87b9-092f608f8561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:10.851228 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4caec-9a6f-4b5a-87b9-092f608f8561 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:10.851500 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4caec-9a6f-4b5a-87b9-092f608f8561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:10.851768 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4caec-9a6f-4b5a-87b9-092f608f8561 admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:10.853003 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4caec-9a6f-4b5a-87b9-092f608f8561 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:10.854921 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4caec-9a6f-4b5a-87b9-092f608f8561 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:10.880880 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1198/2418] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:01:10 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:01:10.884739 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d8c4f-dea5-4710-ae1d-9e5489d922fc admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:10.895271 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d8c4f-dea5-4710-ae1d-9e5489d922fc admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:10.952464 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0316ffd-1e58-4c84-aed1-80477f4179fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:10.952994 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0316ffd-1e58-4c84-aed1-80477f4179fe admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:10.953270 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0316ffd-1e58-4c84-aed1-80477f4179fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:10.953580 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0316ffd-1e58-4c84-aed1-80477f4179fe admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:10.954210 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0316ffd-1e58-4c84-aed1-80477f4179fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:10.956122 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0316ffd-1e58-4c84-aed1-80477f4179fe admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:10.978882 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1221/2419] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:01:10 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 11:01:10.983334 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4caec-9a6f-4b5a-87b9-092f608f8561 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:10.993605 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4caec-9a6f-4b5a-87b9-092f608f8561 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:10.998112 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc433a-588a-43d6-a00b-ceeabb4c96d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:10.998688 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc433a-588a-43d6-a00b-ceeabb4c96d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:10.998962 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc433a-588a-43d6-a00b-ceeabb4c96d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:10.999228 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc433a-588a-43d6-a00b-ceeabb4c96d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:10.999864 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc433a-588a-43d6-a00b-ceeabb4c96d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:11.001465 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc433a-588a-43d6-a00b-ceeabb4c96d5 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:11.011330 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1199/2420] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:01:11.015391 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0316ffd-1e58-4c84-aed1-80477f4179fe admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:11.025803 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0316ffd-1e58-4c84-aed1-80477f4179fe admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:11.030502 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486818a-d53d-49fc-83ce-ebb3317c743a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:11.031123 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486818a-d53d-49fc-83ce-ebb3317c743a admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:11.031399 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486818a-d53d-49fc-83ce-ebb3317c743a admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:11.031742 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486818a-d53d-49fc-83ce-ebb3317c743a admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:11.032483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486818a-d53d-49fc-83ce-ebb3317c743a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:11.034120 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486818a-d53d-49fc-83ce-ebb3317c743a admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:11.045140 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1222/2421] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:01:11.049282 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc433a-588a-43d6-a00b-ceeabb4c96d5 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:11.059395 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc433a-588a-43d6-a00b-ceeabb4c96d5 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:11.063924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bbcc3-4f91-4e6a-ab30-372ebf6a03de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:11.064549 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bbcc3-4f91-4e6a-ab30-372ebf6a03de admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:11.064823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bbcc3-4f91-4e6a-ab30-372ebf6a03de admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:11.065090 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bbcc3-4f91-4e6a-ab30-372ebf6a03de admin admin] PATH_INFO: `/v3/projects/4e536678626f4b43b4a351f18f57d083/users/6726a6b3ac504b0e881e63667bcf04aa/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:11.079219 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7bbcc3-4f91-4e6a-ab30-372ebf6a03de admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e536678626f4b43b4a351f18f57d083, user_id=6726a6b3ac504b0e881e63667bcf04aa, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:11.081893 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7bbcc3-4f91-4e6a-ab30-372ebf6a03de admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:11.095281 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1200/2422] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:01:11 2022] PUT /identity/v3/projects/4e536678626f4b43b4a351f18f57d083/users/6726a6b3ac504b0e881e63667bcf04aa/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 11:01:11.107051 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08b65f-f606-4d34-9326-3f8a0b94f7f2 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:11.107333 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08b65f-f606-4d34-9326-3f8a0b94f7f2 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:11.107598 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08b65f-f606-4d34-9326-3f8a0b94f7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:11.134519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-5e08b65f-f606-4d34-9326-3f8a0b94f7f2 None None] MFA Rules not processed for user `6726a6b3ac504b0e881e63667bcf04aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:01:11.135722 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-5e08b65f-f606-4d34-9326-3f8a0b94f7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:01:11.173145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:11.213938 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1223/2423] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:01:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:01:11.224874 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bbcc3-4f91-4e6a-ab30-372ebf6a03de admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:11.226660 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-fd7bbcc3-4f91-4e6a-ab30-372ebf6a03de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:01:11.285923 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bbcc3-4f91-4e6a-ab30-372ebf6a03de admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:11.290307 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74a311-c2c1-4b0f-9710-e8eb224fc5cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:11.290909 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74a311-c2c1-4b0f-9710-e8eb224fc5cb service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:11.291184 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74a311-c2c1-4b0f-9710-e8eb224fc5cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:11.291456 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74a311-c2c1-4b0f-9710-e8eb224fc5cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:11.300474 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74a311-c2c1-4b0f-9710-e8eb224fc5cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:11.301838 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74a311-c2c1-4b0f-9710-e8eb224fc5cb service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:11.312165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1201/2424] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:01:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:01:16.674919 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08b65f-f606-4d34-9326-3f8a0b94f7f2 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:16.748317 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08b65f-f606-4d34-9326-3f8a0b94f7f2 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:16.752776 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da53bc-fa29-423b-a76e-69db56a96bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:16.753437 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da53bc-fa29-423b-a76e-69db56a96bae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:16.753718 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da53bc-fa29-423b-a76e-69db56a96bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:16.753989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da53bc-fa29-423b-a76e-69db56a96bae admin admin] PATH_INFO: `/v3/users/6726a6b3ac504b0e881e63667bcf04aa` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:16.755123 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da53bc-fa29-423b-a76e-69db56a96bae admin admin] RBAC: Authorizing `identity:delete_user(user_id=6726a6b3ac504b0e881e63667bcf04aa)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:16.757044 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da53bc-fa29-423b-a76e-69db56a96bae admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:16.806485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d9da53bc-fa29-423b-a76e-69db56a96bae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6726a6b3ac504b0e881e63667bcf04aa'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:16.818491 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d9da53bc-fa29-423b-a76e-69db56a96bae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6726a6b3ac504b0e881e63667bcf04aa'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:16.819259 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d9da53bc-fa29-423b-a76e-69db56a96bae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6726a6b3ac504b0e881e63667bcf04aa'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:16.826198 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d9da53bc-fa29-423b-a76e-69db56a96bae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6726a6b3ac504b0e881e63667bcf04aa'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:16.834950 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d9da53bc-fa29-423b-a76e-69db56a96bae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6726a6b3ac504b0e881e63667bcf04aa'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:16.841734 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1224/2425] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:01:16 2022] DELETE /identity/v3/users/6726a6b3ac504b0e881e63667bcf04aa => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:01:16.846359 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250e78f-657f-4e64-95c8-9c260fb91631 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:16.846824 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250e78f-657f-4e64-95c8-9c260fb91631 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:16.847041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250e78f-657f-4e64-95c8-9c260fb91631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:16.866131 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-a250e78f-657f-4e64-95c8-9c260fb91631 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:01:16.867419 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a250e78f-657f-4e64-95c8-9c260fb91631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:01:16.926307 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1202/2426] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 11:01:16.936374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da53bc-fa29-423b-a76e-69db56a96bae admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:16.938570 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-d9da53bc-fa29-423b-a76e-69db56a96bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:01:17.024806 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da53bc-fa29-423b-a76e-69db56a96bae admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:17.029103 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd4f33-d253-4348-ac20-04b9528ce67d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:17.029866 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd4f33-d253-4348-ac20-04b9528ce67d service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:17.030203 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd4f33-d253-4348-ac20-04b9528ce67d service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:17.030540 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd4f33-d253-4348-ac20-04b9528ce67d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:17.049257 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd4f33-d253-4348-ac20-04b9528ce67d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:17.050809 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd4f33-d253-4348-ac20-04b9528ce67d service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:17.055211 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:17.075947 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1225/2427] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:01:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 11:01:17.380179 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250e78f-657f-4e64-95c8-9c260fb91631 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:17.381889 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a250e78f-657f-4e64-95c8-9c260fb91631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:01:17.395281 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250e78f-657f-4e64-95c8-9c260fb91631 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:17.408406 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09579fcc-5b70-4941-b1d9-a444005ff655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:17.409058 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09579fcc-5b70-4941-b1d9-a444005ff655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:17.409378 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09579fcc-5b70-4941-b1d9-a444005ff655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:17.409659 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09579fcc-5b70-4941-b1d9-a444005ff655 admin admin] PATH_INFO: `/v3/projects/4e536678626f4b43b4a351f18f57d083` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:17.413123 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09579fcc-5b70-4941-b1d9-a444005ff655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e536678626f4b43b4a351f18f57d083)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:17.415999 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09579fcc-5b70-4941-b1d9-a444005ff655 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:17.445446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:17.531144 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-09579fcc-5b70-4941-b1d9-a444005ff655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e536678626f4b43b4a351f18f57d083', 'request_id': 'req-09579fcc-5b70-4941-b1d9-a444005ff655'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:17.542622 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-09579fcc-5b70-4941-b1d9-a444005ff655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e536678626f4b43b4a351f18f57d083', 'request_id': 'req-09579fcc-5b70-4941-b1d9-a444005ff655'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:17.554070 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-09579fcc-5b70-4941-b1d9-a444005ff655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e536678626f4b43b4a351f18f57d083', 'request_id': 'req-09579fcc-5b70-4941-b1d9-a444005ff655'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:17.581816 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-09579fcc-5b70-4941-b1d9-a444005ff655 admin admin] The token cache is being invalidate because project 4e536678626f4b43b4a351f18f57d083 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:01:17.582185 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-09579fcc-5b70-4941-b1d9-a444005ff655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:17.582962 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-09579fcc-5b70-4941-b1d9-a444005ff655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:17.584969 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1203/2428] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:01:17 2022] DELETE /identity/v3/projects/4e536678626f4b43b4a351f18f57d083 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:01:17.591369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca9969-65ef-4c20-9e6f-8cf5489723f8 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:17.591765 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca9969-65ef-4c20-9e6f-8cf5489723f8 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:17.592174 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca9969-65ef-4c20-9e6f-8cf5489723f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:17.620990 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-8aca9969-65ef-4c20-9e6f-8cf5489723f8 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:01:17.622623 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-8aca9969-65ef-4c20-9e6f-8cf5489723f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:01:17.686398 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1226/2429] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 11:01:17.695129 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec6395-17c2-426c-9043-4bfb78ea9e42 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:17.695585 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec6395-17c2-426c-9043-4bfb78ea9e42 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:17.696562 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec6395-17c2-426c-9043-4bfb78ea9e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:17.716576 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-a1ec6395-17c2-426c-9043-4bfb78ea9e42 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:01:17.717969 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a1ec6395-17c2-426c-9043-4bfb78ea9e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:01:17.726383 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1204/2430] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 11:01:17.730790 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca9969-65ef-4c20-9e6f-8cf5489723f8 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:17.740402 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca9969-65ef-4c20-9e6f-8cf5489723f8 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:17.745797 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec51a0-03bc-4d54-bad1-e86e4d733362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:17.746397 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec51a0-03bc-4d54-bad1-e86e4d733362 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:17.746671 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec51a0-03bc-4d54-bad1-e86e4d733362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:17.746939 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec51a0-03bc-4d54-bad1-e86e4d733362 admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:17.747584 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec51a0-03bc-4d54-bad1-e86e4d733362 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 11:01:17.747890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec51a0-03bc-4d54-bad1-e86e4d733362 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:17.749522 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec51a0-03bc-4d54-bad1-e86e4d733362 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:17.761875 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1227/2431] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 11:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 11:01:17.766797 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec6395-17c2-426c-9043-4bfb78ea9e42 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:17.776275 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec6395-17c2-426c-9043-4bfb78ea9e42 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:17.781413 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb9b7b-42fe-4d63-b964-c3952aeac61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:17.782016 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb9b7b-42fe-4d63-b964-c3952aeac61d admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:17.782292 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb9b7b-42fe-4d63-b964-c3952aeac61d admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:17.782561 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb9b7b-42fe-4d63-b964-c3952aeac61d admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:17.783224 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb9b7b-42fe-4d63-b964-c3952aeac61d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:17.785112 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb9b7b-42fe-4d63-b964-c3952aeac61d admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:17.814271 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1205/2432] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:01:17 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:01:17.818512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec51a0-03bc-4d54-bad1-e86e4d733362 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:17.829245 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec51a0-03bc-4d54-bad1-e86e4d733362 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:17.887671 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03156af-c172-4e0e-95c1-9112451a48d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:17.888524 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03156af-c172-4e0e-95c1-9112451a48d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:17.888795 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03156af-c172-4e0e-95c1-9112451a48d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:17.889080 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03156af-c172-4e0e-95c1-9112451a48d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:17.889738 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03156af-c172-4e0e-95c1-9112451a48d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:17.891643 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03156af-c172-4e0e-95c1-9112451a48d6 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:17.912626 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1228/2433] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:01:17 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:01:17.916985 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb9b7b-42fe-4d63-b964-c3952aeac61d admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:17.927677 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb9b7b-42fe-4d63-b964-c3952aeac61d admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:17.932814 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdde271-44bd-474a-b8b1-e5ad6ffbacd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:17.933462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdde271-44bd-474a-b8b1-e5ad6ffbacd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:17.933742 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdde271-44bd-474a-b8b1-e5ad6ffbacd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:17.934011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdde271-44bd-474a-b8b1-e5ad6ffbacd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:17.934674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdde271-44bd-474a-b8b1-e5ad6ffbacd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:17.936276 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdde271-44bd-474a-b8b1-e5ad6ffbacd1 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:17.947903 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1206/2434] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:01:17.951704 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03156af-c172-4e0e-95c1-9112451a48d6 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:17.962433 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03156af-c172-4e0e-95c1-9112451a48d6 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:17.967169 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e3af8-a689-42f0-b600-1e222025f87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:17.967774 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e3af8-a689-42f0-b600-1e222025f87b admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:17.968051 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e3af8-a689-42f0-b600-1e222025f87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:17.968327 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e3af8-a689-42f0-b600-1e222025f87b admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:17.968975 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e3af8-a689-42f0-b600-1e222025f87b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:17.970593 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e3af8-a689-42f0-b600-1e222025f87b admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:17.982458 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1229/2435] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:01:17.986744 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdde271-44bd-474a-b8b1-e5ad6ffbacd1 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:17.997041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdde271-44bd-474a-b8b1-e5ad6ffbacd1 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:18.002126 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c4ef0-b14d-45a7-b733-2a4d3fd9f33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:18.002845 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c4ef0-b14d-45a7-b733-2a4d3fd9f33a admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:18.003256 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c4ef0-b14d-45a7-b733-2a4d3fd9f33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:18.003693 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c4ef0-b14d-45a7-b733-2a4d3fd9f33a admin admin] PATH_INFO: `/v3/projects/22f6cb5d73024933b5a745e69a3b8d35/users/738e352a506148a7a7956259e4200392/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:18.020122 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c4ef0-b14d-45a7-b733-2a4d3fd9f33a admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f6cb5d73024933b5a745e69a3b8d35, user_id=738e352a506148a7a7956259e4200392, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:18.023057 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c4ef0-b14d-45a7-b733-2a4d3fd9f33a admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:18.037449 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1207/2436] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:01:17 2022] PUT /identity/v3/projects/22f6cb5d73024933b5a745e69a3b8d35/users/738e352a506148a7a7956259e4200392/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:01:18.047906 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb18c77-2eaf-4e43-b8b4-2bb5cf713089 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:18.048187 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb18c77-2eaf-4e43-b8b4-2bb5cf713089 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:18.048453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb18c77-2eaf-4e43-b8b4-2bb5cf713089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:18.076559 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-afb18c77-2eaf-4e43-b8b4-2bb5cf713089 None None] MFA Rules not processed for user `738e352a506148a7a7956259e4200392`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:01:18.077842 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-afb18c77-2eaf-4e43-b8b4-2bb5cf713089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:01:18.144028 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:18.157364 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1230/2437] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:01:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:01:18.161840 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c4ef0-b14d-45a7-b733-2a4d3fd9f33a admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:18.242287 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c4ef0-b14d-45a7-b733-2a4d3fd9f33a admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:18.247515 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4475e40-b709-4f2d-bed2-527b6cb4164b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:18.248102 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4475e40-b709-4f2d-bed2-527b6cb4164b admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:18.248375 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4475e40-b709-4f2d-bed2-527b6cb4164b admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:18.248666 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4475e40-b709-4f2d-bed2-527b6cb4164b admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:18.249290 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4475e40-b709-4f2d-bed2-527b6cb4164b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:18.251223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4475e40-b709-4f2d-bed2-527b6cb4164b admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:18.277231 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1208/2438] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:01:18 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:01:18.281555 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb18c77-2eaf-4e43-b8b4-2bb5cf713089 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:18.292789 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb18c77-2eaf-4e43-b8b4-2bb5cf713089 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:18.349121 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0182590-0463-48a3-8cef-e1ea3d683196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:18.349458 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0182590-0463-48a3-8cef-e1ea3d683196 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:18.349739 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0182590-0463-48a3-8cef-e1ea3d683196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:18.350012 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0182590-0463-48a3-8cef-e1ea3d683196 admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:18.350646 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0182590-0463-48a3-8cef-e1ea3d683196 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:18.353277 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0182590-0463-48a3-8cef-e1ea3d683196 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:18.379138 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1231/2439] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:01:18 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 11:01:18.390066 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4475e40-b709-4f2d-bed2-527b6cb4164b admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:18.400830 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4475e40-b709-4f2d-bed2-527b6cb4164b admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:18.405574 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51834e-6ba8-4a58-a42b-0cd0f889527e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:18.406162 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51834e-6ba8-4a58-a42b-0cd0f889527e admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:18.406443 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51834e-6ba8-4a58-a42b-0cd0f889527e admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:18.406714 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51834e-6ba8-4a58-a42b-0cd0f889527e admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:18.407357 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51834e-6ba8-4a58-a42b-0cd0f889527e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:18.408953 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51834e-6ba8-4a58-a42b-0cd0f889527e admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:18.419971 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1209/2440] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:01:18.424422 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0182590-0463-48a3-8cef-e1ea3d683196 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:18.434795 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0182590-0463-48a3-8cef-e1ea3d683196 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:18.439774 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fc399-e0cf-4f75-971b-5602c4f7e9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:18.440543 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fc399-e0cf-4f75-971b-5602c4f7e9e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:18.440962 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fc399-e0cf-4f75-971b-5602c4f7e9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:18.441303 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fc399-e0cf-4f75-971b-5602c4f7e9e5 admin admin] PATH_INFO: `/v3/projects/0fbdd865e79344a89e3415deccf45f2d/users/bb6225b2609447e08187d443267d211f/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:18.458670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fc399-e0cf-4f75-971b-5602c4f7e9e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fbdd865e79344a89e3415deccf45f2d, user_id=bb6225b2609447e08187d443267d211f, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:18.463552 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fc399-e0cf-4f75-971b-5602c4f7e9e5 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:18.479364 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1232/2441] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:01:18 2022] PUT /identity/v3/projects/0fbdd865e79344a89e3415deccf45f2d/users/bb6225b2609447e08187d443267d211f/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 11:01:18.483402 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51834e-6ba8-4a58-a42b-0cd0f889527e admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:18.494275 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51834e-6ba8-4a58-a42b-0cd0f889527e admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:18.499105 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:18.556056 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81383dd0-0ba8-4f90-8c0d-bdd63f84782f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:18.556663 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81383dd0-0ba8-4f90-8c0d-bdd63f84782f admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:18.556944 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81383dd0-0ba8-4f90-8c0d-bdd63f84782f admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:18.557248 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81383dd0-0ba8-4f90-8c0d-bdd63f84782f admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:18.557964 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81383dd0-0ba8-4f90-8c0d-bdd63f84782f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:18.559590 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81383dd0-0ba8-4f90-8c0d-bdd63f84782f admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:18.569357 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1210/2442] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:01:18.574198 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fc399-e0cf-4f75-971b-5602c4f7e9e5 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:18.584892 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fc399-e0cf-4f75-971b-5602c4f7e9e5 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:18.590443 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02dae7-1023-47ea-b823-3c7616224f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:18.591185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02dae7-1023-47ea-b823-3c7616224f83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:18.591361 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02dae7-1023-47ea-b823-3c7616224f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:18.591633 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02dae7-1023-47ea-b823-3c7616224f83 admin admin] PATH_INFO: `/v3/projects/0fbdd865e79344a89e3415deccf45f2d/users/bb6225b2609447e08187d443267d211f/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:18.593603 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd02dae7-1023-47ea-b823-3c7616224f83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fbdd865e79344a89e3415deccf45f2d, user_id=bb6225b2609447e08187d443267d211f, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:18.596328 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd02dae7-1023-47ea-b823-3c7616224f83 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:18.609156 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1233/2443] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:01:18 2022] PUT /identity/v3/projects/0fbdd865e79344a89e3415deccf45f2d/users/bb6225b2609447e08187d443267d211f/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:01:18.675500 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf482d-5ded-4704-b230-96207be0e1bc None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:18.675749 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf482d-5ded-4704-b230-96207be0e1bc None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:18.676027 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf482d-5ded-4704-b230-96207be0e1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:18.704316 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-a6cf482d-5ded-4704-b230-96207be0e1bc None None] MFA Rules not processed for user `bb6225b2609447e08187d443267d211f`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:01:18.705612 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a6cf482d-5ded-4704-b230-96207be0e1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:01:18.785352 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1211/2444] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:01:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:01:18.793989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02dae7-1023-47ea-b823-3c7616224f83 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:18.795733 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-dd02dae7-1023-47ea-b823-3c7616224f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:01:18.859244 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02dae7-1023-47ea-b823-3c7616224f83 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:18.863153 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6ab6e-588d-44d6-89d8-435e217e5ece service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:18.863988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6ab6e-588d-44d6-89d8-435e217e5ece service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:18.864294 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6ab6e-588d-44d6-89d8-435e217e5ece service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:18.864603 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6ab6e-588d-44d6-89d8-435e217e5ece service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:18.923410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6ab6e-588d-44d6-89d8-435e217e5ece service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:18.924787 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6ab6e-588d-44d6-89d8-435e217e5ece service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:18.929448 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:18.935781 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1234/2445] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:01:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:01:20.532066 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530f9f1-958c-4ff2-9edd-2f29753e5024 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:20.532605 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530f9f1-958c-4ff2-9edd-2f29753e5024 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:20.532605 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530f9f1-958c-4ff2-9edd-2f29753e5024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:20.553228 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-3530f9f1-958c-4ff2-9edd-2f29753e5024 None None] MFA Rules not processed for user `cba1a3bf0e1f49e885e4c833549be406`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:01:20.554481 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-3530f9f1-958c-4ff2-9edd-2f29753e5024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:01:20.610252 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1212/2446] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:01:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 11:01:21.512385 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6ab6e-588d-44d6-89d8-435e217e5ece service cinder] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:21.577788 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6ab6e-588d-44d6-89d8-435e217e5ece service cinder] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:21.582398 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd55048-5855-4331-9c68-351583964a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:21.583017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd55048-5855-4331-9c68-351583964a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:21.583296 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd55048-5855-4331-9c68-351583964a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:21.583565 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd55048-5855-4331-9c68-351583964a1b admin admin] PATH_INFO: `/v3/users/738e352a506148a7a7956259e4200392` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:21.584682 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd55048-5855-4331-9c68-351583964a1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=738e352a506148a7a7956259e4200392)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:21.587107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd55048-5855-4331-9c68-351583964a1b admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:21.634438 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-5fd55048-5855-4331-9c68-351583964a1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '738e352a506148a7a7956259e4200392'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:21.648173 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-5fd55048-5855-4331-9c68-351583964a1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '738e352a506148a7a7956259e4200392'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:21.649438 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-5fd55048-5855-4331-9c68-351583964a1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '738e352a506148a7a7956259e4200392'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:21.656176 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-5fd55048-5855-4331-9c68-351583964a1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '738e352a506148a7a7956259e4200392'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:21.663670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-5fd55048-5855-4331-9c68-351583964a1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '738e352a506148a7a7956259e4200392'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:21.671410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1235/2447] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:01:21 2022] DELETE /identity/v3/users/738e352a506148a7a7956259e4200392 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:01:21.675911 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6491f2-b540-4917-9a40-27ad71270a77 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:21.676427 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6491f2-b540-4917-9a40-27ad71270a77 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:21.676427 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6491f2-b540-4917-9a40-27ad71270a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:21.695052 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-3d6491f2-b540-4917-9a40-27ad71270a77 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:01:21.696747 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-3d6491f2-b540-4917-9a40-27ad71270a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:01:21.728270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:21.757169 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1213/2448] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:01:21.767786 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd55048-5855-4331-9c68-351583964a1b admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:21.769194 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-5fd55048-5855-4331-9c68-351583964a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:01:21.827751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd55048-5855-4331-9c68-351583964a1b admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:21.831516 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062d15c-6698-49cf-a2c0-19d360f07111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:21.832212 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062d15c-6698-49cf-a2c0-19d360f07111 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:21.832474 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062d15c-6698-49cf-a2c0-19d360f07111 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:21.832772 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062d15c-6698-49cf-a2c0-19d360f07111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:21.843101 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b062d15c-6698-49cf-a2c0-19d360f07111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:21.844525 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b062d15c-6698-49cf-a2c0-19d360f07111 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:21.853987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1236/2449] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:01:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 11:01:22.494651 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6491f2-b540-4917-9a40-27ad71270a77 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:22.497992 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-3d6491f2-b540-4917-9a40-27ad71270a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:01:22.513891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6491f2-b540-4917-9a40-27ad71270a77 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:22.519094 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6337ae-b5cf-4d22-9732-2b429a03e2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:22.519720 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6337ae-b5cf-4d22-9732-2b429a03e2e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:22.519994 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6337ae-b5cf-4d22-9732-2b429a03e2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:22.520268 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6337ae-b5cf-4d22-9732-2b429a03e2e7 admin admin] PATH_INFO: `/v3/projects/22f6cb5d73024933b5a745e69a3b8d35` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:22.521433 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6337ae-b5cf-4d22-9732-2b429a03e2e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22f6cb5d73024933b5a745e69a3b8d35)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:22.523651 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6337ae-b5cf-4d22-9732-2b429a03e2e7 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:22.575345 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-3e6337ae-b5cf-4d22-9732-2b429a03e2e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22f6cb5d73024933b5a745e69a3b8d35', 'request_id': 'req-3e6337ae-b5cf-4d22-9732-2b429a03e2e7'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:22.581683 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-3e6337ae-b5cf-4d22-9732-2b429a03e2e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22f6cb5d73024933b5a745e69a3b8d35', 'request_id': 'req-3e6337ae-b5cf-4d22-9732-2b429a03e2e7'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:22.588884 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-3e6337ae-b5cf-4d22-9732-2b429a03e2e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22f6cb5d73024933b5a745e69a3b8d35', 'request_id': 'req-3e6337ae-b5cf-4d22-9732-2b429a03e2e7'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:22.603901 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-3e6337ae-b5cf-4d22-9732-2b429a03e2e7 admin admin] The token cache is being invalidate because project 22f6cb5d73024933b5a745e69a3b8d35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:01:22.604194 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-3e6337ae-b5cf-4d22-9732-2b429a03e2e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:22.604831 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-3e6337ae-b5cf-4d22-9732-2b429a03e2e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:22.606387 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1214/2450] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:01:22 2022] DELETE /identity/v3/projects/22f6cb5d73024933b5a745e69a3b8d35 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:01:22.610409 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062d15c-6698-49cf-a2c0-19d360f07111 service neutron] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:22.623182 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062d15c-6698-49cf-a2c0-19d360f07111 service neutron] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:22.645971 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:22.699085 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd1d52-2b42-402b-90e1-5bc716ddf843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:22.699767 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd1d52-2b42-402b-90e1-5bc716ddf843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:22.700051 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd1d52-2b42-402b-90e1-5bc716ddf843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:22.700325 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd1d52-2b42-402b-90e1-5bc716ddf843 admin admin] PATH_INFO: `/v3/users/bb6225b2609447e08187d443267d211f` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:22.701589 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd1d52-2b42-402b-90e1-5bc716ddf843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb6225b2609447e08187d443267d211f)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:22.703571 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd1d52-2b42-402b-90e1-5bc716ddf843 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:22.753947 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-24cd1d52-2b42-402b-90e1-5bc716ddf843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb6225b2609447e08187d443267d211f'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:22.767236 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-24cd1d52-2b42-402b-90e1-5bc716ddf843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb6225b2609447e08187d443267d211f'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:22.767956 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-24cd1d52-2b42-402b-90e1-5bc716ddf843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb6225b2609447e08187d443267d211f'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:22.774905 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-24cd1d52-2b42-402b-90e1-5bc716ddf843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb6225b2609447e08187d443267d211f'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:22.783765 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-24cd1d52-2b42-402b-90e1-5bc716ddf843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb6225b2609447e08187d443267d211f'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:22.790413 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1237/2451] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:01:22 2022] DELETE /identity/v3/users/bb6225b2609447e08187d443267d211f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 11:01:23.063912 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6337ae-b5cf-4d22-9732-2b429a03e2e7 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:01:23.065582 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-3e6337ae-b5cf-4d22-9732-2b429a03e2e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:01:23.084639 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6337ae-b5cf-4d22-9732-2b429a03e2e7 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:01:23.160447 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041b205-e020-467d-8881-5b8215888f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:01:23.161133 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041b205-e020-467d-8881-5b8215888f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:01:23.161498 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041b205-e020-467d-8881-5b8215888f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:01:23.161717 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041b205-e020-467d-8881-5b8215888f13 admin admin] PATH_INFO: `/v3/projects/0fbdd865e79344a89e3415deccf45f2d` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:01:23.162885 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041b205-e020-467d-8881-5b8215888f13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fbdd865e79344a89e3415deccf45f2d)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:01:23.165508 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041b205-e020-467d-8881-5b8215888f13 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:01:23.222722 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-6041b205-e020-467d-8881-5b8215888f13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fbdd865e79344a89e3415deccf45f2d', 'request_id': 'req-6041b205-e020-467d-8881-5b8215888f13'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:23.229217 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-6041b205-e020-467d-8881-5b8215888f13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fbdd865e79344a89e3415deccf45f2d', 'request_id': 'req-6041b205-e020-467d-8881-5b8215888f13'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:23.233085 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:23.237491 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-6041b205-e020-467d-8881-5b8215888f13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fbdd865e79344a89e3415deccf45f2d', 'request_id': 'req-6041b205-e020-467d-8881-5b8215888f13'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:23.253346 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-6041b205-e020-467d-8881-5b8215888f13 admin admin] The token cache is being invalidate because project 0fbdd865e79344a89e3415deccf45f2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:01:23.254069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-6041b205-e020-467d-8881-5b8215888f13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:23.254740 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-6041b205-e020-467d-8881-5b8215888f13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:01:23.257407 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1215/2452] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:01:23 2022] DELETE /identity/v3/projects/0fbdd865e79344a89e3415deccf45f2d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 11:01:32.786298 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=43,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:01:33.249443 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=3,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:02:42.072265 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd1d52-2b42-402b-90e1-5bc716ddf843 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:02:42.073815 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-24cd1d52-2b42-402b-90e1-5bc716ddf843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:02:42.262345 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd1d52-2b42-402b-90e1-5bc716ddf843 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:02:42.333994 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a8006-5418-4b85-a23d-36a2c430d3c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b33f797a9af946a4b296d973388891be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:02:42.334824 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a8006-5418-4b85-a23d-36a2c430d3c3 service placement] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:02:42.335176 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a8006-5418-4b85-a23d-36a2c430d3c3 service placement] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:02:42.335521 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a8006-5418-4b85-a23d-36a2c430d3c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:02:42.339629 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-246a8006-5418-4b85-a23d-36a2c430d3c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:02:42.369053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a8006-5418-4b85-a23d-36a2c430d3c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:02:42.369053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a8006-5418-4b85-a23d-36a2c430d3c3 service placement] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:02:42.376431 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1238/2453] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:02:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:02:47.551174 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041b205-e020-467d-8881-5b8215888f13 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:02:47.552564 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-6041b205-e020-467d-8881-5b8215888f13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:02:47.632047 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041b205-e020-467d-8881-5b8215888f13 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:02:47.635664 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f8a36-c350-4224-af97-915230b5c201 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:02:47.636256 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f8a36-c350-4224-af97-915230b5c201 service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:02:47.636526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f8a36-c350-4224-af97-915230b5c201 service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:02:47.636790 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f8a36-c350-4224-af97-915230b5c201 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:02:47.638550 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-877f8a36-c350-4224-af97-915230b5c201 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:02:47.721657 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f8a36-c350-4224-af97-915230b5c201 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:02:47.723084 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f8a36-c350-4224-af97-915230b5c201 service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:02:47.741335 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1216/2454] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:02:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:02:50.940171 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a8006-5418-4b85-a23d-36a2c430d3c3 service placement] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:02:50.941870 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-246a8006-5418-4b85-a23d-36a2c430d3c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:02:50.965160 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a8006-5418-4b85-a23d-36a2c430d3c3 service placement] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:02:50.972877 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ae6cc-7353-498f-bb10-6b5fa4427255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:02:50.973778 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ae6cc-7353-498f-bb10-6b5fa4427255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:02:50.974065 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ae6cc-7353-498f-bb10-6b5fa4427255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:02:50.974333 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ae6cc-7353-498f-bb10-6b5fa4427255 admin admin] PATH_INFO: `/v3/users/2f9976b79f2840bf90eeba66eb999e6c` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:02:50.975491 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ae6cc-7353-498f-bb10-6b5fa4427255 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f9976b79f2840bf90eeba66eb999e6c)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:02:50.977440 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ae6cc-7353-498f-bb10-6b5fa4427255 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:02:51.003654 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:02:51.054500 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d82ae6cc-7353-498f-bb10-6b5fa4427255 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f9976b79f2840bf90eeba66eb999e6c'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:02:51.072155 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d82ae6cc-7353-498f-bb10-6b5fa4427255 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f9976b79f2840bf90eeba66eb999e6c'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:02:51.073002 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d82ae6cc-7353-498f-bb10-6b5fa4427255 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f9976b79f2840bf90eeba66eb999e6c'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:02:51.081647 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d82ae6cc-7353-498f-bb10-6b5fa4427255 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f9976b79f2840bf90eeba66eb999e6c'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:02:51.089913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d82ae6cc-7353-498f-bb10-6b5fa4427255 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f9976b79f2840bf90eeba66eb999e6c'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:02:51.100818 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1239/2455] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:02:50 2022] DELETE /identity/v3/users/2f9976b79f2840bf90eeba66eb999e6c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:02:51.281972 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f8a36-c350-4224-af97-915230b5c201 service neutron] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:02:51.292385 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f8a36-c350-4224-af97-915230b5c201 service neutron] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:02:51.354170 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:02:51.359605 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8b397-0dba-432d-b871-70d27131f366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:02:51.360245 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8b397-0dba-432d-b871-70d27131f366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:02:51.360686 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8b397-0dba-432d-b871-70d27131f366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:02:51.361184 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8b397-0dba-432d-b871-70d27131f366 admin admin] PATH_INFO: `/v3/projects/438ecc4193654d05a9296157b3f63dec` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:02:51.362819 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed8b397-0dba-432d-b871-70d27131f366 admin admin] RBAC: Authorizing `identity:delete_project(project_id=438ecc4193654d05a9296157b3f63dec)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:02:51.364870 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed8b397-0dba-432d-b871-70d27131f366 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:02:51.417557 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0ed8b397-0dba-432d-b871-70d27131f366 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '438ecc4193654d05a9296157b3f63dec', 'request_id': 'req-0ed8b397-0dba-432d-b871-70d27131f366'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:02:51.423117 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0ed8b397-0dba-432d-b871-70d27131f366 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '438ecc4193654d05a9296157b3f63dec', 'request_id': 'req-0ed8b397-0dba-432d-b871-70d27131f366'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:02:51.429235 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0ed8b397-0dba-432d-b871-70d27131f366 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '438ecc4193654d05a9296157b3f63dec', 'request_id': 'req-0ed8b397-0dba-432d-b871-70d27131f366'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:02:51.442026 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0ed8b397-0dba-432d-b871-70d27131f366 admin admin] The token cache is being invalidate because project 438ecc4193654d05a9296157b3f63dec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:02:51.442264 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0ed8b397-0dba-432d-b871-70d27131f366 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:02:51.442883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0ed8b397-0dba-432d-b871-70d27131f366 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:02:51.444363 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1217/2456] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:02:51 2022] DELETE /identity/v3/projects/438ecc4193654d05a9296157b3f63dec => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:02:51.449348 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1421b0-194f-4a49-97e6-f5ff4fdeb8b9 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:02:51.449678 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1421b0-194f-4a49-97e6-f5ff4fdeb8b9 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:02:51.449956 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1421b0-194f-4a49-97e6-f5ff4fdeb8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:02:51.508276 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-7f1421b0-194f-4a49-97e6-f5ff4fdeb8b9 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:02:51.509527 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-7f1421b0-194f-4a49-97e6-f5ff4fdeb8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:02:51.572742 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1240/2457] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 11:02:51.581096 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110a295-454f-48f2-bf5b-6d4c75e9f602 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:02:51.581408 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110a295-454f-48f2-bf5b-6d4c75e9f602 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:02:51.581683 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110a295-454f-48f2-bf5b-6d4c75e9f602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:02:51.601825 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-a110a295-454f-48f2-bf5b-6d4c75e9f602 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:02:51.603094 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a110a295-454f-48f2-bf5b-6d4c75e9f602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:02:51.611648 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1218/2458] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:02:51.615991 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1421b0-194f-4a49-97e6-f5ff4fdeb8b9 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:02:51.626316 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1421b0-194f-4a49-97e6-f5ff4fdeb8b9 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:02:51.630996 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1649ca-a10e-4e58-8b23-e0027bfa18da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:02:51.631595 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1649ca-a10e-4e58-8b23-e0027bfa18da admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:02:51.631874 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1649ca-a10e-4e58-8b23-e0027bfa18da admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:02:51.632145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1649ca-a10e-4e58-8b23-e0027bfa18da admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:02:51.632793 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1649ca-a10e-4e58-8b23-e0027bfa18da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 11:02:51.633095 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1649ca-a10e-4e58-8b23-e0027bfa18da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:02:51.634768 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1649ca-a10e-4e58-8b23-e0027bfa18da admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:02:51.646610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1241/2459] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 11:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 11:02:51.650879 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110a295-454f-48f2-bf5b-6d4c75e9f602 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:02:51.660583 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110a295-454f-48f2-bf5b-6d4c75e9f602 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:02:51.665956 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83ee68-ede1-4776-89ba-9ccd033822ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:02:51.666571 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83ee68-ede1-4776-89ba-9ccd033822ba admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:02:51.666847 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83ee68-ede1-4776-89ba-9ccd033822ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:02:51.667146 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83ee68-ede1-4776-89ba-9ccd033822ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:02:51.667778 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83ee68-ede1-4776-89ba-9ccd033822ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:02:51.669754 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83ee68-ede1-4776-89ba-9ccd033822ba admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:02:51.704221 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1219/2460] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:02:51 2022] POST /identity/v3/projects => generated 355 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:02:51.708538 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1649ca-a10e-4e58-8b23-e0027bfa18da admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:02:51.718567 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1649ca-a10e-4e58-8b23-e0027bfa18da admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:02:51.766208 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:02:51.776585 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862493a-d503-41f3-8dc2-c8ecf8ab74ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:02:51.777206 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862493a-d503-41f3-8dc2-c8ecf8ab74ef admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:02:51.777524 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862493a-d503-41f3-8dc2-c8ecf8ab74ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:02:51.777798 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862493a-d503-41f3-8dc2-c8ecf8ab74ef admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:02:51.778424 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862493a-d503-41f3-8dc2-c8ecf8ab74ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:02:51.780347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862493a-d503-41f3-8dc2-c8ecf8ab74ef admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:02:51.801770 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1242/2461] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:02:51 2022] POST /identity/v3/users => generated 278 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 11:02:51.806364 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83ee68-ede1-4776-89ba-9ccd033822ba admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:02:51.817089 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83ee68-ede1-4776-89ba-9ccd033822ba admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:02:51.821625 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db279f-c0e4-423e-900c-febc92c8c26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:02:51.822203 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db279f-c0e4-423e-900c-febc92c8c26c admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:02:51.822475 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db279f-c0e4-423e-900c-febc92c8c26c admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:02:51.822734 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db279f-c0e4-423e-900c-febc92c8c26c admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:02:51.823394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db279f-c0e4-423e-900c-febc92c8c26c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:02:51.824954 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db279f-c0e4-423e-900c-febc92c8c26c admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:02:51.834604 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1220/2462] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:02:51.838452 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862493a-d503-41f3-8dc2-c8ecf8ab74ef admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:02:51.848415 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862493a-d503-41f3-8dc2-c8ecf8ab74ef admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:02:51.853126 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7305a8a-3901-484b-b510-5baa0792c627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:02:51.853751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7305a8a-3901-484b-b510-5baa0792c627 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:02:51.854029 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7305a8a-3901-484b-b510-5baa0792c627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:02:51.854718 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7305a8a-3901-484b-b510-5baa0792c627 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:02:51.854934 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7305a8a-3901-484b-b510-5baa0792c627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:02:51.856584 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7305a8a-3901-484b-b510-5baa0792c627 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:02:51.868329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1243/2463] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:02:51.872786 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db279f-c0e4-423e-900c-febc92c8c26c admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:02:51.883473 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db279f-c0e4-423e-900c-febc92c8c26c admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:02:51.888285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4558f-0a98-4fe8-b00b-c1aefa92a672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:02:51.888929 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4558f-0a98-4fe8-b00b-c1aefa92a672 admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:02:51.889205 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4558f-0a98-4fe8-b00b-c1aefa92a672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:02:51.889509 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4558f-0a98-4fe8-b00b-c1aefa92a672 admin admin] PATH_INFO: `/v3/projects/84abe4bbe0694e3da9104a0d735f4b6e/users/67d950b9d94643d3a88aa6242052ec36/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:02:51.904846 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4558f-0a98-4fe8-b00b-c1aefa92a672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84abe4bbe0694e3da9104a0d735f4b6e, user_id=67d950b9d94643d3a88aa6242052ec36, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:02:51.907694 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4558f-0a98-4fe8-b00b-c1aefa92a672 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:02:51.920221 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1221/2464] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:02:51 2022] PUT /identity/v3/projects/84abe4bbe0694e3da9104a0d735f4b6e/users/67d950b9d94643d3a88aa6242052ec36/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:02:51.931833 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78060d5-8627-4c90-adf4-fdfda06f50f6 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:02:51.932172 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78060d5-8627-4c90-adf4-fdfda06f50f6 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:02:51.932438 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78060d5-8627-4c90-adf4-fdfda06f50f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:02:51.960575 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-c78060d5-8627-4c90-adf4-fdfda06f50f6 None None] MFA Rules not processed for user `67d950b9d94643d3a88aa6242052ec36`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:02:51.961823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-c78060d5-8627-4c90-adf4-fdfda06f50f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:02:52.028295 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1244/2465] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:02:51 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:02:52.032921 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4558f-0a98-4fe8-b00b-c1aefa92a672 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:02:52.093296 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4558f-0a98-4fe8-b00b-c1aefa92a672 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:02:52.097842 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551342bb-5cb4-4954-be3b-569cfc03119e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:02:52.098425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551342bb-5cb4-4954-be3b-569cfc03119e admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:02:52.098702 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551342bb-5cb4-4954-be3b-569cfc03119e admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:02:52.098967 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551342bb-5cb4-4954-be3b-569cfc03119e admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:02:52.099589 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551342bb-5cb4-4954-be3b-569cfc03119e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:02:52.101479 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551342bb-5cb4-4954-be3b-569cfc03119e admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:02:52.131394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1222/2466] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:02:52 2022] POST /identity/v3/projects => generated 355 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 11:02:52.136160 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78060d5-8627-4c90-adf4-fdfda06f50f6 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:02:52.148384 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78060d5-8627-4c90-adf4-fdfda06f50f6 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:02:52.204057 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbe3d7-c86f-411a-b113-e916ae6a4e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:02:52.204650 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbe3d7-c86f-411a-b113-e916ae6a4e72 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:02:52.204923 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbe3d7-c86f-411a-b113-e916ae6a4e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:02:52.205189 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbe3d7-c86f-411a-b113-e916ae6a4e72 admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:02:52.205840 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbe3d7-c86f-411a-b113-e916ae6a4e72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:02:52.207969 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbe3d7-c86f-411a-b113-e916ae6a4e72 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:02:52.229802 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1245/2467] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:02:52 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 11:02:52.233773 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551342bb-5cb4-4954-be3b-569cfc03119e admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:02:52.244068 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551342bb-5cb4-4954-be3b-569cfc03119e admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:02:52.249054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319aff4d-69cb-435a-ab19-be73f26f441e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:02:52.250214 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319aff4d-69cb-435a-ab19-be73f26f441e admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:02:52.250497 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319aff4d-69cb-435a-ab19-be73f26f441e admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:02:52.250802 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319aff4d-69cb-435a-ab19-be73f26f441e admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:02:52.251451 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319aff4d-69cb-435a-ab19-be73f26f441e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:02:52.253141 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319aff4d-69cb-435a-ab19-be73f26f441e admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:02:52.255466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:02:52.268592 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1223/2468] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:02:52.272751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbe3d7-c86f-411a-b113-e916ae6a4e72 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:02:52.283044 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbe3d7-c86f-411a-b113-e916ae6a4e72 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:02:52.287682 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354ff5c-eaa5-4519-a378-4050a85fe3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:02:52.288324 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354ff5c-eaa5-4519-a378-4050a85fe3e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:02:52.288629 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354ff5c-eaa5-4519-a378-4050a85fe3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:02:52.288900 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354ff5c-eaa5-4519-a378-4050a85fe3e3 admin admin] PATH_INFO: `/v3/projects/15e7faf1f1f1487286bc33a8d4f8c48c/users/4d2d28c070fa43118701f0a9a849dc18/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:02:52.304104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354ff5c-eaa5-4519-a378-4050a85fe3e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15e7faf1f1f1487286bc33a8d4f8c48c, user_id=4d2d28c070fa43118701f0a9a849dc18, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:02:52.306824 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354ff5c-eaa5-4519-a378-4050a85fe3e3 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:02:52.321720 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1246/2469] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:02:52 2022] PUT /identity/v3/projects/15e7faf1f1f1487286bc33a8d4f8c48c/users/4d2d28c070fa43118701f0a9a849dc18/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:02:52.325791 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319aff4d-69cb-435a-ab19-be73f26f441e admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:02:52.336409 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319aff4d-69cb-435a-ab19-be73f26f441e admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:02:52.400056 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0dcd5b-768d-4276-8999-e3a16ae108b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:02:52.400661 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dcd5b-768d-4276-8999-e3a16ae108b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:02:52.400962 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dcd5b-768d-4276-8999-e3a16ae108b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:02:52.401198 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dcd5b-768d-4276-8999-e3a16ae108b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:02:52.401902 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0dcd5b-768d-4276-8999-e3a16ae108b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:02:52.403506 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0dcd5b-768d-4276-8999-e3a16ae108b8 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:02:52.413139 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1224/2470] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 11:02:52.417463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354ff5c-eaa5-4519-a378-4050a85fe3e3 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:02:52.428110 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354ff5c-eaa5-4519-a378-4050a85fe3e3 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:02:52.432674 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3d62e-c401-4d32-aac3-2ad86c6bb6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:02:52.433303 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3d62e-c401-4d32-aac3-2ad86c6bb6c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:02:52.433606 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3d62e-c401-4d32-aac3-2ad86c6bb6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:02:52.433872 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3d62e-c401-4d32-aac3-2ad86c6bb6c3 admin admin] PATH_INFO: `/v3/projects/15e7faf1f1f1487286bc33a8d4f8c48c/users/4d2d28c070fa43118701f0a9a849dc18/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:02:52.435754 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3d62e-c401-4d32-aac3-2ad86c6bb6c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15e7faf1f1f1487286bc33a8d4f8c48c, user_id=4d2d28c070fa43118701f0a9a849dc18, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:02:52.439115 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3d62e-c401-4d32-aac3-2ad86c6bb6c3 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:02:52.449852 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1247/2471] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:02:52 2022] PUT /identity/v3/projects/15e7faf1f1f1487286bc33a8d4f8c48c/users/4d2d28c070fa43118701f0a9a849dc18/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:02:52.459955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf89d4c-65ff-4b4f-b81b-14b191476a67 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:02:52.460235 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf89d4c-65ff-4b4f-b81b-14b191476a67 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:02:52.460501 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf89d4c-65ff-4b4f-b81b-14b191476a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:02:52.487541 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-5bf89d4c-65ff-4b4f-b81b-14b191476a67 None None] MFA Rules not processed for user `4d2d28c070fa43118701f0a9a849dc18`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:02:52.488674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-5bf89d4c-65ff-4b4f-b81b-14b191476a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:02:52.555031 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1225/2472] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:02:52 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:02:52.566769 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3d62e-c401-4d32-aac3-2ad86c6bb6c3 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:02:52.568458 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-13d3d62e-c401-4d32-aac3-2ad86c6bb6c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:02:52.586314 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:02:52.647568 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3d62e-c401-4d32-aac3-2ad86c6bb6c3 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:02:52.651242 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c36f3-8cee-4650-9496-567a2f36eb73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:02:52.651839 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c36f3-8cee-4650-9496-567a2f36eb73 service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:02:52.652111 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c36f3-8cee-4650-9496-567a2f36eb73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:02:52.652375 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c36f3-8cee-4650-9496-567a2f36eb73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:02:52.661479 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c36f3-8cee-4650-9496-567a2f36eb73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:02:52.663052 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c36f3-8cee-4650-9496-567a2f36eb73 service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:02:52.673080 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1248/2473] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:02:52 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:02:52.748711 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf89d4c-65ff-4b4f-b81b-14b191476a67 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:02:52.758180 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf89d4c-65ff-4b4f-b81b-14b191476a67 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:02:52.761899 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d781d44-50c4-43c8-b037-2f992a96e746 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:02:52.762487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d781d44-50c4-43c8-b037-2f992a96e746 service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:02:52.763238 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d781d44-50c4-43c8-b037-2f992a96e746 service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:02:52.763238 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d781d44-50c4-43c8-b037-2f992a96e746 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:02:52.825424 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d781d44-50c4-43c8-b037-2f992a96e746 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:02:52.826884 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d781d44-50c4-43c8-b037-2f992a96e746 service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:02:52.835847 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1226/2474] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:02:52 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:03:02.668361 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=29 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:02.831817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=92 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:02.835116 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c36f3-8cee-4650-9496-567a2f36eb73 service cinder] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:02.836528 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-0c6c36f3-8cee-4650-9496-567a2f36eb73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:02.896455 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c36f3-8cee-4650-9496-567a2f36eb73 service cinder] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:02.900145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a2bf6-2757-45a8-96e0-578d0308dd00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:02.900740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a2bf6-2757-45a8-96e0-578d0308dd00 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:02.901014 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a2bf6-2757-45a8-96e0-578d0308dd00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:02.901294 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a2bf6-2757-45a8-96e0-578d0308dd00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:02.903018 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-ea9a2bf6-2757-45a8-96e0-578d0308dd00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:02.967149 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a2bf6-2757-45a8-96e0-578d0308dd00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:02.969122 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a2bf6-2757-45a8-96e0-578d0308dd00 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:02.979133 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1249/2475] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:03:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 11:03:05.862615 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d781d44-50c4-43c8-b037-2f992a96e746 service cinder] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:05.864073 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-5d781d44-50c4-43c8-b037-2f992a96e746 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:05.878686 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d781d44-50c4-43c8-b037-2f992a96e746 service cinder] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:05.882967 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91988052-3bfb-49a8-bd2f-0f049844ed26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:05.883582 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91988052-3bfb-49a8-bd2f-0f049844ed26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:05.883854 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91988052-3bfb-49a8-bd2f-0f049844ed26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:05.884122 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91988052-3bfb-49a8-bd2f-0f049844ed26 admin admin] PATH_INFO: `/v3/users/cba1a3bf0e1f49e885e4c833549be406` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:05.885226 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91988052-3bfb-49a8-bd2f-0f049844ed26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cba1a3bf0e1f49e885e4c833549be406)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:05.888515 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91988052-3bfb-49a8-bd2f-0f049844ed26 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:05.932755 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-91988052-3bfb-49a8-bd2f-0f049844ed26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cba1a3bf0e1f49e885e4c833549be406'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:05.946559 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-91988052-3bfb-49a8-bd2f-0f049844ed26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cba1a3bf0e1f49e885e4c833549be406'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:05.947283 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-91988052-3bfb-49a8-bd2f-0f049844ed26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cba1a3bf0e1f49e885e4c833549be406'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:05.954763 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-91988052-3bfb-49a8-bd2f-0f049844ed26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cba1a3bf0e1f49e885e4c833549be406'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:05.962677 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-91988052-3bfb-49a8-bd2f-0f049844ed26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cba1a3bf0e1f49e885e4c833549be406'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:05.973166 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1227/2476] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:03:05 2022] DELETE /identity/v3/users/cba1a3bf0e1f49e885e4c833549be406 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:06.165664 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a2bf6-2757-45a8-96e0-578d0308dd00 service neutron] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:06.177636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a2bf6-2757-45a8-96e0-578d0308dd00 service neutron] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:06.239507 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987abd93-61f8-47d6-8a6b-2cd70a457a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:06.240091 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987abd93-61f8-47d6-8a6b-2cd70a457a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:06.240363 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987abd93-61f8-47d6-8a6b-2cd70a457a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:06.240630 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987abd93-61f8-47d6-8a6b-2cd70a457a3d admin admin] PATH_INFO: `/v3/projects/c1d2fff06d694d3ca4b3692199fa9f78` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:06.241767 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987abd93-61f8-47d6-8a6b-2cd70a457a3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1d2fff06d694d3ca4b3692199fa9f78)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:06.243623 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987abd93-61f8-47d6-8a6b-2cd70a457a3d admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:06.292682 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-987abd93-61f8-47d6-8a6b-2cd70a457a3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1d2fff06d694d3ca4b3692199fa9f78', 'request_id': 'req-987abd93-61f8-47d6-8a6b-2cd70a457a3d'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:06.294503 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:06.300313 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-987abd93-61f8-47d6-8a6b-2cd70a457a3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1d2fff06d694d3ca4b3692199fa9f78', 'request_id': 'req-987abd93-61f8-47d6-8a6b-2cd70a457a3d'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:06.307841 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-987abd93-61f8-47d6-8a6b-2cd70a457a3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1d2fff06d694d3ca4b3692199fa9f78', 'request_id': 'req-987abd93-61f8-47d6-8a6b-2cd70a457a3d'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:06.319055 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-987abd93-61f8-47d6-8a6b-2cd70a457a3d admin admin] The token cache is being invalidate because project c1d2fff06d694d3ca4b3692199fa9f78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:03:06.319340 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-987abd93-61f8-47d6-8a6b-2cd70a457a3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:06.320150 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-987abd93-61f8-47d6-8a6b-2cd70a457a3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:06.321750 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1250/2477] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:03:06 2022] DELETE /identity/v3/projects/c1d2fff06d694d3ca4b3692199fa9f78 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:06.327003 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64a0c7-28d1-45c0-8bce-93e15dcd7054 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:06.327285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64a0c7-28d1-45c0-8bce-93e15dcd7054 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:06.327589 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64a0c7-28d1-45c0-8bce-93e15dcd7054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:06.355927 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-8e64a0c7-28d1-45c0-8bce-93e15dcd7054 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:06.357166 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-8e64a0c7-28d1-45c0-8bce-93e15dcd7054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:06.428050 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1228/2478] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:03:06.437266 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4bc31-b22c-405c-a908-38f3a9ee609c None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:06.437735 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4bc31-b22c-405c-a908-38f3a9ee609c None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:06.438141 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4bc31-b22c-405c-a908-38f3a9ee609c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:06.465455 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-a0d4bc31-b22c-405c-a908-38f3a9ee609c None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:06.467469 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-a0d4bc31-b22c-405c-a908-38f3a9ee609c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:06.479547 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1251/2479] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:03:06.484580 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64a0c7-28d1-45c0-8bce-93e15dcd7054 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:06.494455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64a0c7-28d1-45c0-8bce-93e15dcd7054 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:06.499208 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec39cd-ae45-44a0-81ab-ec4e7b71c9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:06.499817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec39cd-ae45-44a0-81ab-ec4e7b71c9ed admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:06.500121 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec39cd-ae45-44a0-81ab-ec4e7b71c9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:06.500391 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec39cd-ae45-44a0-81ab-ec4e7b71c9ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:06.501031 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec39cd-ae45-44a0-81ab-ec4e7b71c9ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 11:03:06.501412 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec39cd-ae45-44a0-81ab-ec4e7b71c9ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:06.503076 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec39cd-ae45-44a0-81ab-ec4e7b71c9ed admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:06.514636 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1229/2480] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 11:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 11:03:06.519192 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4bc31-b22c-405c-a908-38f3a9ee609c None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:06.529135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4bc31-b22c-405c-a908-38f3a9ee609c None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:06.534377 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2eeb4-277c-493a-9748-d244d435bdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:06.534966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2eeb4-277c-493a-9748-d244d435bdc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:06.535259 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2eeb4-277c-493a-9748-d244d435bdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:06.535512 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2eeb4-277c-493a-9748-d244d435bdc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:06.536135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2eeb4-277c-493a-9748-d244d435bdc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:06.538083 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2eeb4-277c-493a-9748-d244d435bdc3 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:06.566940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1252/2481] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:03:06 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:03:06.571425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec39cd-ae45-44a0-81ab-ec4e7b71c9ed admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:06.581145 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec39cd-ae45-44a0-81ab-ec4e7b71c9ed admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:06.641290 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9954c8-b189-472e-94f2-371e7885edc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:06.641924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9954c8-b189-472e-94f2-371e7885edc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:06.642201 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9954c8-b189-472e-94f2-371e7885edc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:06.642471 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9954c8-b189-472e-94f2-371e7885edc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:06.643093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9954c8-b189-472e-94f2-371e7885edc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:06.645137 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9954c8-b189-472e-94f2-371e7885edc8 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:06.653599 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:06.668803 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1230/2482] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:03:06 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:03:06.672941 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2eeb4-277c-493a-9748-d244d435bdc3 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:06.683441 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2eeb4-277c-493a-9748-d244d435bdc3 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:06.688436 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab6abe-5d42-4ebe-8d71-40dd3dae633d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:06.689031 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab6abe-5d42-4ebe-8d71-40dd3dae633d admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:06.689338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab6abe-5d42-4ebe-8d71-40dd3dae633d admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:06.689753 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab6abe-5d42-4ebe-8d71-40dd3dae633d admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:06.690443 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab6abe-5d42-4ebe-8d71-40dd3dae633d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:06.692053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab6abe-5d42-4ebe-8d71-40dd3dae633d admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:06.705078 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1253/2483] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:03:06.712058 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9954c8-b189-472e-94f2-371e7885edc8 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:06.722980 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9954c8-b189-472e-94f2-371e7885edc8 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:06.728019 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b59a26-c421-4a71-8ab1-c77587d93bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:06.728661 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b59a26-c421-4a71-8ab1-c77587d93bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:06.728967 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b59a26-c421-4a71-8ab1-c77587d93bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:06.729268 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b59a26-c421-4a71-8ab1-c77587d93bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:06.729975 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b59a26-c421-4a71-8ab1-c77587d93bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:06.731550 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b59a26-c421-4a71-8ab1-c77587d93bd0 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:06.747797 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1231/2484] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:03:06.749405 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab6abe-5d42-4ebe-8d71-40dd3dae633d admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:06.762146 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab6abe-5d42-4ebe-8d71-40dd3dae633d admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:06.768834 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f0d93-7a52-46c0-8086-0a102a54c335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:06.769818 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f0d93-7a52-46c0-8086-0a102a54c335 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:06.770105 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f0d93-7a52-46c0-8086-0a102a54c335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:06.770384 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f0d93-7a52-46c0-8086-0a102a54c335 admin admin] PATH_INFO: `/v3/projects/d30dd8e8d13d4623a0259995c20fd1fc/users/22909a43ce1b45a5b742921fa164be28/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:06.786339 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f0d93-7a52-46c0-8086-0a102a54c335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d30dd8e8d13d4623a0259995c20fd1fc, user_id=22909a43ce1b45a5b742921fa164be28, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:06.789015 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f0d93-7a52-46c0-8086-0a102a54c335 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:06.805549 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1254/2485] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:03:06 2022] PUT /identity/v3/projects/d30dd8e8d13d4623a0259995c20fd1fc/users/22909a43ce1b45a5b742921fa164be28/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:06.815585 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ce3d0-bf19-4deb-804b-769950f1c4db None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:06.815869 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ce3d0-bf19-4deb-804b-769950f1c4db None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:06.816142 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ce3d0-bf19-4deb-804b-769950f1c4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:06.845464 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-755ce3d0-bf19-4deb-804b-769950f1c4db None None] MFA Rules not processed for user `22909a43ce1b45a5b742921fa164be28`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:06.846598 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-755ce3d0-bf19-4deb-804b-769950f1c4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:06.923715 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1232/2486] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:03:07.017952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f0d93-7a52-46c0-8086-0a102a54c335 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:07.019652 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-1a4f0d93-7a52-46c0-8086-0a102a54c335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:07.123448 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f0d93-7a52-46c0-8086-0a102a54c335 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:07.129841 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b4c2b-0e68-4b50-9dc4-2b4f14a348b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:07.130431 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b4c2b-0e68-4b50-9dc4-2b4f14a348b6 service nova] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:07.130708 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b4c2b-0e68-4b50-9dc4-2b4f14a348b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:07.130982 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b4c2b-0e68-4b50-9dc4-2b4f14a348b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:07.138610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b4c2b-0e68-4b50-9dc4-2b4f14a348b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:07.140838 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b4c2b-0e68-4b50-9dc4-2b4f14a348b6 service nova] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:07.149754 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1255/2487] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:03:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:03:07.705476 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ce3d0-bf19-4deb-804b-769950f1c4db None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:07.706869 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-755ce3d0-bf19-4deb-804b-769950f1c4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:07.771288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ce3d0-bf19-4deb-804b-769950f1c4db None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:07.776079 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82005f-30a1-4e92-9c6a-85514158f062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:07.776712 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82005f-30a1-4e92-9c6a-85514158f062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:07.776992 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82005f-30a1-4e92-9c6a-85514158f062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:07.777261 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82005f-30a1-4e92-9c6a-85514158f062 admin admin] PATH_INFO: `/v3/users/67d950b9d94643d3a88aa6242052ec36` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:07.778441 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82005f-30a1-4e92-9c6a-85514158f062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67d950b9d94643d3a88aa6242052ec36)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:07.780352 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82005f-30a1-4e92-9c6a-85514158f062 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:07.826058 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ff82005f-30a1-4e92-9c6a-85514158f062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67d950b9d94643d3a88aa6242052ec36'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:07.838260 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ff82005f-30a1-4e92-9c6a-85514158f062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67d950b9d94643d3a88aa6242052ec36'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:07.838939 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ff82005f-30a1-4e92-9c6a-85514158f062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67d950b9d94643d3a88aa6242052ec36'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:07.843848 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:07.846995 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ff82005f-30a1-4e92-9c6a-85514158f062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67d950b9d94643d3a88aa6242052ec36'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:07.855011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ff82005f-30a1-4e92-9c6a-85514158f062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67d950b9d94643d3a88aa6242052ec36'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:07.861678 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1233/2488] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:03:07 2022] DELETE /identity/v3/users/67d950b9d94643d3a88aa6242052ec36 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:07.866193 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc5015-da6d-44e3-a9ff-80795816043b None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:07.866648 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc5015-da6d-44e3-a9ff-80795816043b None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:07.866758 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc5015-da6d-44e3-a9ff-80795816043b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:07.885140 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-26bc5015-da6d-44e3-a9ff-80795816043b None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:07.886355 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-26bc5015-da6d-44e3-a9ff-80795816043b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:07.915985 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:07.947811 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1256/2489] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 11:03:07.958411 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82005f-30a1-4e92-9c6a-85514158f062 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:07.959798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ff82005f-30a1-4e92-9c6a-85514158f062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:08.020023 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82005f-30a1-4e92-9c6a-85514158f062 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:08.024164 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f05a7-7b9e-45e0-9109-dae33d978fb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:08.024766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f05a7-7b9e-45e0-9109-dae33d978fb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:08.025050 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f05a7-7b9e-45e0-9109-dae33d978fb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:08.025337 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f05a7-7b9e-45e0-9109-dae33d978fb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:08.036024 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f05a7-7b9e-45e0-9109-dae33d978fb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:08.037487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f05a7-7b9e-45e0-9109-dae33d978fb5 service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:08.048039 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1234/2490] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:03:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:03:08.396050 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc5015-da6d-44e3-a9ff-80795816043b None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:08.397644 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-26bc5015-da6d-44e3-a9ff-80795816043b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:08.411841 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc5015-da6d-44e3-a9ff-80795816043b None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:08.416697 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda0a30-38fa-450c-b0e0-7f272973f77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:08.417332 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda0a30-38fa-450c-b0e0-7f272973f77f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:08.417621 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda0a30-38fa-450c-b0e0-7f272973f77f admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:08.418613 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda0a30-38fa-450c-b0e0-7f272973f77f admin admin] PATH_INFO: `/v3/projects/84abe4bbe0694e3da9104a0d735f4b6e` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:08.420490 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda0a30-38fa-450c-b0e0-7f272973f77f admin admin] RBAC: Authorizing `identity:delete_project(project_id=84abe4bbe0694e3da9104a0d735f4b6e)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:08.422725 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda0a30-38fa-450c-b0e0-7f272973f77f admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:08.471134 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-bdda0a30-38fa-450c-b0e0-7f272973f77f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84abe4bbe0694e3da9104a0d735f4b6e', 'request_id': 'req-bdda0a30-38fa-450c-b0e0-7f272973f77f'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:08.476468 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-bdda0a30-38fa-450c-b0e0-7f272973f77f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84abe4bbe0694e3da9104a0d735f4b6e', 'request_id': 'req-bdda0a30-38fa-450c-b0e0-7f272973f77f'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:08.483872 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-bdda0a30-38fa-450c-b0e0-7f272973f77f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84abe4bbe0694e3da9104a0d735f4b6e', 'request_id': 'req-bdda0a30-38fa-450c-b0e0-7f272973f77f'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:08.495055 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-bdda0a30-38fa-450c-b0e0-7f272973f77f admin admin] The token cache is being invalidate because project 84abe4bbe0694e3da9104a0d735f4b6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:03:08.495344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-bdda0a30-38fa-450c-b0e0-7f272973f77f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:08.495959 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-bdda0a30-38fa-450c-b0e0-7f272973f77f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:08.497483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1257/2491] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:03:08 2022] DELETE /identity/v3/projects/84abe4bbe0694e3da9104a0d735f4b6e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:08.502097 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f05a7-7b9e-45e0-9109-dae33d978fb5 service neutron] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:08.511505 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f05a7-7b9e-45e0-9109-dae33d978fb5 service neutron] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:08.571464 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008810d-b451-44c1-b02e-bebb67e63f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:08.572146 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008810d-b451-44c1-b02e-bebb67e63f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:08.572455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008810d-b451-44c1-b02e-bebb67e63f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:08.572752 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008810d-b451-44c1-b02e-bebb67e63f7e admin admin] PATH_INFO: `/v3/users/4d2d28c070fa43118701f0a9a849dc18` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:08.575404 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008810d-b451-44c1-b02e-bebb67e63f7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d2d28c070fa43118701f0a9a849dc18)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:08.576281 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008810d-b451-44c1-b02e-bebb67e63f7e admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:08.629365 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0008810d-b451-44c1-b02e-bebb67e63f7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d2d28c070fa43118701f0a9a849dc18'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:08.643593 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0008810d-b451-44c1-b02e-bebb67e63f7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d2d28c070fa43118701f0a9a849dc18'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:08.644530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0008810d-b451-44c1-b02e-bebb67e63f7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d2d28c070fa43118701f0a9a849dc18'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:08.652168 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0008810d-b451-44c1-b02e-bebb67e63f7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d2d28c070fa43118701f0a9a849dc18'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:08.660572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0008810d-b451-44c1-b02e-bebb67e63f7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d2d28c070fa43118701f0a9a849dc18'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:08.667858 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1235/2492] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:03:08 2022] DELETE /identity/v3/users/4d2d28c070fa43118701f0a9a849dc18 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:08.969198 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda0a30-38fa-450c-b0e0-7f272973f77f admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:08.970685 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-bdda0a30-38fa-450c-b0e0-7f272973f77f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:08.986327 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda0a30-38fa-450c-b0e0-7f272973f77f admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:09.049011 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea7f004-7e0a-438e-90cd-5f6c1dafb534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:09.049798 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7f004-7e0a-438e-90cd-5f6c1dafb534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:09.050072 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7f004-7e0a-438e-90cd-5f6c1dafb534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:09.050361 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7f004-7e0a-438e-90cd-5f6c1dafb534 admin admin] PATH_INFO: `/v3/projects/15e7faf1f1f1487286bc33a8d4f8c48c` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:09.051562 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea7f004-7e0a-438e-90cd-5f6c1dafb534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15e7faf1f1f1487286bc33a8d4f8c48c)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:09.053599 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea7f004-7e0a-438e-90cd-5f6c1dafb534 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:09.100501 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-aea7f004-7e0a-438e-90cd-5f6c1dafb534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15e7faf1f1f1487286bc33a8d4f8c48c', 'request_id': 'req-aea7f004-7e0a-438e-90cd-5f6c1dafb534'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:09.107675 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-aea7f004-7e0a-438e-90cd-5f6c1dafb534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15e7faf1f1f1487286bc33a8d4f8c48c', 'request_id': 'req-aea7f004-7e0a-438e-90cd-5f6c1dafb534'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:09.110939 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:09.116535 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-aea7f004-7e0a-438e-90cd-5f6c1dafb534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15e7faf1f1f1487286bc33a8d4f8c48c', 'request_id': 'req-aea7f004-7e0a-438e-90cd-5f6c1dafb534'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:09.129965 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-aea7f004-7e0a-438e-90cd-5f6c1dafb534 admin admin] The token cache is being invalidate because project 15e7faf1f1f1487286bc33a8d4f8c48c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:03:09.130300 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-aea7f004-7e0a-438e-90cd-5f6c1dafb534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:09.130924 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-aea7f004-7e0a-438e-90cd-5f6c1dafb534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:09.132425 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1258/2493] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:03:08 2022] DELETE /identity/v3/projects/15e7faf1f1f1487286bc33a8d4f8c48c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 11:03:09.138175 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa81ee0-2ac9-41d8-8a40-32408ffb40eb None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:09.138659 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa81ee0-2ac9-41d8-8a40-32408ffb40eb None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:09.138758 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa81ee0-2ac9-41d8-8a40-32408ffb40eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:09.158884 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-3aa81ee0-2ac9-41d8-8a40-32408ffb40eb None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:09.160081 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-3aa81ee0-2ac9-41d8-8a40-32408ffb40eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:09.164239 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:09.221383 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1236/2494] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:03:09.230506 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdd235-d62e-4ddc-83bc-fc407bf8c2b9 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:09.230722 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdd235-d62e-4ddc-83bc-fc407bf8c2b9 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:09.230988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdd235-d62e-4ddc-83bc-fc407bf8c2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:09.250726 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-89fdd235-d62e-4ddc-83bc-fc407bf8c2b9 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:09.251916 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-89fdd235-d62e-4ddc-83bc-fc407bf8c2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:09.259783 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1259/2495] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:03:09.264293 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa81ee0-2ac9-41d8-8a40-32408ffb40eb None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:09.274101 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa81ee0-2ac9-41d8-8a40-32408ffb40eb None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:09.278860 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e652c29-29e2-423c-b948-6b43e87bdf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:09.279566 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e652c29-29e2-423c-b948-6b43e87bdf77 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:09.279956 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e652c29-29e2-423c-b948-6b43e87bdf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:09.280357 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e652c29-29e2-423c-b948-6b43e87bdf77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:09.281690 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e652c29-29e2-423c-b948-6b43e87bdf77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 11:03:09.282103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e652c29-29e2-423c-b948-6b43e87bdf77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:09.283723 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e652c29-29e2-423c-b948-6b43e87bdf77 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:09.295831 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1237/2496] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 11:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 11:03:09.301016 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdd235-d62e-4ddc-83bc-fc407bf8c2b9 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:09.310538 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdd235-d62e-4ddc-83bc-fc407bf8c2b9 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:09.315387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e335e8-a1c3-4b18-b815-84755dd8f42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:09.316012 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e335e8-a1c3-4b18-b815-84755dd8f42c admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:09.316287 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e335e8-a1c3-4b18-b815-84755dd8f42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:09.316553 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e335e8-a1c3-4b18-b815-84755dd8f42c admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:09.317195 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e335e8-a1c3-4b18-b815-84755dd8f42c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:09.319108 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e335e8-a1c3-4b18-b815-84755dd8f42c admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:09.355297 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1260/2497] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:03:09 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:03:09.356738 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e652c29-29e2-423c-b948-6b43e87bdf77 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:09.367361 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e652c29-29e2-423c-b948-6b43e87bdf77 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:09.426017 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2abed-8494-471f-9532-09b3e0394daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:09.426624 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2abed-8494-471f-9532-09b3e0394daa admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:09.426903 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2abed-8494-471f-9532-09b3e0394daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:09.427173 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2abed-8494-471f-9532-09b3e0394daa admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:09.427804 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2abed-8494-471f-9532-09b3e0394daa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:09.429757 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2abed-8494-471f-9532-09b3e0394daa admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:09.450768 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1238/2498] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:03:09 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:03:09.455405 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e335e8-a1c3-4b18-b815-84755dd8f42c admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:09.465818 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e335e8-a1c3-4b18-b815-84755dd8f42c admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:09.470821 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d222c-7220-4c06-91bc-0bc52bad07bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:09.471402 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d222c-7220-4c06-91bc-0bc52bad07bb admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:09.471681 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d222c-7220-4c06-91bc-0bc52bad07bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:09.471958 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d222c-7220-4c06-91bc-0bc52bad07bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:09.472598 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d222c-7220-4c06-91bc-0bc52bad07bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:09.474202 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d222c-7220-4c06-91bc-0bc52bad07bb admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:09.484581 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1261/2499] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:03:09.488275 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2abed-8494-471f-9532-09b3e0394daa admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:09.498103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2abed-8494-471f-9532-09b3e0394daa admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:09.502720 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff85b2-b314-459d-bc66-5e250868b10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:09.503299 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff85b2-b314-459d-bc66-5e250868b10b admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:09.503577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff85b2-b314-459d-bc66-5e250868b10b admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:09.503850 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff85b2-b314-459d-bc66-5e250868b10b admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:09.504489 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff85b2-b314-459d-bc66-5e250868b10b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:09.506128 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ff85b2-b314-459d-bc66-5e250868b10b admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:09.516624 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1239/2500] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:03:09.520478 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d222c-7220-4c06-91bc-0bc52bad07bb admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:09.530277 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d222c-7220-4c06-91bc-0bc52bad07bb admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:09.535392 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0318e-a50b-4965-a441-f7cc35500833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:09.536017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0318e-a50b-4965-a441-f7cc35500833 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:09.536298 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0318e-a50b-4965-a441-f7cc35500833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:09.536574 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0318e-a50b-4965-a441-f7cc35500833 admin admin] PATH_INFO: `/v3/projects/2e417959bcb4455faa0a54f9030af3b5/users/4b757b00657847f99e8a99077554e975/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:09.551773 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0318e-a50b-4965-a441-f7cc35500833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e417959bcb4455faa0a54f9030af3b5, user_id=4b757b00657847f99e8a99077554e975, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:09.554438 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0318e-a50b-4965-a441-f7cc35500833 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:09.566737 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1262/2501] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:03:09 2022] PUT /identity/v3/projects/2e417959bcb4455faa0a54f9030af3b5/users/4b757b00657847f99e8a99077554e975/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:09.576981 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3840e2-98ed-4732-885f-ff5a1942daf2 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:09.577259 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3840e2-98ed-4732-885f-ff5a1942daf2 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:09.577561 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3840e2-98ed-4732-885f-ff5a1942daf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:09.604634 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-ca3840e2-98ed-4732-885f-ff5a1942daf2 None None] MFA Rules not processed for user `4b757b00657847f99e8a99077554e975`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:09.605882 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ca3840e2-98ed-4732-885f-ff5a1942daf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:09.668443 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1240/2502] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:03:09.672995 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0318e-a50b-4965-a441-f7cc35500833 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:09.732505 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0318e-a50b-4965-a441-f7cc35500833 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:09.737180 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6db02-f0de-4f13-8080-110c21a5b378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:09.737734 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6db02-f0de-4f13-8080-110c21a5b378 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:09.738007 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6db02-f0de-4f13-8080-110c21a5b378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:09.738275 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6db02-f0de-4f13-8080-110c21a5b378 admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:09.738887 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6db02-f0de-4f13-8080-110c21a5b378 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:09.740743 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6db02-f0de-4f13-8080-110c21a5b378 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:09.766390 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1263/2503] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:03:09 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:03:09.770782 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3840e2-98ed-4732-885f-ff5a1942daf2 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:09.779552 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:09.785788 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3840e2-98ed-4732-885f-ff5a1942daf2 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:09.842413 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b6939-ca1e-4cbf-8515-ecc24f56ffb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:09.843019 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b6939-ca1e-4cbf-8515-ecc24f56ffb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:09.843905 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b6939-ca1e-4cbf-8515-ecc24f56ffb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:09.844171 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b6939-ca1e-4cbf-8515-ecc24f56ffb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:09.844794 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b6939-ca1e-4cbf-8515-ecc24f56ffb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:09.846709 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b6939-ca1e-4cbf-8515-ecc24f56ffb2 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:09.867655 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1241/2504] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:03:09 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 11:03:09.871571 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6db02-f0de-4f13-8080-110c21a5b378 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:09.882463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6db02-f0de-4f13-8080-110c21a5b378 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:09.887041 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0f68c-c950-4d35-b712-e24113865f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:09.887731 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0f68c-c950-4d35-b712-e24113865f44 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:09.888012 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0f68c-c950-4d35-b712-e24113865f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:09.888284 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0f68c-c950-4d35-b712-e24113865f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:09.888919 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0f68c-c950-4d35-b712-e24113865f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:09.890509 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0f68c-c950-4d35-b712-e24113865f44 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:09.901107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1264/2505] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:03:09.905046 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b6939-ca1e-4cbf-8515-ecc24f56ffb2 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:09.914932 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b6939-ca1e-4cbf-8515-ecc24f56ffb2 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:09.919529 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce915698-c695-4f6c-b442-a8a0b7297e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:09.920155 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce915698-c695-4f6c-b442-a8a0b7297e48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:09.920432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce915698-c695-4f6c-b442-a8a0b7297e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:09.920701 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce915698-c695-4f6c-b442-a8a0b7297e48 admin admin] PATH_INFO: `/v3/projects/2667d3b9507a4b8eb4eaf3645e223c54/users/fdb2a2362df546eaaab966671735035f/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:09.935440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce915698-c695-4f6c-b442-a8a0b7297e48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2667d3b9507a4b8eb4eaf3645e223c54, user_id=fdb2a2362df546eaaab966671735035f, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:09.938692 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce915698-c695-4f6c-b442-a8a0b7297e48 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:09.951685 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1242/2506] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:03:09 2022] PUT /identity/v3/projects/2667d3b9507a4b8eb4eaf3645e223c54/users/fdb2a2362df546eaaab966671735035f/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 11:03:09.955707 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0f68c-c950-4d35-b712-e24113865f44 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:09.966187 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0f68c-c950-4d35-b712-e24113865f44 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:09.993578 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce915698-c695-4f6c-b442-a8a0b7297e48 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:09.995339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ce915698-c695-4f6c-b442-a8a0b7297e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:10.025424 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84bb09-7b26-43a6-aa61-45ad6a481071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:10.026010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84bb09-7b26-43a6-aa61-45ad6a481071 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:10.026289 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84bb09-7b26-43a6-aa61-45ad6a481071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:10.026561 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84bb09-7b26-43a6-aa61-45ad6a481071 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:10.027197 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf84bb09-7b26-43a6-aa61-45ad6a481071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:10.028768 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf84bb09-7b26-43a6-aa61-45ad6a481071 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:10.030144 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:10.042232 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1265/2507] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:03:10.045940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84bb09-7b26-43a6-aa61-45ad6a481071 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:10.056896 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84bb09-7b26-43a6-aa61-45ad6a481071 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:10.062258 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf14ec-8e0b-479f-8603-9178ed5c3e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:10.062936 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf14ec-8e0b-479f-8603-9178ed5c3e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:10.063214 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf14ec-8e0b-479f-8603-9178ed5c3e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:10.063485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf14ec-8e0b-479f-8603-9178ed5c3e64 admin admin] PATH_INFO: `/v3/projects/2667d3b9507a4b8eb4eaf3645e223c54/users/fdb2a2362df546eaaab966671735035f/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:10.064336 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce915698-c695-4f6c-b442-a8a0b7297e48 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:10.065499 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf14ec-8e0b-479f-8603-9178ed5c3e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2667d3b9507a4b8eb4eaf3645e223c54, user_id=fdb2a2362df546eaaab966671735035f, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:10.068122 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf14ec-8e0b-479f-8603-9178ed5c3e64 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:10.070113 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a864f8-9de9-4dfe-8e03-fb960f7cff70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:10.071294 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a864f8-9de9-4dfe-8e03-fb960f7cff70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:10.071729 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a864f8-9de9-4dfe-8e03-fb960f7cff70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:10.072006 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a864f8-9de9-4dfe-8e03-fb960f7cff70 admin admin] PATH_INFO: `/v3/users/22909a43ce1b45a5b742921fa164be28` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:10.073171 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a864f8-9de9-4dfe-8e03-fb960f7cff70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22909a43ce1b45a5b742921fa164be28)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:10.075222 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a864f8-9de9-4dfe-8e03-fb960f7cff70 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:10.079421 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1266/2508] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:03:10 2022] PUT /identity/v3/projects/2667d3b9507a4b8eb4eaf3645e223c54/users/fdb2a2362df546eaaab966671735035f/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:10.089815 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898146d0-4b03-4312-b0e0-bd10cafdb688 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:10.090259 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898146d0-4b03-4312-b0e0-bd10cafdb688 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:10.090560 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898146d0-4b03-4312-b0e0-bd10cafdb688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:10.120796 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-898146d0-4b03-4312-b0e0-bd10cafdb688 None None] MFA Rules not processed for user `fdb2a2362df546eaaab966671735035f`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:10.122127 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-898146d0-4b03-4312-b0e0-bd10cafdb688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:10.124811 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-e7a864f8-9de9-4dfe-8e03-fb960f7cff70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22909a43ce1b45a5b742921fa164be28'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:10.137485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-e7a864f8-9de9-4dfe-8e03-fb960f7cff70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22909a43ce1b45a5b742921fa164be28'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:10.138202 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-e7a864f8-9de9-4dfe-8e03-fb960f7cff70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22909a43ce1b45a5b742921fa164be28'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:10.143658 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:10.146021 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-e7a864f8-9de9-4dfe-8e03-fb960f7cff70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22909a43ce1b45a5b742921fa164be28'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:10.157209 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-e7a864f8-9de9-4dfe-8e03-fb960f7cff70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22909a43ce1b45a5b742921fa164be28'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:10.164698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1243/2509] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:03:09 2022] DELETE /identity/v3/users/22909a43ce1b45a5b742921fa164be28 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 11:03:10.169018 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd1910-fa3d-4c5e-8922-7051b0022e82 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:10.169297 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd1910-fa3d-4c5e-8922-7051b0022e82 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:10.169599 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd1910-fa3d-4c5e-8922-7051b0022e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:10.188678 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-edcd1910-fa3d-4c5e-8922-7051b0022e82 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:10.189916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-edcd1910-fa3d-4c5e-8922-7051b0022e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:10.195448 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1267/2510] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:10 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 11:03:10.206561 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898146d0-4b03-4312-b0e0-bd10cafdb688 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:10.207948 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-898146d0-4b03-4312-b0e0-bd10cafdb688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:10.250109 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1244/2511] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 11:03:10.260410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd1910-fa3d-4c5e-8922-7051b0022e82 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:10.261820 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-edcd1910-fa3d-4c5e-8922-7051b0022e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:10.264011 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898146d0-4b03-4312-b0e0-bd10cafdb688 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:10.314418 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1aeaee-8712-4b69-b6db-105a8c25603f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:10.315017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1aeaee-8712-4b69-b6db-105a8c25603f service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:10.315289 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1aeaee-8712-4b69-b6db-105a8c25603f service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:10.315557 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1aeaee-8712-4b69-b6db-105a8c25603f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:10.320002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd1910-fa3d-4c5e-8922-7051b0022e82 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:10.323611 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89802881-55b6-41b4-b1e4-a6f74ce4d757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:10.324197 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89802881-55b6-41b4-b1e4-a6f74ce4d757 service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:10.324469 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89802881-55b6-41b4-b1e4-a6f74ce4d757 service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:10.324728 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89802881-55b6-41b4-b1e4-a6f74ce4d757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:10.335487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89802881-55b6-41b4-b1e4-a6f74ce4d757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:10.336960 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89802881-55b6-41b4-b1e4-a6f74ce4d757 service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:10.351199 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1245/2512] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:03:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 11:03:10.359562 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:10.384645 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1aeaee-8712-4b69-b6db-105a8c25603f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:10.386128 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1aeaee-8712-4b69-b6db-105a8c25603f service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:10.397268 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1268/2513] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:03:10 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 11:03:10.477653 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89802881-55b6-41b4-b1e4-a6f74ce4d757 service neutron] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:10.479377 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-89802881-55b6-41b4-b1e4-a6f74ce4d757 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:10.492380 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89802881-55b6-41b4-b1e4-a6f74ce4d757 service neutron] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:10.500354 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202549f-3668-41c1-ac47-b7e6278dd595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:10.500911 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202549f-3668-41c1-ac47-b7e6278dd595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:10.501190 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202549f-3668-41c1-ac47-b7e6278dd595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:10.501561 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202549f-3668-41c1-ac47-b7e6278dd595 admin admin] PATH_INFO: `/v3/users/4b757b00657847f99e8a99077554e975` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:10.503069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202549f-3668-41c1-ac47-b7e6278dd595 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b757b00657847f99e8a99077554e975)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:10.505037 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202549f-3668-41c1-ac47-b7e6278dd595 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:10.560042 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5202549f-3668-41c1-ac47-b7e6278dd595 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b757b00657847f99e8a99077554e975'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:10.574044 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5202549f-3668-41c1-ac47-b7e6278dd595 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b757b00657847f99e8a99077554e975'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:10.574789 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5202549f-3668-41c1-ac47-b7e6278dd595 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b757b00657847f99e8a99077554e975'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:10.583550 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5202549f-3668-41c1-ac47-b7e6278dd595 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b757b00657847f99e8a99077554e975'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:10.594899 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-5202549f-3668-41c1-ac47-b7e6278dd595 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b757b00657847f99e8a99077554e975'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:10.603332 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1246/2514] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:03:10 2022] DELETE /identity/v3/users/4b757b00657847f99e8a99077554e975 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:10.607633 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59265b0-e229-4249-9a2f-e5029586f5a6 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:10.607767 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59265b0-e229-4249-9a2f-e5029586f5a6 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:10.607954 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59265b0-e229-4249-9a2f-e5029586f5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:10.629689 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-a59265b0-e229-4249-9a2f-e5029586f5a6 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:10.630907 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-a59265b0-e229-4249-9a2f-e5029586f5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:10.667747 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202549f-3668-41c1-ac47-b7e6278dd595 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:10.669576 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-5202549f-3668-41c1-ac47-b7e6278dd595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:10.677078 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:10.704373 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1269/2515] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:03:10.714077 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59265b0-e229-4249-9a2f-e5029586f5a6 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:10.715479 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-a59265b0-e229-4249-9a2f-e5029586f5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:10.751802 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202549f-3668-41c1-ac47-b7e6278dd595 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:10.759161 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ed0c4-54fa-41c8-b1e2-439f5c8be318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:10.759887 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ed0c4-54fa-41c8-b1e2-439f5c8be318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:10.760174 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ed0c4-54fa-41c8-b1e2-439f5c8be318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:10.760432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ed0c4-54fa-41c8-b1e2-439f5c8be318 admin admin] PATH_INFO: `/v3/projects/d30dd8e8d13d4623a0259995c20fd1fc` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:10.761632 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ed0c4-54fa-41c8-b1e2-439f5c8be318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d30dd8e8d13d4623a0259995c20fd1fc)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:10.763520 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ed0c4-54fa-41c8-b1e2-439f5c8be318 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:10.776543 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59265b0-e229-4249-9a2f-e5029586f5a6 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:10.780281 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523bd5d-c503-4245-8f2f-9de317cb9b33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:10.780878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523bd5d-c503-4245-8f2f-9de317cb9b33 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:10.781154 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523bd5d-c503-4245-8f2f-9de317cb9b33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:10.781468 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523bd5d-c503-4245-8f2f-9de317cb9b33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:10.790721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523bd5d-c503-4245-8f2f-9de317cb9b33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:10.792131 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523bd5d-c503-4245-8f2f-9de317cb9b33 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:10.801920 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1270/2516] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:03:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 11:03:10.812256 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-440ed0c4-54fa-41c8-b1e2-439f5c8be318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd30dd8e8d13d4623a0259995c20fd1fc', 'request_id': 'req-440ed0c4-54fa-41c8-b1e2-439f5c8be318'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:10.818094 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-440ed0c4-54fa-41c8-b1e2-439f5c8be318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd30dd8e8d13d4623a0259995c20fd1fc', 'request_id': 'req-440ed0c4-54fa-41c8-b1e2-439f5c8be318'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:10.824743 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-440ed0c4-54fa-41c8-b1e2-439f5c8be318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd30dd8e8d13d4623a0259995c20fd1fc', 'request_id': 'req-440ed0c4-54fa-41c8-b1e2-439f5c8be318'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:10.839062 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-440ed0c4-54fa-41c8-b1e2-439f5c8be318 admin admin] The token cache is being invalidate because project d30dd8e8d13d4623a0259995c20fd1fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:03:10.839331 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-440ed0c4-54fa-41c8-b1e2-439f5c8be318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:10.839998 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-440ed0c4-54fa-41c8-b1e2-439f5c8be318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:10.841752 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1247/2517] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:03:10 2022] DELETE /identity/v3/projects/d30dd8e8d13d4623a0259995c20fd1fc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:10.846687 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1f685-0a06-4c20-ae43-5038edd40c6f None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:10.847036 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1f685-0a06-4c20-ae43-5038edd40c6f None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:10.847370 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1f685-0a06-4c20-ae43-5038edd40c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:10.867877 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-63e1f685-0a06-4c20-ae43-5038edd40c6f None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:10.869209 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-63e1f685-0a06-4c20-ae43-5038edd40c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:10.932908 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1271/2518] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 11:03:10.941713 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b96f7-cfb9-45db-875d-14ba15a093a1 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:10.942224 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b96f7-cfb9-45db-875d-14ba15a093a1 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:10.942558 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b96f7-cfb9-45db-875d-14ba15a093a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:10.963606 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-6e5b96f7-cfb9-45db-875d-14ba15a093a1 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:10.964918 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-6e5b96f7-cfb9-45db-875d-14ba15a093a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:10.973492 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1248/2519] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:03:10.978147 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1f685-0a06-4c20-ae43-5038edd40c6f None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:10.988727 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1f685-0a06-4c20-ae43-5038edd40c6f None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:10.993495 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3bcc37-afd1-46a8-90f4-6b2d5186c757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:10.994110 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3bcc37-afd1-46a8-90f4-6b2d5186c757 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:10.994386 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3bcc37-afd1-46a8-90f4-6b2d5186c757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:10.994658 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3bcc37-afd1-46a8-90f4-6b2d5186c757 admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:10.995439 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3bcc37-afd1-46a8-90f4-6b2d5186c757 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 11:03:10.995743 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3bcc37-afd1-46a8-90f4-6b2d5186c757 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:10.997400 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3bcc37-afd1-46a8-90f4-6b2d5186c757 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:11.013937 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1272/2520] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 11:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 11:03:11.015751 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b96f7-cfb9-45db-875d-14ba15a093a1 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:11.026181 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b96f7-cfb9-45db-875d-14ba15a093a1 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:11.030955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e061fe-73f8-42f9-8481-cce27c44cb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:11.031566 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e061fe-73f8-42f9-8481-cce27c44cb71 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:11.031844 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e061fe-73f8-42f9-8481-cce27c44cb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:11.032113 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e061fe-73f8-42f9-8481-cce27c44cb71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:11.032745 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e061fe-73f8-42f9-8481-cce27c44cb71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:11.034688 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e061fe-73f8-42f9-8481-cce27c44cb71 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:11.064723 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1249/2521] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:03:11 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 11:03:11.069013 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3bcc37-afd1-46a8-90f4-6b2d5186c757 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:11.075470 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:11.080226 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3bcc37-afd1-46a8-90f4-6b2d5186c757 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:11.142200 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e199cbc-c5ec-4331-b553-d6a63c6d3dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:11.142803 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e199cbc-c5ec-4331-b553-d6a63c6d3dcb admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:11.143079 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e199cbc-c5ec-4331-b553-d6a63c6d3dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:11.143347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e199cbc-c5ec-4331-b553-d6a63c6d3dcb admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:11.143961 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e199cbc-c5ec-4331-b553-d6a63c6d3dcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:11.146290 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e199cbc-c5ec-4331-b553-d6a63c6d3dcb admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:11.168944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1273/2522] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:03:11 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 11:03:11.174142 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e061fe-73f8-42f9-8481-cce27c44cb71 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:11.185305 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e061fe-73f8-42f9-8481-cce27c44cb71 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:11.194586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23870a6a-be6d-4d39-964a-dea25520bacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:11.195206 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23870a6a-be6d-4d39-964a-dea25520bacb admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:11.195481 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23870a6a-be6d-4d39-964a-dea25520bacb admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:11.195813 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23870a6a-be6d-4d39-964a-dea25520bacb admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:11.196409 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23870a6a-be6d-4d39-964a-dea25520bacb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:11.198054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23870a6a-be6d-4d39-964a-dea25520bacb admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:11.209374 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1250/2523] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:03:11.213159 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e199cbc-c5ec-4331-b553-d6a63c6d3dcb admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:11.223571 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e199cbc-c5ec-4331-b553-d6a63c6d3dcb admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:11.228222 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1f65e-6ec2-4b7a-9eb6-a19c27f5ada2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:11.228812 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1f65e-6ec2-4b7a-9eb6-a19c27f5ada2 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:11.229090 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1f65e-6ec2-4b7a-9eb6-a19c27f5ada2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:11.229388 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1f65e-6ec2-4b7a-9eb6-a19c27f5ada2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:11.230032 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1f65e-6ec2-4b7a-9eb6-a19c27f5ada2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:11.231603 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1f65e-6ec2-4b7a-9eb6-a19c27f5ada2 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:11.242932 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1274/2524] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:03:11.247455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23870a6a-be6d-4d39-964a-dea25520bacb admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:11.258222 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23870a6a-be6d-4d39-964a-dea25520bacb admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:11.262900 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b57446-3620-4ec2-a6f0-f84f82f26040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:11.263571 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b57446-3620-4ec2-a6f0-f84f82f26040 admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:11.263848 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b57446-3620-4ec2-a6f0-f84f82f26040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:11.264185 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b57446-3620-4ec2-a6f0-f84f82f26040 admin admin] PATH_INFO: `/v3/projects/4c34082f94f84f7cb8090beb9656fa2a/users/723725d08fdf4bdebe8199c170452f8a/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:11.279823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b57446-3620-4ec2-a6f0-f84f82f26040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c34082f94f84f7cb8090beb9656fa2a, user_id=723725d08fdf4bdebe8199c170452f8a, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:11.282617 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b57446-3620-4ec2-a6f0-f84f82f26040 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:11.297055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1251/2525] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:03:11 2022] PUT /identity/v3/projects/4c34082f94f84f7cb8090beb9656fa2a/users/723725d08fdf4bdebe8199c170452f8a/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:11.309261 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d56e1-ba39-4890-9edb-51a3381a19a0 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:11.309581 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d56e1-ba39-4890-9edb-51a3381a19a0 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:11.309881 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d56e1-ba39-4890-9edb-51a3381a19a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:11.330018 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b57446-3620-4ec2-a6f0-f84f82f26040 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:11.332212 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-33b57446-3620-4ec2-a6f0-f84f82f26040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:11.351008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-954d56e1-ba39-4890-9edb-51a3381a19a0 None None] MFA Rules not processed for user `723725d08fdf4bdebe8199c170452f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:11.352247 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-954d56e1-ba39-4890-9edb-51a3381a19a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:11.375859 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:11.409070 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b57446-3620-4ec2-a6f0-f84f82f26040 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:11.413805 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd900a-07bd-42f3-b408-6b34d1ae8b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:11.414430 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd900a-07bd-42f3-b408-6b34d1ae8b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:11.414704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd900a-07bd-42f3-b408-6b34d1ae8b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:11.414973 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd900a-07bd-42f3-b408-6b34d1ae8b95 admin admin] PATH_INFO: `/v3/projects/2e417959bcb4455faa0a54f9030af3b5` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:11.416127 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd900a-07bd-42f3-b408-6b34d1ae8b95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e417959bcb4455faa0a54f9030af3b5)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:11.418129 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd900a-07bd-42f3-b408-6b34d1ae8b95 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:11.418974 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1275/2526] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:03:11.423998 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d56e1-ba39-4890-9edb-51a3381a19a0 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:11.434059 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d56e1-ba39-4890-9edb-51a3381a19a0 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:11.439402 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46317c4-b88e-47b0-962c-3c526be4f3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:11.439996 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46317c4-b88e-47b0-962c-3c526be4f3c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:11.440276 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46317c4-b88e-47b0-962c-3c526be4f3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:11.440545 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46317c4-b88e-47b0-962c-3c526be4f3c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:11.441162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46317c4-b88e-47b0-962c-3c526be4f3c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:11.443112 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46317c4-b88e-47b0-962c-3c526be4f3c8 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:11.464815 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-2ddd900a-07bd-42f3-b408-6b34d1ae8b95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e417959bcb4455faa0a54f9030af3b5', 'request_id': 'req-2ddd900a-07bd-42f3-b408-6b34d1ae8b95'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:11.470958 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-2ddd900a-07bd-42f3-b408-6b34d1ae8b95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e417959bcb4455faa0a54f9030af3b5', 'request_id': 'req-2ddd900a-07bd-42f3-b408-6b34d1ae8b95'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:11.471415 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1276/2527] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:03:11 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 11:03:11.475318 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46317c4-b88e-47b0-962c-3c526be4f3c8 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:11.477302 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-2ddd900a-07bd-42f3-b408-6b34d1ae8b95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e417959bcb4455faa0a54f9030af3b5', 'request_id': 'req-2ddd900a-07bd-42f3-b408-6b34d1ae8b95'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:11.490418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-2ddd900a-07bd-42f3-b408-6b34d1ae8b95 admin admin] The token cache is being invalidate because project 2e417959bcb4455faa0a54f9030af3b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:03:11.490697 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-2ddd900a-07bd-42f3-b408-6b34d1ae8b95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:11.491323 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-2ddd900a-07bd-42f3-b408-6b34d1ae8b95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:11.492843 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1252/2528] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:03:11 2022] DELETE /identity/v3/projects/2e417959bcb4455faa0a54f9030af3b5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:11.496686 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd900a-07bd-42f3-b408-6b34d1ae8b95 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:11.498188 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-2ddd900a-07bd-42f3-b408-6b34d1ae8b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:11.526346 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:11.540596 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46317c4-b88e-47b0-962c-3c526be4f3c8 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:11.545513 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c349d9f-4e1e-49ae-992b-2245240e1903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:11.546941 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c349d9f-4e1e-49ae-992b-2245240e1903 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:11.547395 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c349d9f-4e1e-49ae-992b-2245240e1903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:11.547675 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c349d9f-4e1e-49ae-992b-2245240e1903 admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:11.548295 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c349d9f-4e1e-49ae-992b-2245240e1903 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:11.550232 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c349d9f-4e1e-49ae-992b-2245240e1903 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:11.565335 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd900a-07bd-42f3-b408-6b34d1ae8b95 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:11.570208 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45ad5b-3fb3-499a-8b1c-262c4a8df649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:11.570833 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45ad5b-3fb3-499a-8b1c-262c4a8df649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:11.571091 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1277/2529] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:03:11 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 11:03:11.571259 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45ad5b-3fb3-499a-8b1c-262c4a8df649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:11.571351 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45ad5b-3fb3-499a-8b1c-262c4a8df649 admin admin] PATH_INFO: `/v3/users/fdb2a2362df546eaaab966671735035f` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:11.572500 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45ad5b-3fb3-499a-8b1c-262c4a8df649 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdb2a2362df546eaaab966671735035f)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:11.574450 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45ad5b-3fb3-499a-8b1c-262c4a8df649 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:11.574870 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c349d9f-4e1e-49ae-992b-2245240e1903 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:11.576492 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-9c349d9f-4e1e-49ae-992b-2245240e1903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:11.588281 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c349d9f-4e1e-49ae-992b-2245240e1903 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:11.592913 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb8150-d0e5-4261-8808-88a1a874171f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:11.594033 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb8150-d0e5-4261-8808-88a1a874171f admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:11.594309 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb8150-d0e5-4261-8808-88a1a874171f admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:11.594575 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb8150-d0e5-4261-8808-88a1a874171f admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:11.595205 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb8150-d0e5-4261-8808-88a1a874171f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:11.596765 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb8150-d0e5-4261-8808-88a1a874171f admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:11.607334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1278/2530] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 11:03:11.612073 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb8150-d0e5-4261-8808-88a1a874171f admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:11.621225 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-4f45ad5b-3fb3-499a-8b1c-262c4a8df649 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdb2a2362df546eaaab966671735035f'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:11.621670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb8150-d0e5-4261-8808-88a1a874171f admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:11.626493 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c9cfb-6b7c-4b4f-a9f2-b4e5b9b2e0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:11.627200 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c9cfb-6b7c-4b4f-a9f2-b4e5b9b2e0b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:11.627482 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c9cfb-6b7c-4b4f-a9f2-b4e5b9b2e0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:11.627756 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c9cfb-6b7c-4b4f-a9f2-b4e5b9b2e0b4 admin admin] PATH_INFO: `/v3/projects/c3ac41d4804440a7b430172971e7b8c4/users/0566eac953944d8fac8ce2b88cee0643/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:11.633731 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:11.634658 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-4f45ad5b-3fb3-499a-8b1c-262c4a8df649 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdb2a2362df546eaaab966671735035f'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:11.635460 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-4f45ad5b-3fb3-499a-8b1c-262c4a8df649 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdb2a2362df546eaaab966671735035f'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:11.647054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-4f45ad5b-3fb3-499a-8b1c-262c4a8df649 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdb2a2362df546eaaab966671735035f'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:11.648147 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623c9cfb-6b7c-4b4f-a9f2-b4e5b9b2e0b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3ac41d4804440a7b430172971e7b8c4, user_id=0566eac953944d8fac8ce2b88cee0643, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:11.651269 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623c9cfb-6b7c-4b4f-a9f2-b4e5b9b2e0b4 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:11.658526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-4f45ad5b-3fb3-499a-8b1c-262c4a8df649 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdb2a2362df546eaaab966671735035f'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:11.665302 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1253/2531] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:03:11 2022] DELETE /identity/v3/users/fdb2a2362df546eaaab966671735035f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 11:03:11.667306 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1279/2532] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:03:11 2022] PUT /identity/v3/projects/c3ac41d4804440a7b430172971e7b8c4/users/0566eac953944d8fac8ce2b88cee0643/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 11:03:11.671172 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45ad5b-3fb3-499a-8b1c-262c4a8df649 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:11.673460 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-4f45ad5b-3fb3-499a-8b1c-262c4a8df649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:11.743987 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45ad5b-3fb3-499a-8b1c-262c4a8df649 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:11.748870 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6e356-8fb4-4541-8c0a-7733e3c9e814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:11.749541 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6e356-8fb4-4541-8c0a-7733e3c9e814 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:11.749821 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6e356-8fb4-4541-8c0a-7733e3c9e814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:11.750114 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6e356-8fb4-4541-8c0a-7733e3c9e814 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:11.750758 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf6e356-8fb4-4541-8c0a-7733e3c9e814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:11.752357 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf6e356-8fb4-4541-8c0a-7733e3c9e814 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:11.762952 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1254/2533] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 11:03:11.767543 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c9cfb-6b7c-4b4f-a9f2-b4e5b9b2e0b4 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:11.959691 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c9cfb-6b7c-4b4f-a9f2-b4e5b9b2e0b4 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:11.964473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b46513-a5cb-4a6f-aca6-1fd3ad76c766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:11.965118 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b46513-a5cb-4a6f-aca6-1fd3ad76c766 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:11.965450 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b46513-a5cb-4a6f-aca6-1fd3ad76c766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:11.965720 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b46513-a5cb-4a6f-aca6-1fd3ad76c766 admin admin] PATH_INFO: `/v3/projects/c3ac41d4804440a7b430172971e7b8c4/users/0566eac953944d8fac8ce2b88cee0643/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:11.967629 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b46513-a5cb-4a6f-aca6-1fd3ad76c766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3ac41d4804440a7b430172971e7b8c4, user_id=0566eac953944d8fac8ce2b88cee0643, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:11.970878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b46513-a5cb-4a6f-aca6-1fd3ad76c766 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:11.981443 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1280/2534] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:03:11 2022] PUT /identity/v3/projects/c3ac41d4804440a7b430172971e7b8c4/users/0566eac953944d8fac8ce2b88cee0643/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:11.991991 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a572ce5-7036-4992-a711-4449112c3500 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:11.991991 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a572ce5-7036-4992-a711-4449112c3500 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:11.992244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a572ce5-7036-4992-a711-4449112c3500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:12.021060 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-6a572ce5-7036-4992-a711-4449112c3500 None None] MFA Rules not processed for user `0566eac953944d8fac8ce2b88cee0643`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:12.022304 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-6a572ce5-7036-4992-a711-4449112c3500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:12.044006 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b46513-a5cb-4a6f-aca6-1fd3ad76c766 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:12.045875 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-59b46513-a5cb-4a6f-aca6-1fd3ad76c766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:12.110834 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1255/2535] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:03:12.122645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a572ce5-7036-4992-a711-4449112c3500 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:12.123984 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-6a572ce5-7036-4992-a711-4449112c3500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:12.124102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b46513-a5cb-4a6f-aca6-1fd3ad76c766 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:12.128724 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972ce3b-fbef-41e1-a94a-b293a4be9e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:12.129357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972ce3b-fbef-41e1-a94a-b293a4be9e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:12.129693 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972ce3b-fbef-41e1-a94a-b293a4be9e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:12.129890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972ce3b-fbef-41e1-a94a-b293a4be9e86 admin admin] PATH_INFO: `/v3/projects/2667d3b9507a4b8eb4eaf3645e223c54` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:12.131026 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972ce3b-fbef-41e1-a94a-b293a4be9e86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2667d3b9507a4b8eb4eaf3645e223c54)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:12.132872 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972ce3b-fbef-41e1-a94a-b293a4be9e86 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:12.177758 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:12.183206 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a572ce5-7036-4992-a711-4449112c3500 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:12.185892 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-3972ce3b-fbef-41e1-a94a-b293a4be9e86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2667d3b9507a4b8eb4eaf3645e223c54', 'request_id': 'req-3972ce3b-fbef-41e1-a94a-b293a4be9e86'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:12.192559 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-3972ce3b-fbef-41e1-a94a-b293a4be9e86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2667d3b9507a4b8eb4eaf3645e223c54', 'request_id': 'req-3972ce3b-fbef-41e1-a94a-b293a4be9e86'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:12.197465 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:12.200620 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-3972ce3b-fbef-41e1-a94a-b293a4be9e86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2667d3b9507a4b8eb4eaf3645e223c54', 'request_id': 'req-3972ce3b-fbef-41e1-a94a-b293a4be9e86'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:12.214011 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-3972ce3b-fbef-41e1-a94a-b293a4be9e86 admin admin] The token cache is being invalidate because project 2667d3b9507a4b8eb4eaf3645e223c54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:03:12.214508 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-3972ce3b-fbef-41e1-a94a-b293a4be9e86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:12.215249 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-3972ce3b-fbef-41e1-a94a-b293a4be9e86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:12.221354 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1281/2536] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:03:12 2022] DELETE /identity/v3/projects/2667d3b9507a4b8eb4eaf3645e223c54 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 11:03:12.222675 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df066cd-ba0c-4eae-a240-ea7d671eb3b4 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:12.222953 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df066cd-ba0c-4eae-a240-ea7d671eb3b4 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:12.223220 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df066cd-ba0c-4eae-a240-ea7d671eb3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:12.237281 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455c4ed-85b3-4ca7-a9d3-d494d4e5468b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:12.237909 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455c4ed-85b3-4ca7-a9d3-d494d4e5468b service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:12.238188 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455c4ed-85b3-4ca7-a9d3-d494d4e5468b service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:12.238461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455c4ed-85b3-4ca7-a9d3-d494d4e5468b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:12.240235 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-0455c4ed-85b3-4ca7-a9d3-d494d4e5468b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:12.242287 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-8df066cd-ba0c-4eae-a240-ea7d671eb3b4 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:12.243484 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-8df066cd-ba0c-4eae-a240-ea7d671eb3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:12.302261 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1282/2537] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 11:03:12.303853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455c4ed-85b3-4ca7-a9d3-d494d4e5468b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:12.305293 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455c4ed-85b3-4ca7-a9d3-d494d4e5468b service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:12.310816 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810b9aa-5f3d-48ac-94d4-ef77b8f7cd5f None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:12.311105 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810b9aa-5f3d-48ac-94d4-ef77b8f7cd5f None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:12.311374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810b9aa-5f3d-48ac-94d4-ef77b8f7cd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:12.315929 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1256/2538] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:03:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 11:03:12.333201 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-c810b9aa-5f3d-48ac-94d4-ef77b8f7cd5f None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:12.334441 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-c810b9aa-5f3d-48ac-94d4-ef77b8f7cd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:12.346621 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1283/2539] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 11:03:12.347147 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455c4ed-85b3-4ca7-a9d3-d494d4e5468b service cinder] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:12.358608 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455c4ed-85b3-4ca7-a9d3-d494d4e5468b service cinder] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:12.365581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f15d0a-7563-43be-8ccb-5c35c0d1ab95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:12.365581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f15d0a-7563-43be-8ccb-5c35c0d1ab95 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:12.365581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f15d0a-7563-43be-8ccb-5c35c0d1ab95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:12.365845 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f15d0a-7563-43be-8ccb-5c35c0d1ab95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:12.366442 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f15d0a-7563-43be-8ccb-5c35c0d1ab95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 11:03:12.366752 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f15d0a-7563-43be-8ccb-5c35c0d1ab95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:12.368526 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f15d0a-7563-43be-8ccb-5c35c0d1ab95 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:12.381361 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1257/2540] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 11:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 11:03:12.385752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810b9aa-5f3d-48ac-94d4-ef77b8f7cd5f None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:12.395965 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810b9aa-5f3d-48ac-94d4-ef77b8f7cd5f None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:12.404375 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38331b6c-81c1-4c32-8a8d-5dcb5a9567d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:12.405152 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38331b6c-81c1-4c32-8a8d-5dcb5a9567d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:12.405614 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38331b6c-81c1-4c32-8a8d-5dcb5a9567d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:12.405967 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38331b6c-81c1-4c32-8a8d-5dcb5a9567d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:12.406664 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38331b6c-81c1-4c32-8a8d-5dcb5a9567d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:12.408603 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38331b6c-81c1-4c32-8a8d-5dcb5a9567d0 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:12.410455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f15d0a-7563-43be-8ccb-5c35c0d1ab95 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:12.412316 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-63f15d0a-7563-43be-8ccb-5c35c0d1ab95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:12.424652 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f15d0a-7563-43be-8ccb-5c35c0d1ab95 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:12.428826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558738d-e105-488f-ac43-3f335f58c020 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:12.429867 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558738d-e105-488f-ac43-3f335f58c020 service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:12.430205 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558738d-e105-488f-ac43-3f335f58c020 service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:12.430611 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558738d-e105-488f-ac43-3f335f58c020 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:12.432648 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-4558738d-e105-488f-ac43-3f335f58c020 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:12.438607 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1284/2541] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:03:12 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:03:12.442626 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38331b6c-81c1-4c32-8a8d-5dcb5a9567d0 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:12.491830 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558738d-e105-488f-ac43-3f335f58c020 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:12.493268 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558738d-e105-488f-ac43-3f335f58c020 service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:12.503221 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1258/2542] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:03:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 11:03:12.507658 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38331b6c-81c1-4c32-8a8d-5dcb5a9567d0 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:12.512563 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbba407-13a1-4fa3-8978-02c1e71ac900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:12.513277 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbba407-13a1-4fa3-8978-02c1e71ac900 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:12.513590 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbba407-13a1-4fa3-8978-02c1e71ac900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:12.513859 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbba407-13a1-4fa3-8978-02c1e71ac900 admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:12.514478 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbba407-13a1-4fa3-8978-02c1e71ac900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:12.517288 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbba407-13a1-4fa3-8978-02c1e71ac900 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:12.538721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1285/2543] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:03:12 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 11:03:12.542817 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558738d-e105-488f-ac43-3f335f58c020 service cinder] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:12.554546 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558738d-e105-488f-ac43-3f335f58c020 service cinder] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:12.559424 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352d8ac-3f9c-4cf2-928b-c392d7dcf90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:12.560115 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352d8ac-3f9c-4cf2-928b-c392d7dcf90a admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:12.560398 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352d8ac-3f9c-4cf2-928b-c392d7dcf90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:12.560671 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352d8ac-3f9c-4cf2-928b-c392d7dcf90a admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:12.561336 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352d8ac-3f9c-4cf2-928b-c392d7dcf90a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:12.563405 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352d8ac-3f9c-4cf2-928b-c392d7dcf90a admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:12.576638 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1259/2544] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 11:03:12.578554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbba407-13a1-4fa3-8978-02c1e71ac900 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:12.588723 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbba407-13a1-4fa3-8978-02c1e71ac900 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:12.593637 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b439cce-01e0-48d5-a28a-cd10cac937e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:12.594229 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b439cce-01e0-48d5-a28a-cd10cac937e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:12.594509 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b439cce-01e0-48d5-a28a-cd10cac937e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:12.595367 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b439cce-01e0-48d5-a28a-cd10cac937e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:12.595489 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b439cce-01e0-48d5-a28a-cd10cac937e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:12.596979 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b439cce-01e0-48d5-a28a-cd10cac937e2 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:12.608139 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1286/2545] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:03:12.612539 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352d8ac-3f9c-4cf2-928b-c392d7dcf90a admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:12.624973 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352d8ac-3f9c-4cf2-928b-c392d7dcf90a admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:12.631161 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac50ff8-ba6c-4784-8eae-a4801c7eb115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:12.631738 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac50ff8-ba6c-4784-8eae-a4801c7eb115 admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:12.632092 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac50ff8-ba6c-4784-8eae-a4801c7eb115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:12.632470 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac50ff8-ba6c-4784-8eae-a4801c7eb115 admin admin] PATH_INFO: `/v3/projects/042b1213833b4e2f918c17e0de19f487/users/d9de3fac77874d6eb5ddb988993d9946/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:12.650463 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac50ff8-ba6c-4784-8eae-a4801c7eb115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=042b1213833b4e2f918c17e0de19f487, user_id=d9de3fac77874d6eb5ddb988993d9946, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:12.653092 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac50ff8-ba6c-4784-8eae-a4801c7eb115 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:12.665835 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1260/2546] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:03:12 2022] PUT /identity/v3/projects/042b1213833b4e2f918c17e0de19f487/users/d9de3fac77874d6eb5ddb988993d9946/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:12.676925 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e718c2-2361-4209-bad9-871c5f84cea3 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:12.677203 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e718c2-2361-4209-bad9-871c5f84cea3 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:12.677565 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e718c2-2361-4209-bad9-871c5f84cea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:12.704998 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-f5e718c2-2361-4209-bad9-871c5f84cea3 None None] MFA Rules not processed for user `d9de3fac77874d6eb5ddb988993d9946`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:12.706260 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-f5e718c2-2361-4209-bad9-871c5f84cea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:12.714249 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:12.773697 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1287/2547] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:03:12.784849 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac50ff8-ba6c-4784-8eae-a4801c7eb115 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:12.804271 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:12.840452 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac50ff8-ba6c-4784-8eae-a4801c7eb115 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:12.844121 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2793a96-8f43-47af-a273-dca5d1cc0c71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:12.844716 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2793a96-8f43-47af-a273-dca5d1cc0c71 service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:12.844993 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2793a96-8f43-47af-a273-dca5d1cc0c71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:12.845297 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2793a96-8f43-47af-a273-dca5d1cc0c71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:12.853479 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2793a96-8f43-47af-a273-dca5d1cc0c71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:12.854931 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2793a96-8f43-47af-a273-dca5d1cc0c71 service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:12.864083 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1261/2548] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:03:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:03:15.416391 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e718c2-2361-4209-bad9-871c5f84cea3 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:15.487657 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e718c2-2361-4209-bad9-871c5f84cea3 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:15.492438 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d2be8-aec1-455b-be92-c96b28c39f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:15.493063 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d2be8-aec1-455b-be92-c96b28c39f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:15.493339 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d2be8-aec1-455b-be92-c96b28c39f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:15.493622 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d2be8-aec1-455b-be92-c96b28c39f8f admin admin] PATH_INFO: `/v3/users/d9de3fac77874d6eb5ddb988993d9946` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:15.494740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d2be8-aec1-455b-be92-c96b28c39f8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9de3fac77874d6eb5ddb988993d9946)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:15.496826 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d2be8-aec1-455b-be92-c96b28c39f8f admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:15.546603 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-8f4d2be8-aec1-455b-be92-c96b28c39f8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9de3fac77874d6eb5ddb988993d9946'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:15.559061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-8f4d2be8-aec1-455b-be92-c96b28c39f8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9de3fac77874d6eb5ddb988993d9946'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:15.559857 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-8f4d2be8-aec1-455b-be92-c96b28c39f8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9de3fac77874d6eb5ddb988993d9946'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:15.568901 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-8f4d2be8-aec1-455b-be92-c96b28c39f8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9de3fac77874d6eb5ddb988993d9946'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:15.577182 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-8f4d2be8-aec1-455b-be92-c96b28c39f8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9de3fac77874d6eb5ddb988993d9946'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:15.583587 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1288/2549] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:03:15 2022] DELETE /identity/v3/users/d9de3fac77874d6eb5ddb988993d9946 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:15.588033 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3185b-96ef-4965-8849-dbbb1da72045 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:15.588513 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3185b-96ef-4965-8849-dbbb1da72045 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:15.588616 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3185b-96ef-4965-8849-dbbb1da72045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:15.607735 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-15e3185b-96ef-4965-8849-dbbb1da72045 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:15.609090 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-15e3185b-96ef-4965-8849-dbbb1da72045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:15.670738 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1262/2550] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:03:15.680719 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d2be8-aec1-455b-be92-c96b28c39f8f admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:15.682139 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-8f4d2be8-aec1-455b-be92-c96b28c39f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:15.715593 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:15.744989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d2be8-aec1-455b-be92-c96b28c39f8f admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:15.749149 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef0e87-ba14-4703-b402-957bb4c3f3e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:15.749812 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef0e87-ba14-4703-b402-957bb4c3f3e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:15.750094 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef0e87-ba14-4703-b402-957bb4c3f3e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:15.750366 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef0e87-ba14-4703-b402-957bb4c3f3e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:15.759567 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef0e87-ba14-4703-b402-957bb4c3f3e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:15.760983 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef0e87-ba14-4703-b402-957bb4c3f3e0 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:15.771284 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1289/2551] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:03:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:03:16.040359 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3185b-96ef-4965-8849-dbbb1da72045 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:16.041980 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-15e3185b-96ef-4965-8849-dbbb1da72045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:16.055089 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3185b-96ef-4965-8849-dbbb1da72045 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:16.060736 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859ebca-b9b1-46b1-b97f-d86c70dc22b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:16.061558 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859ebca-b9b1-46b1-b97f-d86c70dc22b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:16.062531 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859ebca-b9b1-46b1-b97f-d86c70dc22b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:16.062822 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859ebca-b9b1-46b1-b97f-d86c70dc22b3 admin admin] PATH_INFO: `/v3/projects/042b1213833b4e2f918c17e0de19f487` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:16.063928 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859ebca-b9b1-46b1-b97f-d86c70dc22b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=042b1213833b4e2f918c17e0de19f487)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:16.065892 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859ebca-b9b1-46b1-b97f-d86c70dc22b3 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:16.116095 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-b859ebca-b9b1-46b1-b97f-d86c70dc22b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '042b1213833b4e2f918c17e0de19f487', 'request_id': 'req-b859ebca-b9b1-46b1-b97f-d86c70dc22b3'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:16.121546 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-b859ebca-b9b1-46b1-b97f-d86c70dc22b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '042b1213833b4e2f918c17e0de19f487', 'request_id': 'req-b859ebca-b9b1-46b1-b97f-d86c70dc22b3'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:16.128556 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-b859ebca-b9b1-46b1-b97f-d86c70dc22b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '042b1213833b4e2f918c17e0de19f487', 'request_id': 'req-b859ebca-b9b1-46b1-b97f-d86c70dc22b3'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:16.142435 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-b859ebca-b9b1-46b1-b97f-d86c70dc22b3 admin admin] The token cache is being invalidate because project 042b1213833b4e2f918c17e0de19f487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:03:16.142722 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-b859ebca-b9b1-46b1-b97f-d86c70dc22b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:16.143340 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-b859ebca-b9b1-46b1-b97f-d86c70dc22b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:16.144868 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1263/2552] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:03:16 2022] DELETE /identity/v3/projects/042b1213833b4e2f918c17e0de19f487 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:16.149874 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f947f12-d9da-458a-b8c4-ed86ecc5d028 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:16.150157 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f947f12-d9da-458a-b8c4-ed86ecc5d028 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:16.150425 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f947f12-d9da-458a-b8c4-ed86ecc5d028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:16.170024 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-5f947f12-d9da-458a-b8c4-ed86ecc5d028 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:16.171574 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-5f947f12-d9da-458a-b8c4-ed86ecc5d028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:16.231307 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1290/2553] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 11:03:16.239122 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d881db5-700a-47c3-92d3-a6c89e9d52a7 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:16.239436 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d881db5-700a-47c3-92d3-a6c89e9d52a7 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:16.239711 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d881db5-700a-47c3-92d3-a6c89e9d52a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:16.259942 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-3d881db5-700a-47c3-92d3-a6c89e9d52a7 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:16.261276 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-3d881db5-700a-47c3-92d3-a6c89e9d52a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:16.270885 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1264/2554] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:03:16.274964 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f947f12-d9da-458a-b8c4-ed86ecc5d028 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:16.284740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f947f12-d9da-458a-b8c4-ed86ecc5d028 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:16.289257 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9c264-53b0-4f34-a22e-4b074ae4031c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:16.289874 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9c264-53b0-4f34-a22e-4b074ae4031c admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:16.290151 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9c264-53b0-4f34-a22e-4b074ae4031c admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:16.290420 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9c264-53b0-4f34-a22e-4b074ae4031c admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:16.291063 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9c264-53b0-4f34-a22e-4b074ae4031c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 11:03:16.291363 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9c264-53b0-4f34-a22e-4b074ae4031c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:16.292952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9c264-53b0-4f34-a22e-4b074ae4031c admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:16.304596 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1291/2555] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 11:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 11:03:16.308589 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d881db5-700a-47c3-92d3-a6c89e9d52a7 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:16.318278 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d881db5-700a-47c3-92d3-a6c89e9d52a7 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:16.322883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78a512-f99c-40ee-a5e1-7ae32a8a122b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:16.323463 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78a512-f99c-40ee-a5e1-7ae32a8a122b admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:16.323739 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78a512-f99c-40ee-a5e1-7ae32a8a122b admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:16.324009 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78a512-f99c-40ee-a5e1-7ae32a8a122b admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:16.324622 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78a512-f99c-40ee-a5e1-7ae32a8a122b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:16.326532 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78a512-f99c-40ee-a5e1-7ae32a8a122b admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:16.354917 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1265/2556] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:03:16 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:03:16.359603 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9c264-53b0-4f34-a22e-4b074ae4031c admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:16.369452 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9c264-53b0-4f34-a22e-4b074ae4031c admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:16.423592 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240dc96-f210-4c79-a5a6-24afc5dadaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:16.424221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240dc96-f210-4c79-a5a6-24afc5dadaea admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:16.424488 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240dc96-f210-4c79-a5a6-24afc5dadaea admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:16.424986 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240dc96-f210-4c79-a5a6-24afc5dadaea admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:16.425648 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240dc96-f210-4c79-a5a6-24afc5dadaea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:16.427534 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240dc96-f210-4c79-a5a6-24afc5dadaea admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:16.450281 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1292/2557] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:03:16 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:03:16.454382 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78a512-f99c-40ee-a5e1-7ae32a8a122b admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:16.464954 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78a512-f99c-40ee-a5e1-7ae32a8a122b admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:16.469658 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00967d2f-05aa-4f43-a743-1345877630d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:16.470251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00967d2f-05aa-4f43-a743-1345877630d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:16.470530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00967d2f-05aa-4f43-a743-1345877630d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:16.470810 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00967d2f-05aa-4f43-a743-1345877630d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:16.471452 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00967d2f-05aa-4f43-a743-1345877630d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:16.473044 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00967d2f-05aa-4f43-a743-1345877630d5 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:16.484570 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1266/2558] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:03:16.488582 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240dc96-f210-4c79-a5a6-24afc5dadaea admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:16.498509 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240dc96-f210-4c79-a5a6-24afc5dadaea admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:16.503712 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37cee3-2149-4ae1-b0d9-91dfbd26dac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:16.504295 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37cee3-2149-4ae1-b0d9-91dfbd26dac8 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:16.504572 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37cee3-2149-4ae1-b0d9-91dfbd26dac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:16.504840 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37cee3-2149-4ae1-b0d9-91dfbd26dac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:16.505519 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37cee3-2149-4ae1-b0d9-91dfbd26dac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:16.507087 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37cee3-2149-4ae1-b0d9-91dfbd26dac8 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:16.517832 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1293/2559] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 11:03:16.522007 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00967d2f-05aa-4f43-a743-1345877630d5 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:16.528341 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:16.532973 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00967d2f-05aa-4f43-a743-1345877630d5 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:16.540138 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eedb63-f56e-4a76-b3ed-ae1b5c45a70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:16.541057 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eedb63-f56e-4a76-b3ed-ae1b5c45a70a admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:16.541647 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eedb63-f56e-4a76-b3ed-ae1b5c45a70a admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:16.542033 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eedb63-f56e-4a76-b3ed-ae1b5c45a70a admin admin] PATH_INFO: `/v3/projects/81f327d645ea4445a5137f7a021804ac/users/c498a538726748059f0a71d257129aa4/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:16.557826 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eedb63-f56e-4a76-b3ed-ae1b5c45a70a admin admin] RBAC: Authorizing `identity:create_grant(project_id=81f327d645ea4445a5137f7a021804ac, user_id=c498a538726748059f0a71d257129aa4, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:16.560661 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eedb63-f56e-4a76-b3ed-ae1b5c45a70a admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:16.575940 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1267/2560] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:03:16 2022] PUT /identity/v3/projects/81f327d645ea4445a5137f7a021804ac/users/c498a538726748059f0a71d257129aa4/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:16.580735 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b794041-2034-42ef-beea-6f4c7763b30b None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:16.581012 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b794041-2034-42ef-beea-6f4c7763b30b None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:16.581417 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b794041-2034-42ef-beea-6f4c7763b30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:16.599757 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-8b794041-2034-42ef-beea-6f4c7763b30b None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:16.600946 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-8b794041-2034-42ef-beea-6f4c7763b30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:16.632960 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:16.661894 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1294/2561] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:03:16.672134 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eedb63-f56e-4a76-b3ed-ae1b5c45a70a admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:16.673891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-99eedb63-f56e-4a76-b3ed-ae1b5c45a70a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:16.737030 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eedb63-f56e-4a76-b3ed-ae1b5c45a70a admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:16.744462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea406c7-3f9f-45cd-af5a-2c687539242b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:16.745074 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea406c7-3f9f-45cd-af5a-2c687539242b service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:16.745379 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea406c7-3f9f-45cd-af5a-2c687539242b service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:16.745650 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea406c7-3f9f-45cd-af5a-2c687539242b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:16.755195 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea406c7-3f9f-45cd-af5a-2c687539242b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:16.756924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea406c7-3f9f-45cd-af5a-2c687539242b service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:16.766850 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1268/2562] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:03:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:03:19.636549 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b794041-2034-42ef-beea-6f4c7763b30b None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:19.638280 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-8b794041-2034-42ef-beea-6f4c7763b30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:19.652072 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b794041-2034-42ef-beea-6f4c7763b30b None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:19.657489 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff12abf-20d5-4d0a-afd1-1ee43119d066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:19.658384 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff12abf-20d5-4d0a-afd1-1ee43119d066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:19.658698 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff12abf-20d5-4d0a-afd1-1ee43119d066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:19.658953 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff12abf-20d5-4d0a-afd1-1ee43119d066 admin admin] PATH_INFO: `/v3/users/723725d08fdf4bdebe8199c170452f8a` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:19.660106 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff12abf-20d5-4d0a-afd1-1ee43119d066 admin admin] RBAC: Authorizing `identity:delete_user(user_id=723725d08fdf4bdebe8199c170452f8a)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:19.662144 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff12abf-20d5-4d0a-afd1-1ee43119d066 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:19.714221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-bff12abf-20d5-4d0a-afd1-1ee43119d066 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '723725d08fdf4bdebe8199c170452f8a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:19.728336 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-bff12abf-20d5-4d0a-afd1-1ee43119d066 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '723725d08fdf4bdebe8199c170452f8a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:19.729119 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-bff12abf-20d5-4d0a-afd1-1ee43119d066 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '723725d08fdf4bdebe8199c170452f8a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:19.738768 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-bff12abf-20d5-4d0a-afd1-1ee43119d066 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '723725d08fdf4bdebe8199c170452f8a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:19.746962 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-bff12abf-20d5-4d0a-afd1-1ee43119d066 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '723725d08fdf4bdebe8199c170452f8a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:19.754520 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1295/2563] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:03:19 2022] DELETE /identity/v3/users/723725d08fdf4bdebe8199c170452f8a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:19.758801 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f14dd-2701-4a67-8e0b-f116232e62a5 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:19.759278 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f14dd-2701-4a67-8e0b-f116232e62a5 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:19.759494 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f14dd-2701-4a67-8e0b-f116232e62a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:19.781127 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-e70f14dd-2701-4a67-8e0b-f116232e62a5 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:19.783216 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-e70f14dd-2701-4a67-8e0b-f116232e62a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:19.852862 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1269/2564] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:03:19.864732 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff12abf-20d5-4d0a-afd1-1ee43119d066 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:19.866542 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-bff12abf-20d5-4d0a-afd1-1ee43119d066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:19.929769 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff12abf-20d5-4d0a-afd1-1ee43119d066 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:19.933744 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266e3b1-9762-4e37-8e79-5a2aff17a1d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:19.934481 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266e3b1-9762-4e37-8e79-5a2aff17a1d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:19.934814 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266e3b1-9762-4e37-8e79-5a2aff17a1d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:19.935172 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266e3b1-9762-4e37-8e79-5a2aff17a1d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:19.945113 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266e3b1-9762-4e37-8e79-5a2aff17a1d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:19.946856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266e3b1-9762-4e37-8e79-5a2aff17a1d3 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:19.958909 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1296/2565] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:03:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 11:03:20.279000 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f14dd-2701-4a67-8e0b-f116232e62a5 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:20.280493 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-e70f14dd-2701-4a67-8e0b-f116232e62a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:20.310453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f14dd-2701-4a67-8e0b-f116232e62a5 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:20.316267 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c467466-d4ea-496d-955f-43b42df2990c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:20.316910 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c467466-d4ea-496d-955f-43b42df2990c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:20.317579 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c467466-d4ea-496d-955f-43b42df2990c admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:20.317579 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c467466-d4ea-496d-955f-43b42df2990c admin admin] PATH_INFO: `/v3/projects/4c34082f94f84f7cb8090beb9656fa2a` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:20.318650 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c467466-d4ea-496d-955f-43b42df2990c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c34082f94f84f7cb8090beb9656fa2a)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:20.320549 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c467466-d4ea-496d-955f-43b42df2990c admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:20.406791 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-3c467466-d4ea-496d-955f-43b42df2990c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c34082f94f84f7cb8090beb9656fa2a', 'request_id': 'req-3c467466-d4ea-496d-955f-43b42df2990c'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:20.415613 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-3c467466-d4ea-496d-955f-43b42df2990c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c34082f94f84f7cb8090beb9656fa2a', 'request_id': 'req-3c467466-d4ea-496d-955f-43b42df2990c'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:20.437530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-3c467466-d4ea-496d-955f-43b42df2990c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c34082f94f84f7cb8090beb9656fa2a', 'request_id': 'req-3c467466-d4ea-496d-955f-43b42df2990c'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:20.479632 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-3c467466-d4ea-496d-955f-43b42df2990c admin admin] The token cache is being invalidate because project 4c34082f94f84f7cb8090beb9656fa2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:03:20.480165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-3c467466-d4ea-496d-955f-43b42df2990c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:20.480996 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-3c467466-d4ea-496d-955f-43b42df2990c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:20.483049 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1270/2566] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:03:20 2022] DELETE /identity/v3/projects/4c34082f94f84f7cb8090beb9656fa2a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 11:03:20.487879 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266e3b1-9762-4e37-8e79-5a2aff17a1d3 service neutron] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:20.507366 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266e3b1-9762-4e37-8e79-5a2aff17a1d3 service neutron] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:20.578402 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:20.597776 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db852650-6e99-417c-a6ac-890ba2a26038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:20.599086 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db852650-6e99-417c-a6ac-890ba2a26038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:20.599579 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db852650-6e99-417c-a6ac-890ba2a26038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:20.599856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db852650-6e99-417c-a6ac-890ba2a26038 admin admin] PATH_INFO: `/v3/users/0566eac953944d8fac8ce2b88cee0643` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:20.603154 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db852650-6e99-417c-a6ac-890ba2a26038 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0566eac953944d8fac8ce2b88cee0643)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:20.605222 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db852650-6e99-417c-a6ac-890ba2a26038 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:20.673801 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-db852650-6e99-417c-a6ac-890ba2a26038 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0566eac953944d8fac8ce2b88cee0643'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:20.688951 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-db852650-6e99-417c-a6ac-890ba2a26038 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0566eac953944d8fac8ce2b88cee0643'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:20.689993 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-db852650-6e99-417c-a6ac-890ba2a26038 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0566eac953944d8fac8ce2b88cee0643'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:20.698321 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-db852650-6e99-417c-a6ac-890ba2a26038 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0566eac953944d8fac8ce2b88cee0643'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:20.709411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-db852650-6e99-417c-a6ac-890ba2a26038 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0566eac953944d8fac8ce2b88cee0643'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:20.717180 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1297/2567] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:03:20 2022] DELETE /identity/v3/users/0566eac953944d8fac8ce2b88cee0643 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:21.132741 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c467466-d4ea-496d-955f-43b42df2990c admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:21.134439 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-3c467466-d4ea-496d-955f-43b42df2990c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:21.163640 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c467466-d4ea-496d-955f-43b42df2990c admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:21.167791 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:21.170285 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b035684-3209-4d50-95a0-93f4fa7dcba4 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:21.171319 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b035684-3209-4d50-95a0-93f4fa7dcba4 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:21.171668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b035684-3209-4d50-95a0-93f4fa7dcba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:21.210400 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-2b035684-3209-4d50-95a0-93f4fa7dcba4 None None] MFA Rules not processed for user `c498a538726748059f0a71d257129aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:21.211984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-2b035684-3209-4d50-95a0-93f4fa7dcba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:21.254289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f52865-3e27-4b6e-a71d-8460024f0c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:21.255602 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f52865-3e27-4b6e-a71d-8460024f0c82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:21.256067 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f52865-3e27-4b6e-a71d-8460024f0c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:21.256761 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f52865-3e27-4b6e-a71d-8460024f0c82 admin admin] PATH_INFO: `/v3/projects/c3ac41d4804440a7b430172971e7b8c4` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:21.262466 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f52865-3e27-4b6e-a71d-8460024f0c82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3ac41d4804440a7b430172971e7b8c4)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:21.264448 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f52865-3e27-4b6e-a71d-8460024f0c82 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:21.326295 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1298/2568] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:03:21.327090 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b035684-3209-4d50-95a0-93f4fa7dcba4 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:21.330003 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-2b035684-3209-4d50-95a0-93f4fa7dcba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:21.343832 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-d5f52865-3e27-4b6e-a71d-8460024f0c82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3ac41d4804440a7b430172971e7b8c4', 'request_id': 'req-d5f52865-3e27-4b6e-a71d-8460024f0c82'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:21.357360 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-d5f52865-3e27-4b6e-a71d-8460024f0c82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3ac41d4804440a7b430172971e7b8c4', 'request_id': 'req-d5f52865-3e27-4b6e-a71d-8460024f0c82'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:21.358507 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b035684-3209-4d50-95a0-93f4fa7dcba4 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:21.365501 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-d5f52865-3e27-4b6e-a71d-8460024f0c82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3ac41d4804440a7b430172971e7b8c4', 'request_id': 'req-d5f52865-3e27-4b6e-a71d-8460024f0c82'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:21.381455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-d5f52865-3e27-4b6e-a71d-8460024f0c82 admin admin] The token cache is being invalidate because project c3ac41d4804440a7b430172971e7b8c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:03:21.381755 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-d5f52865-3e27-4b6e-a71d-8460024f0c82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:21.382637 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-d5f52865-3e27-4b6e-a71d-8460024f0c82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:21.384783 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1271/2569] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:03:21 2022] DELETE /identity/v3/projects/c3ac41d4804440a7b430172971e7b8c4 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:21.389788 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63770c-6c95-4ff4-bd85-8205e6fffd5f None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:21.390077 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63770c-6c95-4ff4-bd85-8205e6fffd5f None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:21.390372 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63770c-6c95-4ff4-bd85-8205e6fffd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:21.413873 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-ce63770c-6c95-4ff4-bd85-8205e6fffd5f None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:21.415137 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ce63770c-6c95-4ff4-bd85-8205e6fffd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:21.424797 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984fa0b-3cb9-4987-9547-58e8eb805845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:21.425585 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984fa0b-3cb9-4987-9547-58e8eb805845 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:21.425979 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984fa0b-3cb9-4987-9547-58e8eb805845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:21.426940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984fa0b-3cb9-4987-9547-58e8eb805845 admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:21.427661 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984fa0b-3cb9-4987-9547-58e8eb805845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:21.429653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984fa0b-3cb9-4987-9547-58e8eb805845 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:21.435825 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:21.462693 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1299/2570] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:03:21 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:03:21.466207 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984fa0b-3cb9-4987-9547-58e8eb805845 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:21.468569 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-1984fa0b-3cb9-4987-9547-58e8eb805845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:21.485713 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1272/2571] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 11:03:21.493541 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca5ec5-301f-44cd-bf5f-8329c02aee29 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:21.493833 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca5ec5-301f-44cd-bf5f-8329c02aee29 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:21.494106 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca5ec5-301f-44cd-bf5f-8329c02aee29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:21.514549 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-b7ca5ec5-301f-44cd-bf5f-8329c02aee29 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:21.516368 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-b7ca5ec5-301f-44cd-bf5f-8329c02aee29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:21.552593 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984fa0b-3cb9-4987-9547-58e8eb805845 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:21.557002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:21.557765 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9048b1-6873-453b-b9cd-1187d49c1b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:21.558381 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9048b1-6873-453b-b9cd-1187d49c1b10 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:21.558661 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9048b1-6873-453b-b9cd-1187d49c1b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:21.558931 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9048b1-6873-453b-b9cd-1187d49c1b10 admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:21.559562 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9048b1-6873-453b-b9cd-1187d49c1b10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:21.561526 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9048b1-6873-453b-b9cd-1187d49c1b10 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:21.586995 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1300/2572] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:03:21 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:03:21.591156 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9048b1-6873-453b-b9cd-1187d49c1b10 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:21.591301 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1273/2573] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 11:03:21.595775 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca5ec5-301f-44cd-bf5f-8329c02aee29 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:21.602096 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9048b1-6873-453b-b9cd-1187d49c1b10 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:21.605440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca5ec5-301f-44cd-bf5f-8329c02aee29 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:21.607273 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcb55c-d132-435f-8f0f-c06d845df52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:21.607880 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcb55c-d132-435f-8f0f-c06d845df52d admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:21.608161 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcb55c-d132-435f-8f0f-c06d845df52d admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:21.608997 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcb55c-d132-435f-8f0f-c06d845df52d admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:21.609700 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efcb55c-d132-435f-8f0f-c06d845df52d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:21.611111 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813b8a1-75bf-4add-8444-d54ba1a8c1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:21.611315 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efcb55c-d132-435f-8f0f-c06d845df52d admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:21.611715 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813b8a1-75bf-4add-8444-d54ba1a8c1ef admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:21.611993 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813b8a1-75bf-4add-8444-d54ba1a8c1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:21.612908 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813b8a1-75bf-4add-8444-d54ba1a8c1ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:21.613628 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813b8a1-75bf-4add-8444-d54ba1a8c1ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 11:03:21.613937 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813b8a1-75bf-4add-8444-d54ba1a8c1ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:21.615531 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813b8a1-75bf-4add-8444-d54ba1a8c1ef admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:21.622091 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1301/2574] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:03:21.626791 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcb55c-d132-435f-8f0f-c06d845df52d admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:21.631099 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1274/2575] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 11:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 11:03:21.631978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813b8a1-75bf-4add-8444-d54ba1a8c1ef admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:21.638680 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcb55c-d132-435f-8f0f-c06d845df52d admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:21.643087 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813b8a1-75bf-4add-8444-d54ba1a8c1ef admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:21.644704 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399fd175-51d3-4bfa-ae52-11a7be312cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:21.645412 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399fd175-51d3-4bfa-ae52-11a7be312cef admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:21.645695 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399fd175-51d3-4bfa-ae52-11a7be312cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:21.645967 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399fd175-51d3-4bfa-ae52-11a7be312cef admin admin] PATH_INFO: `/v3/projects/f8d45f6b8188470ca3ee12d9e27bf0f3/users/c8e82545df4347b0bc8fd8f17e353d8f/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:21.649555 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca32b8-5870-4c2f-956d-793174cbfa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:21.650160 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca32b8-5870-4c2f-956d-793174cbfa49 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:21.650438 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca32b8-5870-4c2f-956d-793174cbfa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:21.650712 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca32b8-5870-4c2f-956d-793174cbfa49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:21.651393 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ca32b8-5870-4c2f-956d-793174cbfa49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:21.653325 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ca32b8-5870-4c2f-956d-793174cbfa49 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:21.666667 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399fd175-51d3-4bfa-ae52-11a7be312cef admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8d45f6b8188470ca3ee12d9e27bf0f3, user_id=c8e82545df4347b0bc8fd8f17e353d8f, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:21.669424 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399fd175-51d3-4bfa-ae52-11a7be312cef admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:21.690354 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1302/2576] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:03:21 2022] PUT /identity/v3/projects/f8d45f6b8188470ca3ee12d9e27bf0f3/users/c8e82545df4347b0bc8fd8f17e353d8f/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 11:03:21.693734 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1275/2577] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:03:21 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:03:21.695291 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca32b8-5870-4c2f-956d-793174cbfa49 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:21.696361 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399fd175-51d3-4bfa-ae52-11a7be312cef admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:21.803421 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399fd175-51d3-4bfa-ae52-11a7be312cef admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:21.803674 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca32b8-5870-4c2f-956d-793174cbfa49 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:21.819922 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a2a4e-923c-4a1a-93f0-909a51b93c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:21.820703 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a2a4e-923c-4a1a-93f0-909a51b93c81 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:21.821158 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a2a4e-923c-4a1a-93f0-909a51b93c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:21.821530 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a2a4e-923c-4a1a-93f0-909a51b93c81 admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:21.822421 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a2a4e-923c-4a1a-93f0-909a51b93c81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:21.830150 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a2a4e-923c-4a1a-93f0-909a51b93c81 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:21.833081 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf3cab-cb35-4f01-8640-79b386848264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:21.835137 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf3cab-cb35-4f01-8640-79b386848264 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:21.835429 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf3cab-cb35-4f01-8640-79b386848264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:21.835711 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf3cab-cb35-4f01-8640-79b386848264 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:21.836384 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecf3cab-cb35-4f01-8640-79b386848264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:21.838972 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecf3cab-cb35-4f01-8640-79b386848264 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:21.858386 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1303/2578] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:03:21 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:03:21.863859 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a2a4e-923c-4a1a-93f0-909a51b93c81 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:21.870275 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1276/2579] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:03:21.879027 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf3cab-cb35-4f01-8640-79b386848264 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:21.884895 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a2a4e-923c-4a1a-93f0-909a51b93c81 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:21.890807 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b3545-50b2-45f5-8a1a-507e8cdce642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:21.891799 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b3545-50b2-45f5-8a1a-507e8cdce642 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:21.892314 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b3545-50b2-45f5-8a1a-507e8cdce642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:21.892707 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b3545-50b2-45f5-8a1a-507e8cdce642 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:21.893574 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b3545-50b2-45f5-8a1a-507e8cdce642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:21.894226 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf3cab-cb35-4f01-8640-79b386848264 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:21.895327 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b3545-50b2-45f5-8a1a-507e8cdce642 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:21.900348 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e956f-fd56-4f95-9ac0-2f24041f5751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:21.901849 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e956f-fd56-4f95-9ac0-2f24041f5751 admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:21.902125 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e956f-fd56-4f95-9ac0-2f24041f5751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:21.902431 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e956f-fd56-4f95-9ac0-2f24041f5751 admin admin] PATH_INFO: `/v3/projects/f8d45f6b8188470ca3ee12d9e27bf0f3/users/c8e82545df4347b0bc8fd8f17e353d8f/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:21.904700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e956f-fd56-4f95-9ac0-2f24041f5751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8d45f6b8188470ca3ee12d9e27bf0f3, user_id=c8e82545df4347b0bc8fd8f17e353d8f, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:21.907518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e956f-fd56-4f95-9ac0-2f24041f5751 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:21.909188 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1304/2580] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:03:21.913953 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b3545-50b2-45f5-8a1a-507e8cdce642 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:21.933253 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b3545-50b2-45f5-8a1a-507e8cdce642 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:21.933949 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1277/2581] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:03:21 2022] PUT /identity/v3/projects/f8d45f6b8188470ca3ee12d9e27bf0f3/users/c8e82545df4347b0bc8fd8f17e353d8f/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:21.972624 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:22.037107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361b8e1-c9e2-43de-afce-fd469cacf491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:22.038035 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361b8e1-c9e2-43de-afce-fd469cacf491 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:22.038502 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361b8e1-c9e2-43de-afce-fd469cacf491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:22.038834 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361b8e1-c9e2-43de-afce-fd469cacf491 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:22.039623 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361b8e1-c9e2-43de-afce-fd469cacf491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:22.041511 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361b8e1-c9e2-43de-afce-fd469cacf491 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:22.054261 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1305/2582] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 11:03:22.058779 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e956f-fd56-4f95-9ac0-2f24041f5751 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:22.073209 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e956f-fd56-4f95-9ac0-2f24041f5751 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:22.079793 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e9b5a-0315-4cfc-afdf-3416826e8a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:22.080554 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e9b5a-0315-4cfc-afdf-3416826e8a2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:22.081236 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e9b5a-0315-4cfc-afdf-3416826e8a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:22.081236 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e9b5a-0315-4cfc-afdf-3416826e8a2b admin admin] PATH_INFO: `/v3/projects/c81cadd255554af1b7c02a8344d69449/users/6d4e014ce39241ce9bc0fb8105dcbc29/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:22.101374 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e9b5a-0315-4cfc-afdf-3416826e8a2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c81cadd255554af1b7c02a8344d69449, user_id=6d4e014ce39241ce9bc0fb8105dcbc29, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:22.104218 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e9b5a-0315-4cfc-afdf-3416826e8a2b admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:22.120459 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1278/2583] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:03:22 2022] PUT /identity/v3/projects/c81cadd255554af1b7c02a8344d69449/users/6d4e014ce39241ce9bc0fb8105dcbc29/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 11:03:22.132682 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62793f90-d778-4dcb-9f2e-7a277faca510 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:22.132957 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62793f90-d778-4dcb-9f2e-7a277faca510 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:22.133584 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62793f90-d778-4dcb-9f2e-7a277faca510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:22.178965 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-62793f90-d778-4dcb-9f2e-7a277faca510 None None] MFA Rules not processed for user `6d4e014ce39241ce9bc0fb8105dcbc29`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:22.180379 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-62793f90-d778-4dcb-9f2e-7a277faca510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:22.255933 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1306/2584] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:03:22.260092 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e9b5a-0315-4cfc-afdf-3416826e8a2b admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:22.358346 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e9b5a-0315-4cfc-afdf-3416826e8a2b admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:22.365364 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4c0bb-3cac-4fde-999d-1729530bda7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:22.366263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4c0bb-3cac-4fde-999d-1729530bda7e admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:22.366547 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4c0bb-3cac-4fde-999d-1729530bda7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:22.366816 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4c0bb-3cac-4fde-999d-1729530bda7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:22.367457 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4c0bb-3cac-4fde-999d-1729530bda7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:22.369417 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4c0bb-3cac-4fde-999d-1729530bda7e admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:22.382786 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:22.424197 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1279/2585] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:03:22 2022] POST /identity/v3/projects => generated 367 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:03:22.428327 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62793f90-d778-4dcb-9f2e-7a277faca510 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:22.439800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62793f90-d778-4dcb-9f2e-7a277faca510 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:22.510110 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b026d-f1c6-4011-af10-923bc8216313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:22.510927 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b026d-f1c6-4011-af10-923bc8216313 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:22.511204 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b026d-f1c6-4011-af10-923bc8216313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:22.511470 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b026d-f1c6-4011-af10-923bc8216313 admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:22.512098 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b026d-f1c6-4011-af10-923bc8216313 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:22.514077 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b026d-f1c6-4011-af10-923bc8216313 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:22.542750 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1307/2586] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:03:22 2022] POST /identity/v3/users => generated 290 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:03:22.544092 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4c0bb-3cac-4fde-999d-1729530bda7e admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:22.555037 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4c0bb-3cac-4fde-999d-1729530bda7e admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:22.559960 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe06f7-6407-4b86-bb7b-32444567343f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:22.561150 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe06f7-6407-4b86-bb7b-32444567343f admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:22.561150 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe06f7-6407-4b86-bb7b-32444567343f admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:22.561150 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe06f7-6407-4b86-bb7b-32444567343f admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:22.561845 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbe06f7-6407-4b86-bb7b-32444567343f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:22.563462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbe06f7-6407-4b86-bb7b-32444567343f admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:22.580067 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1280/2587] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:03:22.584730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b026d-f1c6-4011-af10-923bc8216313 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:22.596727 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b026d-f1c6-4011-af10-923bc8216313 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:22.601691 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9889fae-c7ce-457d-b154-0bdfa68b218b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:22.602466 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9889fae-c7ce-457d-b154-0bdfa68b218b admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:22.602749 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9889fae-c7ce-457d-b154-0bdfa68b218b admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:22.603086 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9889fae-c7ce-457d-b154-0bdfa68b218b admin admin] PATH_INFO: `/v3/projects/3f9980ae1e25451896142c7689c48663/users/21edcdb390374e8ebdad4ab28f2c7c4f/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:22.619621 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9889fae-c7ce-457d-b154-0bdfa68b218b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f9980ae1e25451896142c7689c48663, user_id=21edcdb390374e8ebdad4ab28f2c7c4f, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:22.622378 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9889fae-c7ce-457d-b154-0bdfa68b218b admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:22.636244 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1308/2588] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:03:22 2022] PUT /identity/v3/projects/3f9980ae1e25451896142c7689c48663/users/21edcdb390374e8ebdad4ab28f2c7c4f/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 11:03:22.641804 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe06f7-6407-4b86-bb7b-32444567343f admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:22.652167 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe06f7-6407-4b86-bb7b-32444567343f admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:22.726699 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821620b-fcfe-43ba-b243-259e44fe751d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:22.727316 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821620b-fcfe-43ba-b243-259e44fe751d admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:22.727589 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821620b-fcfe-43ba-b243-259e44fe751d admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:22.728062 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821620b-fcfe-43ba-b243-259e44fe751d admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:22.728725 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821620b-fcfe-43ba-b243-259e44fe751d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:22.730784 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821620b-fcfe-43ba-b243-259e44fe751d admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:22.743256 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1281/2589] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:03:22.748480 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9889fae-c7ce-457d-b154-0bdfa68b218b admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:22.759371 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9889fae-c7ce-457d-b154-0bdfa68b218b admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:22.767111 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaac7fd-d38c-4736-8418-209c71b1ea72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:22.767816 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaac7fd-d38c-4736-8418-209c71b1ea72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:22.768079 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaac7fd-d38c-4736-8418-209c71b1ea72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:22.769729 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaac7fd-d38c-4736-8418-209c71b1ea72 admin admin] PATH_INFO: `/v3/projects/3f9980ae1e25451896142c7689c48663/users/21edcdb390374e8ebdad4ab28f2c7c4f/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:22.770937 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaac7fd-d38c-4736-8418-209c71b1ea72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f9980ae1e25451896142c7689c48663, user_id=21edcdb390374e8ebdad4ab28f2c7c4f, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:22.775636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaac7fd-d38c-4736-8418-209c71b1ea72 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:22.791543 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:22.804232 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1309/2590] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:03:22 2022] PUT /identity/v3/projects/3f9980ae1e25451896142c7689c48663/users/21edcdb390374e8ebdad4ab28f2c7c4f/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:22.815227 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3086b-7d4c-494d-8197-905af3262ea6 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:22.815511 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3086b-7d4c-494d-8197-905af3262ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:22.815790 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3086b-7d4c-494d-8197-905af3262ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:22.871130 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-eeb3086b-7d4c-494d-8197-905af3262ea6 None None] MFA Rules not processed for user `21edcdb390374e8ebdad4ab28f2c7c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:22.878474 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-eeb3086b-7d4c-494d-8197-905af3262ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:23.028411 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1282/2591] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:22 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 11:03:23.041738 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaac7fd-d38c-4736-8418-209c71b1ea72 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:23.043539 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-bdaac7fd-d38c-4736-8418-209c71b1ea72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:23.141972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaac7fd-d38c-4736-8418-209c71b1ea72 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:23.146161 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac63c8-fc78-4ba8-8f29-812b67e35a1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:23.149174 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac63c8-fc78-4ba8-8f29-812b67e35a1d service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:23.149174 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac63c8-fc78-4ba8-8f29-812b67e35a1d service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:23.149174 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac63c8-fc78-4ba8-8f29-812b67e35a1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:23.166475 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac63c8-fc78-4ba8-8f29-812b67e35a1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:23.168684 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac63c8-fc78-4ba8-8f29-812b67e35a1d service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:23.181522 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1310/2592] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:03:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:03:25.335133 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3086b-7d4c-494d-8197-905af3262ea6 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:25.447555 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:25.470490 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3086b-7d4c-494d-8197-905af3262ea6 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:25.486120 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9c495-a530-4432-892a-807108a4433e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:25.487156 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9c495-a530-4432-892a-807108a4433e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:25.487648 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9c495-a530-4432-892a-807108a4433e admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:25.488284 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9c495-a530-4432-892a-807108a4433e admin admin] PATH_INFO: `/v3/users/6d4e014ce39241ce9bc0fb8105dcbc29` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:25.489835 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9c495-a530-4432-892a-807108a4433e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d4e014ce39241ce9bc0fb8105dcbc29)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:25.492573 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9c495-a530-4432-892a-807108a4433e admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:25.575522 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-a0a9c495-a530-4432-892a-807108a4433e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d4e014ce39241ce9bc0fb8105dcbc29'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:25.590589 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-a0a9c495-a530-4432-892a-807108a4433e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d4e014ce39241ce9bc0fb8105dcbc29'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:25.591883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-a0a9c495-a530-4432-892a-807108a4433e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d4e014ce39241ce9bc0fb8105dcbc29'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:25.601285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-a0a9c495-a530-4432-892a-807108a4433e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d4e014ce39241ce9bc0fb8105dcbc29'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:25.613966 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-a0a9c495-a530-4432-892a-807108a4433e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d4e014ce39241ce9bc0fb8105dcbc29'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:25.630201 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1283/2593] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:03:25 2022] DELETE /identity/v3/users/6d4e014ce39241ce9bc0fb8105dcbc29 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:25.631987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528bce4-8f59-47e3-a111-c5b1f6a84eb4 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:25.632457 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528bce4-8f59-47e3-a111-c5b1f6a84eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:25.632794 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528bce4-8f59-47e3-a111-c5b1f6a84eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:25.668010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-8528bce4-8f59-47e3-a111-c5b1f6a84eb4 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:25.669366 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-8528bce4-8f59-47e3-a111-c5b1f6a84eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:25.780029 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1311/2594] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:03:25.791637 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9c495-a530-4432-892a-807108a4433e admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:25.793103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a0a9c495-a530-4432-892a-807108a4433e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:25.868622 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9c495-a530-4432-892a-807108a4433e admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:25.872665 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0e701-d14d-465b-a476-93d4a1734c24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:25.873278 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0e701-d14d-465b-a476-93d4a1734c24 service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:25.873591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0e701-d14d-465b-a476-93d4a1734c24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:25.873862 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0e701-d14d-465b-a476-93d4a1734c24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:25.885721 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0e701-d14d-465b-a476-93d4a1734c24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:25.887629 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0e701-d14d-465b-a476-93d4a1734c24 service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:25.900309 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1284/2595] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:03:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:03:26.387260 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528bce4-8f59-47e3-a111-c5b1f6a84eb4 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:26.388769 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-8528bce4-8f59-47e3-a111-c5b1f6a84eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:26.402654 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528bce4-8f59-47e3-a111-c5b1f6a84eb4 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:26.408540 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2daa68-09ac-44d0-85df-6312b50d69ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:26.409183 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2daa68-09ac-44d0-85df-6312b50d69ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:26.409492 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2daa68-09ac-44d0-85df-6312b50d69ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:26.409765 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2daa68-09ac-44d0-85df-6312b50d69ce admin admin] PATH_INFO: `/v3/projects/c81cadd255554af1b7c02a8344d69449` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:26.411105 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2daa68-09ac-44d0-85df-6312b50d69ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=c81cadd255554af1b7c02a8344d69449)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:26.413027 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2daa68-09ac-44d0-85df-6312b50d69ce admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:26.504837 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-5a2daa68-09ac-44d0-85df-6312b50d69ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c81cadd255554af1b7c02a8344d69449', 'request_id': 'req-5a2daa68-09ac-44d0-85df-6312b50d69ce'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:26.513188 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-5a2daa68-09ac-44d0-85df-6312b50d69ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c81cadd255554af1b7c02a8344d69449', 'request_id': 'req-5a2daa68-09ac-44d0-85df-6312b50d69ce'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:26.524096 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-5a2daa68-09ac-44d0-85df-6312b50d69ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c81cadd255554af1b7c02a8344d69449', 'request_id': 'req-5a2daa68-09ac-44d0-85df-6312b50d69ce'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:26.540678 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-5a2daa68-09ac-44d0-85df-6312b50d69ce admin admin] The token cache is being invalidate because project c81cadd255554af1b7c02a8344d69449 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:03:26.540678 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-5a2daa68-09ac-44d0-85df-6312b50d69ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:26.541415 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-5a2daa68-09ac-44d0-85df-6312b50d69ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:26.543681 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1312/2596] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:03:26 2022] DELETE /identity/v3/projects/c81cadd255554af1b7c02a8344d69449 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:26.548995 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0e701-d14d-465b-a476-93d4a1734c24 service neutron] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:26.576343 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0e701-d14d-465b-a476-93d4a1734c24 service neutron] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:26.672342 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98688d3-f904-460c-8c49-7a0238543767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:26.673190 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98688d3-f904-460c-8c49-7a0238543767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:26.673636 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98688d3-f904-460c-8c49-7a0238543767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:26.673868 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98688d3-f904-460c-8c49-7a0238543767 admin admin] PATH_INFO: `/v3/users/21edcdb390374e8ebdad4ab28f2c7c4f` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:26.675802 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98688d3-f904-460c-8c49-7a0238543767 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21edcdb390374e8ebdad4ab28f2c7c4f)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:26.678823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98688d3-f904-460c-8c49-7a0238543767 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:26.711775 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:26.753209 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-e98688d3-f904-460c-8c49-7a0238543767 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21edcdb390374e8ebdad4ab28f2c7c4f'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:26.769689 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-e98688d3-f904-460c-8c49-7a0238543767 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21edcdb390374e8ebdad4ab28f2c7c4f'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:26.770591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-e98688d3-f904-460c-8c49-7a0238543767 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21edcdb390374e8ebdad4ab28f2c7c4f'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:26.785026 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-e98688d3-f904-460c-8c49-7a0238543767 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21edcdb390374e8ebdad4ab28f2c7c4f'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:26.796986 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-e98688d3-f904-460c-8c49-7a0238543767 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21edcdb390374e8ebdad4ab28f2c7c4f'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:26.809055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1285/2597] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:03:26 2022] DELETE /identity/v3/users/21edcdb390374e8ebdad4ab28f2c7c4f => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:27.282022 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2daa68-09ac-44d0-85df-6312b50d69ce admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:27.284077 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-5a2daa68-09ac-44d0-85df-6312b50d69ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:27.317705 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2daa68-09ac-44d0-85df-6312b50d69ce admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:27.379387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:27.449198 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa8db6-af5a-4dab-8271-cf67c22ec091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:27.449868 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa8db6-af5a-4dab-8271-cf67c22ec091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:27.450460 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa8db6-af5a-4dab-8271-cf67c22ec091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:27.450928 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa8db6-af5a-4dab-8271-cf67c22ec091 admin admin] PATH_INFO: `/v3/projects/3f9980ae1e25451896142c7689c48663` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:27.452337 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa8db6-af5a-4dab-8271-cf67c22ec091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f9980ae1e25451896142c7689c48663)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:27.455043 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa8db6-af5a-4dab-8271-cf67c22ec091 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:27.507307 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd07ad2-ae14-48bc-9da4-c246fa7ba2a1 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:27.507679 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd07ad2-ae14-48bc-9da4-c246fa7ba2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:27.508024 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd07ad2-ae14-48bc-9da4-c246fa7ba2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:27.538053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-b1fa8db6-af5a-4dab-8271-cf67c22ec091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f9980ae1e25451896142c7689c48663', 'request_id': 'req-b1fa8db6-af5a-4dab-8271-cf67c22ec091'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:27.552021 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-b1fa8db6-af5a-4dab-8271-cf67c22ec091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f9980ae1e25451896142c7689c48663', 'request_id': 'req-b1fa8db6-af5a-4dab-8271-cf67c22ec091'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:27.563827 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-4bd07ad2-ae14-48bc-9da4-c246fa7ba2a1 None None] MFA Rules not processed for user `e7eebb4bd7e04ff8bc4304a40cf6ba35`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:27.574878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-b1fa8db6-af5a-4dab-8271-cf67c22ec091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f9980ae1e25451896142c7689c48663', 'request_id': 'req-b1fa8db6-af5a-4dab-8271-cf67c22ec091'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:27.575070 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-4bd07ad2-ae14-48bc-9da4-c246fa7ba2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:27.595613 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-b1fa8db6-af5a-4dab-8271-cf67c22ec091 admin admin] The token cache is being invalidate because project 3f9980ae1e25451896142c7689c48663 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:03:27.596244 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-b1fa8db6-af5a-4dab-8271-cf67c22ec091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:27.597279 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-b1fa8db6-af5a-4dab-8271-cf67c22ec091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:27.599575 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1313/2598] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:03:27 2022] DELETE /identity/v3/projects/3f9980ae1e25451896142c7689c48663 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:27.606720 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464b695-24a3-423c-9ea5-5b5daed2def8 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:27.607338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464b695-24a3-423c-9ea5-5b5daed2def8 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:27.607971 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464b695-24a3-423c-9ea5-5b5daed2def8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:27.634208 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-4464b695-24a3-423c-9ea5-5b5daed2def8 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:27.636226 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-4464b695-24a3-423c-9ea5-5b5daed2def8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:27.652644 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1286/2599] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 7 11:03:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:03:27.670637 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394b633-c537-43e2-9f1f-6d583b93f202 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:27.670873 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394b633-c537-43e2-9f1f-6d583b93f202 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:27.672025 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394b633-c537-43e2-9f1f-6d583b93f202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:27.720251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-d394b633-c537-43e2-9f1f-6d583b93f202 None None] MFA Rules not processed for user `c8e82545df4347b0bc8fd8f17e353d8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:27.721861 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-d394b633-c537-43e2-9f1f-6d583b93f202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:27.733357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1314/2600] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:03:27.733357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464b695-24a3-423c-9ea5-5b5daed2def8 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:27.733357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-4464b695-24a3-423c-9ea5-5b5daed2def8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:27.796668 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:27.809606 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1287/2601] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:03:27.812505 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641e377-f332-4870-b050-cd846545261f None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:27.812987 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641e377-f332-4870-b050-cd846545261f None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:27.813437 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641e377-f332-4870-b050-cd846545261f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:27.820644 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464b695-24a3-423c-9ea5-5b5daed2def8 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:27.826067 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc967d1c-11b9-472e-97b2-25b9dbefe1de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7181e5118c547a3a31d2e080c25ff01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:27.826679 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc967d1c-11b9-472e-97b2-25b9dbefe1de service swift] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:27.826960 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc967d1c-11b9-472e-97b2-25b9dbefe1de service swift] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:27.827775 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc967d1c-11b9-472e-97b2-25b9dbefe1de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:27.836458 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc967d1c-11b9-472e-97b2-25b9dbefe1de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:27.836634 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-b641e377-f332-4870-b050-cd846545261f None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:27.837999 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-b641e377-f332-4870-b050-cd846545261f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:27.838285 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc967d1c-11b9-472e-97b2-25b9dbefe1de service swift] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:27.847509 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1315/2602] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 7 11:03:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 11:03:27.849342 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1288/2603] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:03:27.855950 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc967d1c-11b9-472e-97b2-25b9dbefe1de service swift] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:27.856229 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641e377-f332-4870-b050-cd846545261f None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:27.857426 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-cc967d1c-11b9-472e-97b2-25b9dbefe1de service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:27.883021 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641e377-f332-4870-b050-cd846545261f None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:27.899631 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee5cec-2527-45c0-a334-28c4f9c5d397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:27.900279 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee5cec-2527-45c0-a334-28c4f9c5d397 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:27.900558 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee5cec-2527-45c0-a334-28c4f9c5d397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:27.900832 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee5cec-2527-45c0-a334-28c4f9c5d397 admin admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:27.901968 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee5cec-2527-45c0-a334-28c4f9c5d397 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 11:03:27.901968 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee5cec-2527-45c0-a334-28c4f9c5d397 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:27.903456 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee5cec-2527-45c0-a334-28c4f9c5d397 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:27.929014 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:27.940488 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1289/2604] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 11:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 11:03:27.942590 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee5cec-2527-45c0-a334-28c4f9c5d397 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:27.962437 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee5cec-2527-45c0-a334-28c4f9c5d397 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:27.975302 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9bb9a-1f2c-4ef7-b03f-d5ddc7295372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:27.975926 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9bb9a-1f2c-4ef7-b03f-d5ddc7295372 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:27.976212 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9bb9a-1f2c-4ef7-b03f-d5ddc7295372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:27.976480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9bb9a-1f2c-4ef7-b03f-d5ddc7295372 admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:27.977177 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9bb9a-1f2c-4ef7-b03f-d5ddc7295372 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:27.979183 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9bb9a-1f2c-4ef7-b03f-d5ddc7295372 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:27.989151 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc967d1c-11b9-472e-97b2-25b9dbefe1de service swift] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:28.001718 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca67a7f-95ec-4a1b-a03f-bd8ba5c0eeef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:28.002470 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca67a7f-95ec-4a1b-a03f-bd8ba5c0eeef service nova] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:28.002866 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca67a7f-95ec-4a1b-a03f-bd8ba5c0eeef service nova] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:28.003233 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca67a7f-95ec-4a1b-a03f-bd8ba5c0eeef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:28.006650 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-0ca67a7f-95ec-4a1b-a03f-bd8ba5c0eeef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:28.036065 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1290/2605] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:03:27 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:03:28.040311 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9bb9a-1f2c-4ef7-b03f-d5ddc7295372 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:28.138364 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca67a7f-95ec-4a1b-a03f-bd8ba5c0eeef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:28.140817 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca67a7f-95ec-4a1b-a03f-bd8ba5c0eeef service nova] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:28.158818 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9bb9a-1f2c-4ef7-b03f-d5ddc7295372 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:28.164619 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc88d6b-224b-44ce-980c-f30da837a721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:28.165240 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc88d6b-224b-44ce-980c-f30da837a721 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:28.165570 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc88d6b-224b-44ce-980c-f30da837a721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:28.165988 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc88d6b-224b-44ce-980c-f30da837a721 admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:28.166628 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc88d6b-224b-44ce-980c-f30da837a721 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:28.167201 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1316/2606] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:03:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:03:28.171600 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc88d6b-224b-44ce-980c-f30da837a721 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:28.230878 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1291/2607] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:03:28 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 11:03:28.235193 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca67a7f-95ec-4a1b-a03f-bd8ba5c0eeef service nova] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:28.247347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca67a7f-95ec-4a1b-a03f-bd8ba5c0eeef service nova] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:28.259009 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a762cc0-916c-4d9b-a1c9-3b3865d4ca84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:28.259777 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a762cc0-916c-4d9b-a1c9-3b3865d4ca84 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:28.260149 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a762cc0-916c-4d9b-a1c9-3b3865d4ca84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:28.260511 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a762cc0-916c-4d9b-a1c9-3b3865d4ca84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:28.263119 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a762cc0-916c-4d9b-a1c9-3b3865d4ca84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:28.263119 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a762cc0-916c-4d9b-a1c9-3b3865d4ca84 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:28.296744 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1317/2608] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:03:28.300538 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc88d6b-224b-44ce-980c-f30da837a721 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:28.313106 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc88d6b-224b-44ce-980c-f30da837a721 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:28.318207 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accfca4-8832-4333-90b1-05e558eebac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:28.318825 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accfca4-8832-4333-90b1-05e558eebac3 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:28.319105 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accfca4-8832-4333-90b1-05e558eebac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:28.319522 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accfca4-8832-4333-90b1-05e558eebac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:28.320209 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5accfca4-8832-4333-90b1-05e558eebac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:28.321852 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5accfca4-8832-4333-90b1-05e558eebac3 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:28.347173 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1292/2609] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:03:28.350826 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a762cc0-916c-4d9b-a1c9-3b3865d4ca84 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:28.371509 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a762cc0-916c-4d9b-a1c9-3b3865d4ca84 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:28.385177 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0d946-474c-4772-9df7-af529d2c05e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:28.386689 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0d946-474c-4772-9df7-af529d2c05e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:28.387209 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0d946-474c-4772-9df7-af529d2c05e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:28.387695 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0d946-474c-4772-9df7-af529d2c05e2 admin admin] PATH_INFO: `/v3/projects/fd7735f07ee04bfe8a6b2fc46713cc41/users/ecc0153abade4f3c94589f28415e608b/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:28.410739 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a0d946-474c-4772-9df7-af529d2c05e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd7735f07ee04bfe8a6b2fc46713cc41, user_id=ecc0153abade4f3c94589f28415e608b, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:28.414196 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a0d946-474c-4772-9df7-af529d2c05e2 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:28.448393 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1318/2610] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:03:28 2022] PUT /identity/v3/projects/fd7735f07ee04bfe8a6b2fc46713cc41/users/ecc0153abade4f3c94589f28415e608b/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:28.462656 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58dacc-1d84-4db9-9b22-ba63ec5d3147 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:28.463229 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58dacc-1d84-4db9-9b22-ba63ec5d3147 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:28.463749 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58dacc-1d84-4db9-9b22-ba63ec5d3147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:28.509734 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-da58dacc-1d84-4db9-9b22-ba63ec5d3147 None None] MFA Rules not processed for user `ecc0153abade4f3c94589f28415e608b`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:28.514200 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-da58dacc-1d84-4db9-9b22-ba63ec5d3147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:28.653429 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1293/2611] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:03:28.654084 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0d946-474c-4772-9df7-af529d2c05e2 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:28.746136 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:28.779011 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0d946-474c-4772-9df7-af529d2c05e2 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:28.794371 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225ff06-e908-4363-9a91-196582d271e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:28.795260 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225ff06-e908-4363-9a91-196582d271e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:28.795896 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225ff06-e908-4363-9a91-196582d271e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:28.796455 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225ff06-e908-4363-9a91-196582d271e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:28.797289 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225ff06-e908-4363-9a91-196582d271e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:28.799504 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225ff06-e908-4363-9a91-196582d271e5 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:28.845948 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1319/2612] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:03:28 2022] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:03:28.851688 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58dacc-1d84-4db9-9b22-ba63ec5d3147 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:28.878357 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58dacc-1d84-4db9-9b22-ba63ec5d3147 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:28.989291 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:29.029491 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f9ec9-3ff8-40c3-a695-1a768316b3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:29.030116 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f9ec9-3ff8-40c3-a695-1a768316b3ef admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:29.030922 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f9ec9-3ff8-40c3-a695-1a768316b3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:29.031260 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f9ec9-3ff8-40c3-a695-1a768316b3ef admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:29.031892 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f9ec9-3ff8-40c3-a695-1a768316b3ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:29.034406 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f9ec9-3ff8-40c3-a695-1a768316b3ef admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:29.081840 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1294/2613] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:03:28 2022] POST /identity/v3/users => generated 299 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 11:03:29.086447 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225ff06-e908-4363-9a91-196582d271e5 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:29.109244 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225ff06-e908-4363-9a91-196582d271e5 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:29.132047 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a738be8-aa00-4a7a-9a31-d499803e18b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:29.132795 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a738be8-aa00-4a7a-9a31-d499803e18b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:29.133397 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a738be8-aa00-4a7a-9a31-d499803e18b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:29.133766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a738be8-aa00-4a7a-9a31-d499803e18b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:29.134520 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a738be8-aa00-4a7a-9a31-d499803e18b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:29.137174 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a738be8-aa00-4a7a-9a31-d499803e18b9 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:29.177104 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1320/2614] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:03:29.181115 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f9ec9-3ff8-40c3-a695-1a768316b3ef admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:29.193092 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f9ec9-3ff8-40c3-a695-1a768316b3ef admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:29.201676 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13611be-a2e8-491d-9259-f21776ec435e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:29.202919 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13611be-a2e8-491d-9259-f21776ec435e admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:29.203203 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13611be-a2e8-491d-9259-f21776ec435e admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:29.203513 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13611be-a2e8-491d-9259-f21776ec435e admin admin] PATH_INFO: `/v3/projects/d62843debb9842a3950b35663c03ebd8/users/5ec9b964f49c419189d6239e85f1a992/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:29.232814 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13611be-a2e8-491d-9259-f21776ec435e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d62843debb9842a3950b35663c03ebd8, user_id=5ec9b964f49c419189d6239e85f1a992, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:29.237102 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13611be-a2e8-491d-9259-f21776ec435e admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:29.282966 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1295/2615] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:03:29 2022] PUT /identity/v3/projects/d62843debb9842a3950b35663c03ebd8/users/5ec9b964f49c419189d6239e85f1a992/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:29.284625 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a738be8-aa00-4a7a-9a31-d499803e18b9 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:29.303216 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a738be8-aa00-4a7a-9a31-d499803e18b9 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:29.415626 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8426e8-bc09-44f7-8ad7-62cdaa029c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:29.416298 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8426e8-bc09-44f7-8ad7-62cdaa029c20 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:29.416573 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8426e8-bc09-44f7-8ad7-62cdaa029c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:29.416843 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8426e8-bc09-44f7-8ad7-62cdaa029c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:29.417854 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8426e8-bc09-44f7-8ad7-62cdaa029c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:29.419877 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8426e8-bc09-44f7-8ad7-62cdaa029c20 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:29.445658 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1321/2616] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 11:03:29.447570 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13611be-a2e8-491d-9259-f21776ec435e admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:29.486917 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13611be-a2e8-491d-9259-f21776ec435e admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:29.503992 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d457190-65bd-43a6-8185-010881b41f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:29.507147 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d457190-65bd-43a6-8185-010881b41f0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:29.508743 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d457190-65bd-43a6-8185-010881b41f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:29.509047 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d457190-65bd-43a6-8185-010881b41f0d admin admin] PATH_INFO: `/v3/projects/d62843debb9842a3950b35663c03ebd8/users/5ec9b964f49c419189d6239e85f1a992/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:29.517815 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d457190-65bd-43a6-8185-010881b41f0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d62843debb9842a3950b35663c03ebd8, user_id=5ec9b964f49c419189d6239e85f1a992, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:29.534597 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d457190-65bd-43a6-8185-010881b41f0d admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:29.586982 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1296/2617] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:03:29 2022] PUT /identity/v3/projects/d62843debb9842a3950b35663c03ebd8/users/5ec9b964f49c419189d6239e85f1a992/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:29.598688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8260f37-8552-40c3-be05-a7fe1b945a7a None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:29.599226 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8260f37-8552-40c3-be05-a7fe1b945a7a None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:29.599658 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8260f37-8552-40c3-be05-a7fe1b945a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:29.654917 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-f8260f37-8552-40c3-be05-a7fe1b945a7a None None] MFA Rules not processed for user `5ec9b964f49c419189d6239e85f1a992`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:29.657006 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-f8260f37-8552-40c3-be05-a7fe1b945a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:29.759934 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1322/2618] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:29 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:03:29.772328 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d457190-65bd-43a6-8185-010881b41f0d admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:29.774962 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-1d457190-65bd-43a6-8185-010881b41f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:29.891071 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d457190-65bd-43a6-8185-010881b41f0d admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:29.895289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d4e06-a7e9-4bb2-bc16-297b7efe90de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:29.896076 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d4e06-a7e9-4bb2-bc16-297b7efe90de service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:29.896528 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d4e06-a7e9-4bb2-bc16-297b7efe90de service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:29.896946 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d4e06-a7e9-4bb2-bc16-297b7efe90de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:30.001172 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d4e06-a7e9-4bb2-bc16-297b7efe90de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:30.004493 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d4e06-a7e9-4bb2-bc16-297b7efe90de service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:30.029499 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1297/2619] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:03:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:03:30.063020 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f3d3d-7a52-4705-b042-8477e8943499 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:30.063284 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f3d3d-7a52-4705-b042-8477e8943499 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:30.063557 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f3d3d-7a52-4705-b042-8477e8943499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:30.088874 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-225f3d3d-7a52-4705-b042-8477e8943499 None None] MFA Rules not processed for user `c498a538726748059f0a71d257129aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:30.090738 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-225f3d3d-7a52-4705-b042-8477e8943499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:30.162205 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:30.189122 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1323/2620] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:03:34.792607 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d4e06-a7e9-4bb2-bc16-297b7efe90de service cinder] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:34.803150 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d4e06-a7e9-4bb2-bc16-297b7efe90de service cinder] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:34.807155 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b362db7f-88ec-42df-b578-a0aaa3a72e1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:34.808045 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362db7f-88ec-42df-b578-a0aaa3a72e1a service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:34.808561 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362db7f-88ec-42df-b578-a0aaa3a72e1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:34.808920 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362db7f-88ec-42df-b578-a0aaa3a72e1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:34.819376 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362db7f-88ec-42df-b578-a0aaa3a72e1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:34.820872 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b362db7f-88ec-42df-b578-a0aaa3a72e1a service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:34.833920 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1298/2621] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:03:34 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:03:40.054112 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f3d3d-7a52-4705-b042-8477e8943499 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:40.120839 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f3d3d-7a52-4705-b042-8477e8943499 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:40.126581 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af02b01-7648-43af-8b66-7ab2b5d8c832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:40.127344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af02b01-7648-43af-8b66-7ab2b5d8c832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:40.127660 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af02b01-7648-43af-8b66-7ab2b5d8c832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:40.127963 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af02b01-7648-43af-8b66-7ab2b5d8c832 admin admin] PATH_INFO: `/v3/users/ecc0153abade4f3c94589f28415e608b` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:40.129257 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af02b01-7648-43af-8b66-7ab2b5d8c832 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecc0153abade4f3c94589f28415e608b)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:40.131418 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af02b01-7648-43af-8b66-7ab2b5d8c832 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:40.184592 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-8af02b01-7648-43af-8b66-7ab2b5d8c832 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecc0153abade4f3c94589f28415e608b'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:40.198740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-8af02b01-7648-43af-8b66-7ab2b5d8c832 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecc0153abade4f3c94589f28415e608b'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:40.199476 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-8af02b01-7648-43af-8b66-7ab2b5d8c832 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecc0153abade4f3c94589f28415e608b'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:40.207609 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-8af02b01-7648-43af-8b66-7ab2b5d8c832 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecc0153abade4f3c94589f28415e608b'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:40.214888 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-8af02b01-7648-43af-8b66-7ab2b5d8c832 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecc0153abade4f3c94589f28415e608b'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:40.221049 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1324/2622] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:03:40 2022] DELETE /identity/v3/users/ecc0153abade4f3c94589f28415e608b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:40.226032 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcbf0f-6c0a-421b-b796-0d1cf347a45b None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:40.226538 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcbf0f-6c0a-421b-b796-0d1cf347a45b None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:40.226658 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcbf0f-6c0a-421b-b796-0d1cf347a45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:40.376028 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-13fcbf0f-6c0a-421b-b796-0d1cf347a45b None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:40.377386 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-13fcbf0f-6c0a-421b-b796-0d1cf347a45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:40.413728 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:40.450265 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1299/2623] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 11:03:40.463185 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af02b01-7648-43af-8b66-7ab2b5d8c832 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:40.464689 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-8af02b01-7648-43af-8b66-7ab2b5d8c832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:40.535547 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af02b01-7648-43af-8b66-7ab2b5d8c832 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:40.540466 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8751e-89ad-4c20-90ed-86248f920d86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:40.541291 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8751e-89ad-4c20-90ed-86248f920d86 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:40.541599 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8751e-89ad-4c20-90ed-86248f920d86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:40.541859 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8751e-89ad-4c20-90ed-86248f920d86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:40.554868 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8751e-89ad-4c20-90ed-86248f920d86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:40.557283 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8751e-89ad-4c20-90ed-86248f920d86 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:40.571359 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1325/2624] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:03:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 11:03:40.865630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcbf0f-6c0a-421b-b796-0d1cf347a45b None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:40.867710 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-13fcbf0f-6c0a-421b-b796-0d1cf347a45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:40.880928 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcbf0f-6c0a-421b-b796-0d1cf347a45b None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:40.887008 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df591943-60c5-4090-b7b4-d22ddf5c1fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:40.887870 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df591943-60c5-4090-b7b4-d22ddf5c1fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:40.888139 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df591943-60c5-4090-b7b4-d22ddf5c1fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:40.888405 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df591943-60c5-4090-b7b4-d22ddf5c1fd7 admin admin] PATH_INFO: `/v3/projects/fd7735f07ee04bfe8a6b2fc46713cc41` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:40.889630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df591943-60c5-4090-b7b4-d22ddf5c1fd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd7735f07ee04bfe8a6b2fc46713cc41)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:40.892505 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df591943-60c5-4090-b7b4-d22ddf5c1fd7 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:40.943347 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-df591943-60c5-4090-b7b4-d22ddf5c1fd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd7735f07ee04bfe8a6b2fc46713cc41', 'request_id': 'req-df591943-60c5-4090-b7b4-d22ddf5c1fd7'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:40.949096 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-df591943-60c5-4090-b7b4-d22ddf5c1fd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd7735f07ee04bfe8a6b2fc46713cc41', 'request_id': 'req-df591943-60c5-4090-b7b4-d22ddf5c1fd7'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:40.956366 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-df591943-60c5-4090-b7b4-d22ddf5c1fd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd7735f07ee04bfe8a6b2fc46713cc41', 'request_id': 'req-df591943-60c5-4090-b7b4-d22ddf5c1fd7'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:40.969460 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-df591943-60c5-4090-b7b4-d22ddf5c1fd7 admin admin] The token cache is being invalidate because project fd7735f07ee04bfe8a6b2fc46713cc41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:03:40.969725 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-df591943-60c5-4090-b7b4-d22ddf5c1fd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:40.970457 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-df591943-60c5-4090-b7b4-d22ddf5c1fd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:40.971927 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1300/2625] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:03:40 2022] DELETE /identity/v3/projects/fd7735f07ee04bfe8a6b2fc46713cc41 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:40.976008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8751e-89ad-4c20-90ed-86248f920d86 service neutron] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:40.987690 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8751e-89ad-4c20-90ed-86248f920d86 service neutron] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:40.995141 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:41.055666 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99854e9-b069-490d-bb91-5a2ebc27815e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:41.056374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99854e9-b069-490d-bb91-5a2ebc27815e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:41.056554 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99854e9-b069-490d-bb91-5a2ebc27815e admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:41.056824 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99854e9-b069-490d-bb91-5a2ebc27815e admin admin] PATH_INFO: `/v3/users/5ec9b964f49c419189d6239e85f1a992` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:41.057970 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99854e9-b069-490d-bb91-5a2ebc27815e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ec9b964f49c419189d6239e85f1a992)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:41.059906 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99854e9-b069-490d-bb91-5a2ebc27815e admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:41.112722 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-b99854e9-b069-490d-bb91-5a2ebc27815e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ec9b964f49c419189d6239e85f1a992'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:41.127321 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-b99854e9-b069-490d-bb91-5a2ebc27815e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ec9b964f49c419189d6239e85f1a992'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:41.128284 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-b99854e9-b069-490d-bb91-5a2ebc27815e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ec9b964f49c419189d6239e85f1a992'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:41.136290 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-b99854e9-b069-490d-bb91-5a2ebc27815e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ec9b964f49c419189d6239e85f1a992'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:41.144691 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-b99854e9-b069-490d-bb91-5a2ebc27815e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ec9b964f49c419189d6239e85f1a992'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:41.151115 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1326/2626] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:03:40 2022] DELETE /identity/v3/users/5ec9b964f49c419189d6239e85f1a992 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:41.446170 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df591943-60c5-4090-b7b4-d22ddf5c1fd7 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:41.447716 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-df591943-60c5-4090-b7b4-d22ddf5c1fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:41.461508 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df591943-60c5-4090-b7b4-d22ddf5c1fd7 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:41.523671 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eab420-b57c-4d83-a4ae-17bbee55504b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:41.524298 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eab420-b57c-4d83-a4ae-17bbee55504b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:41.524578 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eab420-b57c-4d83-a4ae-17bbee55504b admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:41.524846 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eab420-b57c-4d83-a4ae-17bbee55504b admin admin] PATH_INFO: `/v3/projects/d62843debb9842a3950b35663c03ebd8` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:41.525975 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eab420-b57c-4d83-a4ae-17bbee55504b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d62843debb9842a3950b35663c03ebd8)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:41.527854 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eab420-b57c-4d83-a4ae-17bbee55504b admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:41.573097 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-84eab420-b57c-4d83-a4ae-17bbee55504b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd62843debb9842a3950b35663c03ebd8', 'request_id': 'req-84eab420-b57c-4d83-a4ae-17bbee55504b'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:41.579883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-84eab420-b57c-4d83-a4ae-17bbee55504b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd62843debb9842a3950b35663c03ebd8', 'request_id': 'req-84eab420-b57c-4d83-a4ae-17bbee55504b'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:41.586743 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-84eab420-b57c-4d83-a4ae-17bbee55504b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd62843debb9842a3950b35663c03ebd8', 'request_id': 'req-84eab420-b57c-4d83-a4ae-17bbee55504b'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:41.591277 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:41.602131 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-84eab420-b57c-4d83-a4ae-17bbee55504b admin admin] The token cache is being invalidate because project d62843debb9842a3950b35663c03ebd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:03:41.602762 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-84eab420-b57c-4d83-a4ae-17bbee55504b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:41.603903 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-84eab420-b57c-4d83-a4ae-17bbee55504b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:41.605692 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1301/2627] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:03:41 2022] DELETE /identity/v3/projects/d62843debb9842a3950b35663c03ebd8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:41.611949 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509cd273-e63f-4848-b78c-5a38f012d6b8 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:41.612230 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509cd273-e63f-4848-b78c-5a38f012d6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:41.612497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509cd273-e63f-4848-b78c-5a38f012d6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:41.632734 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-509cd273-e63f-4848-b78c-5a38f012d6b8 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:41.634048 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-509cd273-e63f-4848-b78c-5a38f012d6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:41.701084 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1327/2628] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:03:41.710884 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e01e80-ba80-4e34-9df9-f2fc0375a3aa None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:41.711160 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e01e80-ba80-4e34-9df9-f2fc0375a3aa None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:41.711425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e01e80-ba80-4e34-9df9-f2fc0375a3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:41.731620 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-19e01e80-ba80-4e34-9df9-f2fc0375a3aa None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:41.732809 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-19e01e80-ba80-4e34-9df9-f2fc0375a3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:41.740605 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1302/2629] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:03:41.744922 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509cd273-e63f-4848-b78c-5a38f012d6b8 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:41.755157 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509cd273-e63f-4848-b78c-5a38f012d6b8 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:41.759735 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4e2af-68c5-4fbf-a457-1e8640b7def4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:41.760295 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4e2af-68c5-4fbf-a457-1e8640b7def4 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:41.760572 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4e2af-68c5-4fbf-a457-1e8640b7def4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:41.760839 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4e2af-68c5-4fbf-a457-1e8640b7def4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:41.761574 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4e2af-68c5-4fbf-a457-1e8640b7def4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 11:03:41.761847 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4e2af-68c5-4fbf-a457-1e8640b7def4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:41.763409 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4e2af-68c5-4fbf-a457-1e8640b7def4 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:41.776166 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1328/2630] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 11:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 11:03:41.780436 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e01e80-ba80-4e34-9df9-f2fc0375a3aa None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:41.789641 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e01e80-ba80-4e34-9df9-f2fc0375a3aa None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:41.794193 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45217851-56c8-49e9-b720-cace7d3b7ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:41.794771 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45217851-56c8-49e9-b720-cace7d3b7ead admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:41.795042 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45217851-56c8-49e9-b720-cace7d3b7ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:41.795304 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45217851-56c8-49e9-b720-cace7d3b7ead admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:41.795919 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45217851-56c8-49e9-b720-cace7d3b7ead admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:41.797795 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45217851-56c8-49e9-b720-cace7d3b7ead admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:41.824193 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1303/2631] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:03:41 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 11:03:41.828794 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4e2af-68c5-4fbf-a457-1e8640b7def4 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:41.838580 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4e2af-68c5-4fbf-a457-1e8640b7def4 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:41.849768 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:41.897122 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5ce16-62fb-4a20-9d6a-feb626a8feae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:41.897747 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5ce16-62fb-4a20-9d6a-feb626a8feae admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:41.898023 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5ce16-62fb-4a20-9d6a-feb626a8feae admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:41.898294 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5ce16-62fb-4a20-9d6a-feb626a8feae admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:41.898920 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5ce16-62fb-4a20-9d6a-feb626a8feae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:41.900807 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5ce16-62fb-4a20-9d6a-feb626a8feae admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:41.922179 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1329/2632] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:03:41 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:03:41.926814 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45217851-56c8-49e9-b720-cace7d3b7ead admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:41.937688 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45217851-56c8-49e9-b720-cace7d3b7ead admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:41.942595 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d369a2c-0ec1-4b4a-94f4-042648820217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:41.943175 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d369a2c-0ec1-4b4a-94f4-042648820217 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:41.943449 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d369a2c-0ec1-4b4a-94f4-042648820217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:41.943718 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d369a2c-0ec1-4b4a-94f4-042648820217 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:41.944404 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d369a2c-0ec1-4b4a-94f4-042648820217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:41.946457 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d369a2c-0ec1-4b4a-94f4-042648820217 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:41.957341 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1304/2633] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:03:41.960993 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5ce16-62fb-4a20-9d6a-feb626a8feae admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:41.971497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5ce16-62fb-4a20-9d6a-feb626a8feae admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:41.976073 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8dcc4d-9a35-4e11-8947-ae4afb8f3230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:41.976646 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8dcc4d-9a35-4e11-8947-ae4afb8f3230 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:41.976924 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8dcc4d-9a35-4e11-8947-ae4afb8f3230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:41.977191 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8dcc4d-9a35-4e11-8947-ae4afb8f3230 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:41.977929 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8dcc4d-9a35-4e11-8947-ae4afb8f3230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:41.979488 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8dcc4d-9a35-4e11-8947-ae4afb8f3230 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:41.990067 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1330/2634] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:03:41.994506 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d369a2c-0ec1-4b4a-94f4-042648820217 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:42.006896 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d369a2c-0ec1-4b4a-94f4-042648820217 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:42.012942 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393e5bc-6578-49be-bef2-41ee9e2e0f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:42.013850 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393e5bc-6578-49be-bef2-41ee9e2e0f5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:42.014174 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393e5bc-6578-49be-bef2-41ee9e2e0f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:42.014520 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393e5bc-6578-49be-bef2-41ee9e2e0f5c admin admin] PATH_INFO: `/v3/projects/eb137a51c2774253ad12c5d0c78c5b0f/users/c61d7d800d9f45e881536b539d0b31b8/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:42.034603 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393e5bc-6578-49be-bef2-41ee9e2e0f5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb137a51c2774253ad12c5d0c78c5b0f, user_id=c61d7d800d9f45e881536b539d0b31b8, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:42.037560 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393e5bc-6578-49be-bef2-41ee9e2e0f5c admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:42.050329 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1305/2635] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:03:41 2022] PUT /identity/v3/projects/eb137a51c2774253ad12c5d0c78c5b0f/users/c61d7d800d9f45e881536b539d0b31b8/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 11:03:42.065070 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a03308-da92-4d48-b13b-8402353f3c4f None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:42.065577 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a03308-da92-4d48-b13b-8402353f3c4f None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:42.065692 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a03308-da92-4d48-b13b-8402353f3c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:42.094323 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-33a03308-da92-4d48-b13b-8402353f3c4f None None] MFA Rules not processed for user `c61d7d800d9f45e881536b539d0b31b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:42.096036 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-33a03308-da92-4d48-b13b-8402353f3c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:42.161275 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1331/2636] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:03:42.172625 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393e5bc-6578-49be-bef2-41ee9e2e0f5c admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:42.174401 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-7393e5bc-6578-49be-bef2-41ee9e2e0f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:42.239464 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393e5bc-6578-49be-bef2-41ee9e2e0f5c admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:42.242945 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53a771-969a-49f4-ad44-4eaea473730b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:42.243535 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53a771-969a-49f4-ad44-4eaea473730b service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:42.243809 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53a771-969a-49f4-ad44-4eaea473730b service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:42.244073 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53a771-969a-49f4-ad44-4eaea473730b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:42.254417 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53a771-969a-49f4-ad44-4eaea473730b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:42.255833 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53a771-969a-49f4-ad44-4eaea473730b service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:42.268161 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1306/2637] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:03:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:03:42.287898 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a03308-da92-4d48-b13b-8402353f3c4f None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:42.366447 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a03308-da92-4d48-b13b-8402353f3c4f None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:42.371136 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3ce4f-43e8-4bb8-b0c2-f5f10281fbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:42.371759 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3ce4f-43e8-4bb8-b0c2-f5f10281fbf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:42.372038 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3ce4f-43e8-4bb8-b0c2-f5f10281fbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:42.372311 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3ce4f-43e8-4bb8-b0c2-f5f10281fbf7 admin admin] PATH_INFO: `/v3/users/c61d7d800d9f45e881536b539d0b31b8` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:42.373505 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3ce4f-43e8-4bb8-b0c2-f5f10281fbf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c61d7d800d9f45e881536b539d0b31b8)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:42.375931 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3ce4f-43e8-4bb8-b0c2-f5f10281fbf7 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:42.404919 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:42.427216 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-11b3ce4f-43e8-4bb8-b0c2-f5f10281fbf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c61d7d800d9f45e881536b539d0b31b8'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:42.439571 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-11b3ce4f-43e8-4bb8-b0c2-f5f10281fbf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c61d7d800d9f45e881536b539d0b31b8'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:42.440311 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-11b3ce4f-43e8-4bb8-b0c2-f5f10281fbf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c61d7d800d9f45e881536b539d0b31b8'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:42.447537 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-11b3ce4f-43e8-4bb8-b0c2-f5f10281fbf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c61d7d800d9f45e881536b539d0b31b8'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:42.455264 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-11b3ce4f-43e8-4bb8-b0c2-f5f10281fbf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c61d7d800d9f45e881536b539d0b31b8'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:42.461248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1332/2638] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:03:42 2022] DELETE /identity/v3/users/c61d7d800d9f45e881536b539d0b31b8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:42.465700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f38c21-c4e7-4c41-a44b-099e9eecfe01 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:42.466152 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f38c21-c4e7-4c41-a44b-099e9eecfe01 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:42.466269 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f38c21-c4e7-4c41-a44b-099e9eecfe01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:42.485746 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-15f38c21-c4e7-4c41-a44b-099e9eecfe01 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:42.487287 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-15f38c21-c4e7-4c41-a44b-099e9eecfe01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:42.546729 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1307/2639] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 11:03:42.556338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3ce4f-43e8-4bb8-b0c2-f5f10281fbf7 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:42.557794 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-11b3ce4f-43e8-4bb8-b0c2-f5f10281fbf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:42.614468 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3ce4f-43e8-4bb8-b0c2-f5f10281fbf7 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:42.618129 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e5501-9774-4f3b-baa4-ec64d1828406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:42.618714 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e5501-9774-4f3b-baa4-ec64d1828406 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:42.618980 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e5501-9774-4f3b-baa4-ec64d1828406 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:42.619233 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e5501-9774-4f3b-baa4-ec64d1828406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:42.628678 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e5501-9774-4f3b-baa4-ec64d1828406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:42.630241 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e5501-9774-4f3b-baa4-ec64d1828406 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:42.639455 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1333/2640] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:03:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:03:42.927300 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f38c21-c4e7-4c41-a44b-099e9eecfe01 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:42.929749 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-15f38c21-c4e7-4c41-a44b-099e9eecfe01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:42.947592 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f38c21-c4e7-4c41-a44b-099e9eecfe01 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:42.953596 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f7601-133b-4b09-a223-16ed0c5976dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:42.954142 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f7601-133b-4b09-a223-16ed0c5976dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:42.954537 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f7601-133b-4b09-a223-16ed0c5976dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:42.954808 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f7601-133b-4b09-a223-16ed0c5976dc admin admin] PATH_INFO: `/v3/projects/eb137a51c2774253ad12c5d0c78c5b0f` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:42.955928 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f7601-133b-4b09-a223-16ed0c5976dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb137a51c2774253ad12c5d0c78c5b0f)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:42.958172 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f7601-133b-4b09-a223-16ed0c5976dc admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:42.996539 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:43.014025 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-415f7601-133b-4b09-a223-16ed0c5976dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb137a51c2774253ad12c5d0c78c5b0f', 'request_id': 'req-415f7601-133b-4b09-a223-16ed0c5976dc'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:43.019897 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-415f7601-133b-4b09-a223-16ed0c5976dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb137a51c2774253ad12c5d0c78c5b0f', 'request_id': 'req-415f7601-133b-4b09-a223-16ed0c5976dc'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:43.026622 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-415f7601-133b-4b09-a223-16ed0c5976dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb137a51c2774253ad12c5d0c78c5b0f', 'request_id': 'req-415f7601-133b-4b09-a223-16ed0c5976dc'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:43.042114 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-415f7601-133b-4b09-a223-16ed0c5976dc admin admin] The token cache is being invalidate because project eb137a51c2774253ad12c5d0c78c5b0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:03:43.042398 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-415f7601-133b-4b09-a223-16ed0c5976dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:43.043030 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-415f7601-133b-4b09-a223-16ed0c5976dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:03:43.044637 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1308/2641] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:03:42 2022] DELETE /identity/v3/projects/eb137a51c2774253ad12c5d0c78c5b0f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:43.050259 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea2554-3f1c-4089-b54b-3e0be89fed4d None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:43.050715 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea2554-3f1c-4089-b54b-3e0be89fed4d None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:43.051088 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea2554-3f1c-4089-b54b-3e0be89fed4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:43.085485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-87ea2554-3f1c-4089-b54b-3e0be89fed4d None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:43.087674 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-87ea2554-3f1c-4089-b54b-3e0be89fed4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:43.165813 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1334/2642] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:03:43.176011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02ec89-dff3-4d1d-ac64-1660ab8a3baa None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:43.176373 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02ec89-dff3-4d1d-ac64-1660ab8a3baa None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:43.176641 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02ec89-dff3-4d1d-ac64-1660ab8a3baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:43.198350 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-2a02ec89-dff3-4d1d-ac64-1660ab8a3baa None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:43.199619 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-2a02ec89-dff3-4d1d-ac64-1660ab8a3baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:43.208195 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1309/2643] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 11:03:43.212743 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea2554-3f1c-4089-b54b-3e0be89fed4d None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:43.226793 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea2554-3f1c-4089-b54b-3e0be89fed4d None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:43.231780 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e371f1-bbb9-43a9-b3c1-e9b3d334a8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:43.232364 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e371f1-bbb9-43a9-b3c1-e9b3d334a8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:43.232635 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e371f1-bbb9-43a9-b3c1-e9b3d334a8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:43.232896 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e371f1-bbb9-43a9-b3c1-e9b3d334a8e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:43.233586 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e371f1-bbb9-43a9-b3c1-e9b3d334a8e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 11:03:43.233885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e371f1-bbb9-43a9-b3c1-e9b3d334a8e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:43.235453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e371f1-bbb9-43a9-b3c1-e9b3d334a8e1 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:43.247087 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1335/2644] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 11:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 11:03:43.252199 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02ec89-dff3-4d1d-ac64-1660ab8a3baa None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:43.261474 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02ec89-dff3-4d1d-ac64-1660ab8a3baa None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:43.266843 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86c61b-af88-49e3-873a-fd13d8668860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:43.267680 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86c61b-af88-49e3-873a-fd13d8668860 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:43.267978 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86c61b-af88-49e3-873a-fd13d8668860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:43.268244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86c61b-af88-49e3-873a-fd13d8668860 admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:43.268866 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df86c61b-af88-49e3-873a-fd13d8668860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:43.270813 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df86c61b-af88-49e3-873a-fd13d8668860 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:43.303868 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1310/2645] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:03:43 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:03:43.308154 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e371f1-bbb9-43a9-b3c1-e9b3d334a8e1 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:43.318717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e371f1-bbb9-43a9-b3c1-e9b3d334a8e1 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:43.350020 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:43.381028 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704e972-2914-4c1e-a20c-54892ae8a5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:43.381662 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704e972-2914-4c1e-a20c-54892ae8a5ab admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:43.381937 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704e972-2914-4c1e-a20c-54892ae8a5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:43.382206 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704e972-2914-4c1e-a20c-54892ae8a5ab admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:43.382853 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d704e972-2914-4c1e-a20c-54892ae8a5ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:43.384774 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d704e972-2914-4c1e-a20c-54892ae8a5ab admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:43.409438 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1336/2646] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:03:43 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:03:43.410956 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86c61b-af88-49e3-873a-fd13d8668860 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:43.422662 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86c61b-af88-49e3-873a-fd13d8668860 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:43.427414 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e78e0-50c2-4bbe-9cf8-568695f76809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:43.428009 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e78e0-50c2-4bbe-9cf8-568695f76809 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:43.428285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e78e0-50c2-4bbe-9cf8-568695f76809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:43.428548 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e78e0-50c2-4bbe-9cf8-568695f76809 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:43.429251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e78e0-50c2-4bbe-9cf8-568695f76809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:43.430863 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e78e0-50c2-4bbe-9cf8-568695f76809 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:43.442316 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1311/2647] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 11:03:43.446346 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704e972-2914-4c1e-a20c-54892ae8a5ab admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:43.456430 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d704e972-2914-4c1e-a20c-54892ae8a5ab admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:43.461415 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8681081-21f1-4841-ba61-7498122a2658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:43.462152 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8681081-21f1-4841-ba61-7498122a2658 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:43.462529 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8681081-21f1-4841-ba61-7498122a2658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:43.462899 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8681081-21f1-4841-ba61-7498122a2658 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:43.463675 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8681081-21f1-4841-ba61-7498122a2658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:43.465610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8681081-21f1-4841-ba61-7498122a2658 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:43.476124 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1337/2648] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:03:43.480189 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e78e0-50c2-4bbe-9cf8-568695f76809 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:43.490933 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e78e0-50c2-4bbe-9cf8-568695f76809 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:43.495868 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6430878-ebe4-45c0-b185-987049c0d58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:43.496512 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6430878-ebe4-45c0-b185-987049c0d58a admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:43.496785 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6430878-ebe4-45c0-b185-987049c0d58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:43.497051 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6430878-ebe4-45c0-b185-987049c0d58a admin admin] PATH_INFO: `/v3/projects/e58c0d55e6a746299a93b5eafc10d120/users/5cf9a8ed36444a4da84c84cd553f20ba/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:43.512789 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6430878-ebe4-45c0-b185-987049c0d58a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e58c0d55e6a746299a93b5eafc10d120, user_id=5cf9a8ed36444a4da84c84cd553f20ba, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:43.516008 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6430878-ebe4-45c0-b185-987049c0d58a admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:43.548049 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1312/2649] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:03:43 2022] PUT /identity/v3/projects/e58c0d55e6a746299a93b5eafc10d120/users/5cf9a8ed36444a4da84c84cd553f20ba/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:03:43.558066 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219eac9c-698c-4a2f-8ff8-885a8de6724c None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:43.558358 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219eac9c-698c-4a2f-8ff8-885a8de6724c None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:43.558699 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219eac9c-698c-4a2f-8ff8-885a8de6724c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:43.587425 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-219eac9c-698c-4a2f-8ff8-885a8de6724c None None] MFA Rules not processed for user `5cf9a8ed36444a4da84c84cd553f20ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:43.588639 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-219eac9c-698c-4a2f-8ff8-885a8de6724c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:43.658149 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1338/2650] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:03:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:03:43.670085 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6430878-ebe4-45c0-b185-987049c0d58a admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:43.671812 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-b6430878-ebe4-45c0-b185-987049c0d58a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:43.739128 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6430878-ebe4-45c0-b185-987049c0d58a admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:43.744909 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ebbef-99ca-4de7-a573-ba1b6f84342b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a462a891b30847c0aeadbd697652011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:43.745560 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ebbef-99ca-4de7-a573-ba1b6f84342b service glance] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:43.745845 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ebbef-99ca-4de7-a573-ba1b6f84342b service glance] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:43.746135 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ebbef-99ca-4de7-a573-ba1b6f84342b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:43.759742 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ebbef-99ca-4de7-a573-ba1b6f84342b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:43.761780 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ebbef-99ca-4de7-a573-ba1b6f84342b service glance] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:43.772725 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1313/2651] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:03:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:03:45.548713 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07fa60-b844-4102-8f38-fa240861bbb3 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:45.549300 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07fa60-b844-4102-8f38-fa240861bbb3 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:45.549300 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07fa60-b844-4102-8f38-fa240861bbb3 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:45.550836 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1339/2652] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 7 11:03:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 11:03:45.557711 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0940ccc-4398-461e-aaac-ccc3c5df5d4d None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:45.558171 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0940ccc-4398-461e-aaac-ccc3c5df5d4d None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:45.558290 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0940ccc-4398-461e-aaac-ccc3c5df5d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:45.579572 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-b0940ccc-4398-461e-aaac-ccc3c5df5d4d None None] MFA Rules not processed for user `f98cb7abbb8942cebb71aa98da80a05a`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:45.580785 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-b0940ccc-4398-461e-aaac-ccc3c5df5d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:45.632918 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:45.657793 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1314/2653] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 7 11:03:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:03:45.669343 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07fa60-b844-4102-8f38-fa240861bbb3 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:45.682181 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07fa60-b844-4102-8f38-fa240861bbb3 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:45.688745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614b136-dd70-4af2-ba48-8eafaf69fd97 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a462a891b30847c0aeadbd697652011a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:45.689381 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614b136-dd70-4af2-ba48-8eafaf69fd97 service glance] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:45.689664 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614b136-dd70-4af2-ba48-8eafaf69fd97 service glance] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:45.689931 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614b136-dd70-4af2-ba48-8eafaf69fd97 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:45.700511 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614b136-dd70-4af2-ba48-8eafaf69fd97 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:45.701987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614b136-dd70-4af2-ba48-8eafaf69fd97 service glance] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:45.713340 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1340/2654] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:03:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:03:45.783487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28720b4-4aa2-478c-a7dd-7af2c88c7d80 None None] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:45.783714 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28720b4-4aa2-478c-a7dd-7af2c88c7d80 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:45.784003 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28720b4-4aa2-478c-a7dd-7af2c88c7d80 None None] PATH_INFO: `/` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:45.785375 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1315/2655] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 7 11:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 11:03:45.790719 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f31c0e-320c-41d2-84e3-fe15e5fb5aa6 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:45.791121 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f31c0e-320c-41d2-84e3-fe15e5fb5aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:45.791546 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f31c0e-320c-41d2-84e3-fe15e5fb5aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:45.813437 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-b8f31c0e-320c-41d2-84e3-fe15e5fb5aa6 None None] MFA Rules not processed for user `9b03428b48264b9da9800283496de2e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:45.815261 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-b8f31c0e-320c-41d2-84e3-fe15e5fb5aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:45.878271 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1341/2656] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 7 11:03:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:03:45.889735 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28720b4-4aa2-478c-a7dd-7af2c88c7d80 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:45.891434 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-e28720b4-4aa2-478c-a7dd-7af2c88c7d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:45.905076 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28720b4-4aa2-478c-a7dd-7af2c88c7d80 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:45.908834 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60b19c-5d9c-447b-b2a9-9ced38c744df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:45.909467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60b19c-5d9c-447b-b2a9-9ced38c744df service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:45.909744 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60b19c-5d9c-447b-b2a9-9ced38c744df service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:45.910011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60b19c-5d9c-447b-b2a9-9ced38c744df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:45.917748 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60b19c-5d9c-447b-b2a9-9ced38c744df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:45.919163 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60b19c-5d9c-447b-b2a9-9ced38c744df service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:45.927579 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1316/2657] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:03:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:03:46.018614 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22382316-d93c-4c6f-a693-c02a82968304 None None] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:46.018897 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22382316-d93c-4c6f-a693-c02a82968304 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:46.019171 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22382316-d93c-4c6f-a693-c02a82968304 None None] PATH_INFO: `/` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:46.020522 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1342/2658] 10.222.0.27 () {54 vars in 921 bytes} [Sun Aug 7 11:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 11:03:46.025795 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022c326-7118-41ba-9c12-865ae9808b03 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:46.026078 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022c326-7118-41ba-9c12-865ae9808b03 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:46.026346 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022c326-7118-41ba-9c12-865ae9808b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:46.047377 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-4022c326-7118-41ba-9c12-865ae9808b03 None None] MFA Rules not processed for user `f98cb7abbb8942cebb71aa98da80a05a`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:46.048561 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-4022c326-7118-41ba-9c12-865ae9808b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:46.058173 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1317/2659] 10.222.0.27 () {58 vars in 1018 bytes} [Sun Aug 7 11:03:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:03:46.069614 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22382316-d93c-4c6f-a693-c02a82968304 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:46.082337 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22382316-d93c-4c6f-a693-c02a82968304 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:46.085927 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa1840-ca23-44a7-9c54-08956d44f4e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:46.086514 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa1840-ca23-44a7-9c54-08956d44f4e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:46.086868 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa1840-ca23-44a7-9c54-08956d44f4e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:46.087269 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa1840-ca23-44a7-9c54-08956d44f4e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:46.099446 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa1840-ca23-44a7-9c54-08956d44f4e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:46.100886 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa1840-ca23-44a7-9c54-08956d44f4e9 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:46.113223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1343/2660] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:03:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:03:47.831612 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997d621-7ef4-402d-a873-579a2c4b2114 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:47.832098 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997d621-7ef4-402d-a873-579a2c4b2114 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:47.832198 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997d621-7ef4-402d-a873-579a2c4b2114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:47.850930 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-6997d621-7ef4-402d-a873-579a2c4b2114 None None] MFA Rules not processed for user `e7eebb4bd7e04ff8bc4304a40cf6ba35`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:03:47.852128 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-6997d621-7ef4-402d-a873-579a2c4b2114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:47.908344 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1318/2661] 10.222.0.27 () {58 vars in 1009 bytes} [Sun Aug 7 11:03:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 11:03:47.920315 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa1840-ca23-44a7-9c54-08956d44f4e9 service neutron] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:03:47.922321 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-d9fa1840-ca23-44a7-9c54-08956d44f4e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:03:47.952420 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:48.000521 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa1840-ca23-44a7-9c54-08956d44f4e9 service neutron] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:03:48.005603 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250f3e1-a8d5-496b-b748-478bc0126b3d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7181e5118c547a3a31d2e080c25ff01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:03:48.006202 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250f3e1-a8d5-496b-b748-478bc0126b3d service swift] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:03:48.006474 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250f3e1-a8d5-496b-b748-478bc0126b3d service swift] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:03:48.006739 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250f3e1-a8d5-496b-b748-478bc0126b3d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:03:48.018890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250f3e1-a8d5-496b-b748-478bc0126b3d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:03:48.020470 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250f3e1-a8d5-496b-b748-478bc0126b3d service swift] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:03:48.028935 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1344/2662] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 7 11:03:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 11:03:57.900840 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=40 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:03:58.025483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=21 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:04:13.880737 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997d621-7ef4-402d-a873-579a2c4b2114 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:04:13.943388 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997d621-7ef4-402d-a873-579a2c4b2114 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:04:13.947895 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13770934-1c8a-4875-9267-d2aa2953dcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:04:13.948512 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13770934-1c8a-4875-9267-d2aa2953dcc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:04:13.948787 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13770934-1c8a-4875-9267-d2aa2953dcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:04:13.949057 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13770934-1c8a-4875-9267-d2aa2953dcc1 admin admin] PATH_INFO: `/v3/users/5cf9a8ed36444a4da84c84cd553f20ba` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:04:13.950228 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13770934-1c8a-4875-9267-d2aa2953dcc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cf9a8ed36444a4da84c84cd553f20ba)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:04:13.952154 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13770934-1c8a-4875-9267-d2aa2953dcc1 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:04:14.000342 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-13770934-1c8a-4875-9267-d2aa2953dcc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cf9a8ed36444a4da84c84cd553f20ba'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:04:14.013406 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-13770934-1c8a-4875-9267-d2aa2953dcc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cf9a8ed36444a4da84c84cd553f20ba'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:04:14.014689 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-13770934-1c8a-4875-9267-d2aa2953dcc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cf9a8ed36444a4da84c84cd553f20ba'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:04:14.025534 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-13770934-1c8a-4875-9267-d2aa2953dcc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cf9a8ed36444a4da84c84cd553f20ba'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:04:14.035213 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-13770934-1c8a-4875-9267-d2aa2953dcc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cf9a8ed36444a4da84c84cd553f20ba'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:04:14.042424 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1319/2663] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:04:13 2022] DELETE /identity/v3/users/5cf9a8ed36444a4da84c84cd553f20ba => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:04:14.047934 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b68bf-65ef-4160-b8bb-b39e2a4b3dfd None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:04:14.048405 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b68bf-65ef-4160-b8bb-b39e2a4b3dfd None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:04:14.048663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b68bf-65ef-4160-b8bb-b39e2a4b3dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:04:14.067921 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-b44b68bf-65ef-4160-b8bb-b39e2a4b3dfd None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:04:14.069145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-b44b68bf-65ef-4160-b8bb-b39e2a4b3dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:04:14.129444 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1345/2664] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 11:04:14.139134 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13770934-1c8a-4875-9267-d2aa2953dcc1 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:04:14.141035 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-13770934-1c8a-4875-9267-d2aa2953dcc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:04:14.196275 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13770934-1c8a-4875-9267-d2aa2953dcc1 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:04:14.199883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56edcf-04bc-427c-af95-a9f7d2f6894b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:04:14.200463 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56edcf-04bc-427c-af95-a9f7d2f6894b service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:04:14.200737 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56edcf-04bc-427c-af95-a9f7d2f6894b service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:04:14.201009 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56edcf-04bc-427c-af95-a9f7d2f6894b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:04:14.210235 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56edcf-04bc-427c-af95-a9f7d2f6894b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:04:14.211630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56edcf-04bc-427c-af95-a9f7d2f6894b service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:04:14.221493 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1320/2665] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:04:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:04:14.488105 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b68bf-65ef-4160-b8bb-b39e2a4b3dfd None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:04:14.489688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-b44b68bf-65ef-4160-b8bb-b39e2a4b3dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:04:14.503784 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b68bf-65ef-4160-b8bb-b39e2a4b3dfd None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:04:14.508545 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea329cc0-9130-4052-9fb3-d49e2ed6c5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:04:14.509307 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea329cc0-9130-4052-9fb3-d49e2ed6c5bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:04:14.509654 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea329cc0-9130-4052-9fb3-d49e2ed6c5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:04:14.509926 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea329cc0-9130-4052-9fb3-d49e2ed6c5bf admin admin] PATH_INFO: `/v3/projects/e58c0d55e6a746299a93b5eafc10d120` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:04:14.511112 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea329cc0-9130-4052-9fb3-d49e2ed6c5bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e58c0d55e6a746299a93b5eafc10d120)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:04:14.513082 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea329cc0-9130-4052-9fb3-d49e2ed6c5bf admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:04:14.534989 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39810d-c57b-456a-99ee-ac2fe67cff0c None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:04:14.535271 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39810d-c57b-456a-99ee-ac2fe67cff0c None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:04:14.535542 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39810d-c57b-456a-99ee-ac2fe67cff0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:04:14.556165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-ce39810d-c57b-456a-99ee-ac2fe67cff0c None None] MFA Rules not processed for user `e7eebb4bd7e04ff8bc4304a40cf6ba35`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:04:14.557371 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ce39810d-c57b-456a-99ee-ac2fe67cff0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:04:14.565673 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-ea329cc0-9130-4052-9fb3-d49e2ed6c5bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e58c0d55e6a746299a93b5eafc10d120', 'request_id': 'req-ea329cc0-9130-4052-9fb3-d49e2ed6c5bf'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:04:14.571337 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-ea329cc0-9130-4052-9fb3-d49e2ed6c5bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e58c0d55e6a746299a93b5eafc10d120', 'request_id': 'req-ea329cc0-9130-4052-9fb3-d49e2ed6c5bf'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:04:14.575304 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:04:14.578968 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-ea329cc0-9130-4052-9fb3-d49e2ed6c5bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e58c0d55e6a746299a93b5eafc10d120', 'request_id': 'req-ea329cc0-9130-4052-9fb3-d49e2ed6c5bf'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:04:14.590565 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-ea329cc0-9130-4052-9fb3-d49e2ed6c5bf admin admin] The token cache is being invalidate because project e58c0d55e6a746299a93b5eafc10d120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:04:14.590940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-ea329cc0-9130-4052-9fb3-d49e2ed6c5bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:04:14.591656 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-ea329cc0-9130-4052-9fb3-d49e2ed6c5bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:04:14.593790 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1346/2666] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:04:14 2022] DELETE /identity/v3/projects/e58c0d55e6a746299a93b5eafc10d120 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:04:14.598530 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce873cb-b59d-4abc-83a9-2bf48bcd04db None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:04:14.598884 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce873cb-b59d-4abc-83a9-2bf48bcd04db None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:04:14.599222 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce873cb-b59d-4abc-83a9-2bf48bcd04db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:04:14.618644 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1321/2667] 10.222.0.27 () {58 vars in 967 bytes} [Sun Aug 7 11:04:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 11:04:14.619758 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-1ce873cb-b59d-4abc-83a9-2bf48bcd04db None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:04:14.621128 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-1ce873cb-b59d-4abc-83a9-2bf48bcd04db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:04:14.632394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39810d-c57b-456a-99ee-ac2fe67cff0c None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:04:14.633874 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ce39810d-c57b-456a-99ee-ac2fe67cff0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:04:14.682152 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1347/2668] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 11:04:14.690604 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb656e-b8c6-4531-a688-5763a7aeb7a7 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:04:14.690870 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb656e-b8c6-4531-a688-5763a7aeb7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:04:14.691137 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb656e-b8c6-4531-a688-5763a7aeb7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:04:14.714131 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-c7fb656e-b8c6-4531-a688-5763a7aeb7a7 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:04:14.715460 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-c7fb656e-b8c6-4531-a688-5763a7aeb7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:04:14.722714 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39810d-c57b-456a-99ee-ac2fe67cff0c None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:04:14.724617 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1348/2669] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 11:04:14.731266 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b3ee3-1b01-44b3-b9be-3392fa79a3ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7181e5118c547a3a31d2e080c25ff01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:04:14.731871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b3ee3-1b01-44b3-b9be-3392fa79a3ba service swift] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:04:14.732155 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b3ee3-1b01-44b3-b9be-3392fa79a3ba service swift] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:04:14.732419 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b3ee3-1b01-44b3-b9be-3392fa79a3ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:04:14.734321 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb656e-b8c6-4531-a688-5763a7aeb7a7 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:04:14.744205 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb656e-b8c6-4531-a688-5763a7aeb7a7 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:04:14.745291 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b3ee3-1b01-44b3-b9be-3392fa79a3ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:04:14.747037 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b3ee3-1b01-44b3-b9be-3392fa79a3ba service swift] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:04:14.749399 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78584591-a817-4611-8129-f8b2136f484a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:04:14.749987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78584591-a817-4611-8129-f8b2136f484a admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:04:14.750257 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78584591-a817-4611-8129-f8b2136f484a admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:04:14.750522 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78584591-a817-4611-8129-f8b2136f484a admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:04:14.751150 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78584591-a817-4611-8129-f8b2136f484a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 11:04:14.751445 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78584591-a817-4611-8129-f8b2136f484a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:04:14.753267 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78584591-a817-4611-8129-f8b2136f484a admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:04:14.757199 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1322/2670] 10.222.0.27 () {60 vars in 1384 bytes} [Sun Aug 7 11:04:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 11:04:14.770330 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1349/2671] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 11:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 11:04:14.772075 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b3ee3-1b01-44b3-b9be-3392fa79a3ba service swift] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:04:14.784825 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b3ee3-1b01-44b3-b9be-3392fa79a3ba service swift] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:04:14.789658 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779fba8-f99f-4a9f-b2a2-d92c1f43820d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:04:14.790250 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779fba8-f99f-4a9f-b2a2-d92c1f43820d admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:04:14.790527 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779fba8-f99f-4a9f-b2a2-d92c1f43820d admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:04:14.790792 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779fba8-f99f-4a9f-b2a2-d92c1f43820d admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:04:14.791418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779fba8-f99f-4a9f-b2a2-d92c1f43820d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:04:14.793298 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779fba8-f99f-4a9f-b2a2-d92c1f43820d admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:04:14.839091 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1323/2672] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:04:14 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 11:04:14.840890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78584591-a817-4611-8129-f8b2136f484a admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:04:14.859714 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:04:14.866928 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78584591-a817-4611-8129-f8b2136f484a admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:04:14.948063 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba441158-031e-46f0-916c-62a0f57a6e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:04:14.948555 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba441158-031e-46f0-916c-62a0f57a6e80 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:04:14.948828 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba441158-031e-46f0-916c-62a0f57a6e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:04:14.949213 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba441158-031e-46f0-916c-62a0f57a6e80 admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:04:14.949868 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba441158-031e-46f0-916c-62a0f57a6e80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:04:14.952656 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba441158-031e-46f0-916c-62a0f57a6e80 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:04:14.977145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1350/2673] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:04:14 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:04:14.981086 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779fba8-f99f-4a9f-b2a2-d92c1f43820d admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:04:14.997646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779fba8-f99f-4a9f-b2a2-d92c1f43820d admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:04:15.004084 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447761bf-6d54-4e2e-8a64-09d743cc2af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:04:15.004841 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447761bf-6d54-4e2e-8a64-09d743cc2af5 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:04:15.005143 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447761bf-6d54-4e2e-8a64-09d743cc2af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:04:15.005450 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447761bf-6d54-4e2e-8a64-09d743cc2af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:04:15.006206 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447761bf-6d54-4e2e-8a64-09d743cc2af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:04:15.007897 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447761bf-6d54-4e2e-8a64-09d743cc2af5 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:04:15.019553 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1324/2674] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:04:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 11:04:15.023724 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba441158-031e-46f0-916c-62a0f57a6e80 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:04:15.035490 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba441158-031e-46f0-916c-62a0f57a6e80 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:04:15.040590 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aea769-ef77-4d10-abe7-3e5b5bcf9ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:04:15.041646 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aea769-ef77-4d10-abe7-3e5b5bcf9ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:04:15.041980 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aea769-ef77-4d10-abe7-3e5b5bcf9ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:04:15.042318 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aea769-ef77-4d10-abe7-3e5b5bcf9ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:04:15.043030 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aea769-ef77-4d10-abe7-3e5b5bcf9ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:04:15.044684 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aea769-ef77-4d10-abe7-3e5b5bcf9ff6 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:04:15.056995 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1351/2675] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 11:04:15.072667 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447761bf-6d54-4e2e-8a64-09d743cc2af5 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:04:15.084684 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447761bf-6d54-4e2e-8a64-09d743cc2af5 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:04:15.089524 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12586964-1d97-4343-b741-c450883b2b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:04:15.090166 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12586964-1d97-4343-b741-c450883b2b19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:04:15.090446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12586964-1d97-4343-b741-c450883b2b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:04:15.090718 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12586964-1d97-4343-b741-c450883b2b19 admin admin] PATH_INFO: `/v3/projects/02e176428ebc413ab96d138f59cf4db6/users/16509e38d0eb491f8ccc940123536a73/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:04:15.110483 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12586964-1d97-4343-b741-c450883b2b19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02e176428ebc413ab96d138f59cf4db6, user_id=16509e38d0eb491f8ccc940123536a73, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:04:15.113274 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12586964-1d97-4343-b741-c450883b2b19 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:04:15.133030 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1325/2676] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:04:15 2022] PUT /identity/v3/projects/02e176428ebc413ab96d138f59cf4db6/users/16509e38d0eb491f8ccc940123536a73/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:04:15.135008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ded25-74cf-4eec-b361-e0ac0690b766 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:04:15.135349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ded25-74cf-4eec-b361-e0ac0690b766 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:04:15.135852 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ded25-74cf-4eec-b361-e0ac0690b766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:04:15.159114 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-111ded25-74cf-4eec-b361-e0ac0690b766 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:04:15.160333 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-111ded25-74cf-4eec-b361-e0ac0690b766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:04:15.223962 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1352/2677] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 11:04:15.234082 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12586964-1d97-4343-b741-c450883b2b19 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:04:15.235846 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-12586964-1d97-4343-b741-c450883b2b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:04:15.337686 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12586964-1d97-4343-b741-c450883b2b19 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:04:15.341578 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315f7ff-25f5-406d-b2e3-2b81e30c81fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:04:15.342188 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315f7ff-25f5-406d-b2e3-2b81e30c81fd service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:04:15.342522 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315f7ff-25f5-406d-b2e3-2b81e30c81fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:04:15.342796 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315f7ff-25f5-406d-b2e3-2b81e30c81fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:04:15.351492 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:04:15.355140 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315f7ff-25f5-406d-b2e3-2b81e30c81fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:04:15.357143 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315f7ff-25f5-406d-b2e3-2b81e30c81fd service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:04:15.368651 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1326/2678] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:04:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:04:16.187433 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa97dd0-aea7-49f6-8346-6d78c77da0df None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:04:16.187956 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa97dd0-aea7-49f6-8346-6d78c77da0df None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:04:16.188726 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa97dd0-aea7-49f6-8346-6d78c77da0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:04:16.221162 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-0aa97dd0-aea7-49f6-8346-6d78c77da0df None None] MFA Rules not processed for user `16509e38d0eb491f8ccc940123536a73`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:04:16.222695 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-0aa97dd0-aea7-49f6-8346-6d78c77da0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:04:16.315677 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1353/2679] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:04:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:04:16.326332 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315f7ff-25f5-406d-b2e3-2b81e30c81fd service neutron] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:04:16.328625 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a315f7ff-25f5-406d-b2e3-2b81e30c81fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:04:16.396691 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315f7ff-25f5-406d-b2e3-2b81e30c81fd service neutron] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:04:16.400215 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f690fc-7f08-4b75-a907-27a835c4b52e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:04:16.400804 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f690fc-7f08-4b75-a907-27a835c4b52e service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:04:16.401076 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f690fc-7f08-4b75-a907-27a835c4b52e service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:04:16.401366 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f690fc-7f08-4b75-a907-27a835c4b52e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:04:16.409607 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f690fc-7f08-4b75-a907-27a835c4b52e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:04:16.411010 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f690fc-7f08-4b75-a907-27a835c4b52e service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:04:16.419760 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1327/2680] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:04:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:04:17.743951 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa97dd0-aea7-49f6-8346-6d78c77da0df None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:04:17.745474 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-0aa97dd0-aea7-49f6-8346-6d78c77da0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:04:17.758430 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa97dd0-aea7-49f6-8346-6d78c77da0df None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:04:17.761439 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57cdfa-bc6d-423d-a3ef-05bc03c64c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:04:17.762144 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57cdfa-bc6d-423d-a3ef-05bc03c64c11 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:04:17.762422 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57cdfa-bc6d-423d-a3ef-05bc03c64c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:04:17.762693 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57cdfa-bc6d-423d-a3ef-05bc03c64c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:04:17.764441 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-6a57cdfa-bc6d-423d-a3ef-05bc03c64c11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:04:17.769259 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efb28e-3a81-4624-89d5-98858e983d7c None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:04:17.769974 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efb28e-3a81-4624-89d5-98858e983d7c None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:04:17.770316 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efb28e-3a81-4624-89d5-98858e983d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:04:17.775389 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:04:17.789562 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-17efb28e-3a81-4624-89d5-98858e983d7c None None] MFA Rules not processed for user `16509e38d0eb491f8ccc940123536a73`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:04:17.790840 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-17efb28e-3a81-4624-89d5-98858e983d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:04:17.798444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1328/2681] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:04:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 11:04:17.838446 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57cdfa-bc6d-423d-a3ef-05bc03c64c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:04:17.839860 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57cdfa-bc6d-423d-a3ef-05bc03c64c11 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:04:17.851197 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1354/2682] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:04:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:04:17.928221 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efb28e-3a81-4624-89d5-98858e983d7c None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:04:17.938181 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efb28e-3a81-4624-89d5-98858e983d7c None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:04:17.941861 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65743c-cbc7-4425-9aa6-f2045c27cb5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:04:17.942540 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65743c-cbc7-4425-9aa6-f2045c27cb5c service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:04:17.942881 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65743c-cbc7-4425-9aa6-f2045c27cb5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:04:17.943217 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65743c-cbc7-4425-9aa6-f2045c27cb5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:04:17.944991 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-de65743c-cbc7-4425-9aa6-f2045c27cb5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:04:18.007794 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65743c-cbc7-4425-9aa6-f2045c27cb5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:04:18.009213 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65743c-cbc7-4425-9aa6-f2045c27cb5c service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:04:18.019354 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1329/2683] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:04:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:04:27.846305 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=28 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:04:28.015045 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=62 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:04:52.445883 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65140c-e00f-4e2f-a4fc-c52dc512f816 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:04:52.446336 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65140c-e00f-4e2f-a4fc-c52dc512f816 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:04:52.446447 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65140c-e00f-4e2f-a4fc-c52dc512f816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:04:52.465345 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-9e65140c-e00f-4e2f-a4fc-c52dc512f816 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:04:52.466540 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-9e65140c-e00f-4e2f-a4fc-c52dc512f816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:04:52.474200 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1355/2684] 10.222.0.30 () {58 vars in 1016 bytes} [Sun Aug 7 11:04:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:04:52.506195 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65743c-cbc7-4425-9aa6-f2045c27cb5c service neutron] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:04:52.507627 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-de65743c-cbc7-4425-9aa6-f2045c27cb5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:04:52.523570 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65743c-cbc7-4425-9aa6-f2045c27cb5c service neutron] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:04:52.528972 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc30aa0-d279-4fe6-bfcd-9a0a02f1bdb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:04:52.529592 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc30aa0-d279-4fe6-bfcd-9a0a02f1bdb2 service nova] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:04:52.529868 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc30aa0-d279-4fe6-bfcd-9a0a02f1bdb2 service nova] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:04:52.530137 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc30aa0-d279-4fe6-bfcd-9a0a02f1bdb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:04:52.538931 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc30aa0-d279-4fe6-bfcd-9a0a02f1bdb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:04:52.540505 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc30aa0-d279-4fe6-bfcd-9a0a02f1bdb2 service nova] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:04:52.549689 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1330/2685] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:04:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:04:56.522762 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1f22a-8853-4346-a0e0-3cc14c88b23b None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:04:56.523269 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1f22a-8853-4346-a0e0-3cc14c88b23b None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:04:56.523269 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1f22a-8853-4346-a0e0-3cc14c88b23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:04:56.542467 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-2aa1f22a-8853-4346-a0e0-3cc14c88b23b None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:04:56.543659 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-2aa1f22a-8853-4346-a0e0-3cc14c88b23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:04:56.552163 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1356/2686] 10.222.0.30 () {58 vars in 1016 bytes} [Sun Aug 7 11:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:04:56.571065 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc30aa0-d279-4fe6-bfcd-9a0a02f1bdb2 service nova] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:04:56.582040 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc30aa0-d279-4fe6-bfcd-9a0a02f1bdb2 service nova] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:04:56.587497 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6f7a0-3d58-4a02-ad49-de6a292a773f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:04:56.588128 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6f7a0-3d58-4a02-ad49-de6a292a773f service nova] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:04:56.588403 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6f7a0-3d58-4a02-ad49-de6a292a773f service nova] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:04:56.588668 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6f7a0-3d58-4a02-ad49-de6a292a773f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:04:56.596882 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6f7a0-3d58-4a02-ad49-de6a292a773f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:04:56.598451 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6f7a0-3d58-4a02-ad49-de6a292a773f service nova] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:04:56.607911 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1331/2687] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:04:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:04:59.769270 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd1724-a5b9-4c3b-b507-85d31b0ac516 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:04:59.769955 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd1724-a5b9-4c3b-b507-85d31b0ac516 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:04:59.769955 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd1724-a5b9-4c3b-b507-85d31b0ac516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:04:59.789836 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-addd1724-a5b9-4c3b-b507-85d31b0ac516 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:04:59.791027 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-addd1724-a5b9-4c3b-b507-85d31b0ac516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:04:59.799347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1357/2688] 10.222.0.30 () {58 vars in 1016 bytes} [Sun Aug 7 11:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 11:04:59.817424 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6f7a0-3d58-4a02-ad49-de6a292a773f service nova] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:04:59.828535 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6f7a0-3d58-4a02-ad49-de6a292a773f service nova] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:04:59.834347 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6157620-0dac-474a-8b56-45cc17980ed5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:04:59.834937 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6157620-0dac-474a-8b56-45cc17980ed5 service nova] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:04:59.835232 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6157620-0dac-474a-8b56-45cc17980ed5 service nova] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:04:59.835536 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6157620-0dac-474a-8b56-45cc17980ed5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:04:59.844326 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6157620-0dac-474a-8b56-45cc17980ed5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:04:59.846085 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6157620-0dac-474a-8b56-45cc17980ed5 service nova] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:04:59.855715 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1332/2689] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:04:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:05:02.852506 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15699430-6a19-46d6-934d-d5d54bdf9024 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:02.852992 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15699430-6a19-46d6-934d-d5d54bdf9024 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:02.853099 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15699430-6a19-46d6-934d-d5d54bdf9024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:02.872293 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-15699430-6a19-46d6-934d-d5d54bdf9024 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:02.873445 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-15699430-6a19-46d6-934d-d5d54bdf9024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:02.881466 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1358/2690] 10.222.0.30 () {58 vars in 1016 bytes} [Sun Aug 7 11:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:02.901776 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6157620-0dac-474a-8b56-45cc17980ed5 service nova] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:02.913263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6157620-0dac-474a-8b56-45cc17980ed5 service nova] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:02.918683 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda3a7f-2a7f-4402-8bf3-e034baeb200f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:02.919256 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda3a7f-2a7f-4402-8bf3-e034baeb200f service nova] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:02.919530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda3a7f-2a7f-4402-8bf3-e034baeb200f service nova] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:02.919798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda3a7f-2a7f-4402-8bf3-e034baeb200f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:02.927593 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda3a7f-2a7f-4402-8bf3-e034baeb200f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:02.929138 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda3a7f-2a7f-4402-8bf3-e034baeb200f service nova] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:02.938266 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1333/2691] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:05:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:05:07.071744 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a95c46-411a-4f25-935e-1a97880a6b1c None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:07.072221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a95c46-411a-4f25-935e-1a97880a6b1c None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:07.072317 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a95c46-411a-4f25-935e-1a97880a6b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:07.092229 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-f0a95c46-411a-4f25-935e-1a97880a6b1c None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:07.093463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-f0a95c46-411a-4f25-935e-1a97880a6b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:07.101274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1359/2692] 10.222.0.30 () {58 vars in 1016 bytes} [Sun Aug 7 11:05:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:07.119717 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda3a7f-2a7f-4402-8bf3-e034baeb200f service nova] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:07.131251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda3a7f-2a7f-4402-8bf3-e034baeb200f service nova] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:07.136628 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6acd3-3037-421e-aefd-d961c4def6c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:07.137202 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6acd3-3037-421e-aefd-d961c4def6c5 service nova] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:07.137508 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6acd3-3037-421e-aefd-d961c4def6c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:07.137814 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6acd3-3037-421e-aefd-d961c4def6c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:07.146583 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6acd3-3037-421e-aefd-d961c4def6c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:07.148139 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6acd3-3037-421e-aefd-d961c4def6c5 service nova] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:07.157428 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1334/2693] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:05:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:05:10.217066 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e27e9-934c-4bb9-b17e-b39875c388f8 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:10.217592 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e27e9-934c-4bb9-b17e-b39875c388f8 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:10.217694 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e27e9-934c-4bb9-b17e-b39875c388f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:10.236416 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-880e27e9-934c-4bb9-b17e-b39875c388f8 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:10.237610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-880e27e9-934c-4bb9-b17e-b39875c388f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:10.245839 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1360/2694] 10.222.0.30 () {58 vars in 1016 bytes} [Sun Aug 7 11:05:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:10.264251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6acd3-3037-421e-aefd-d961c4def6c5 service nova] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:10.275755 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6acd3-3037-421e-aefd-d961c4def6c5 service nova] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:10.281142 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdf6f4-e39b-4a91-bbcd-e853693f5962 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:10.281756 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdf6f4-e39b-4a91-bbcd-e853693f5962 service nova] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:10.282027 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdf6f4-e39b-4a91-bbcd-e853693f5962 service nova] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:10.282291 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdf6f4-e39b-4a91-bbcd-e853693f5962 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:10.290165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccdf6f4-e39b-4a91-bbcd-e853693f5962 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:10.291727 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccdf6f4-e39b-4a91-bbcd-e853693f5962 service nova] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:10.301649 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1335/2695] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:05:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:05:20.231324 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=18 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:20.296850 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=36 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:20.590732 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e27e9-934c-4bb9-b17e-b39875c388f8 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:20.604802 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e27e9-934c-4bb9-b17e-b39875c388f8 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:20.610312 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b27cb-7e27-43a3-b27f-7d62a7be2a2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:20.610909 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b27cb-7e27-43a3-b27f-7d62a7be2a2a service nova] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:20.611605 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b27cb-7e27-43a3-b27f-7d62a7be2a2a service nova] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:20.611878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b27cb-7e27-43a3-b27f-7d62a7be2a2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:20.613877 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-5b5b27cb-7e27-43a3-b27f-7d62a7be2a2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:20.626980 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b27cb-7e27-43a3-b27f-7d62a7be2a2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:20.629096 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b27cb-7e27-43a3-b27f-7d62a7be2a2a service nova] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:20.640342 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1361/2696] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:05:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:05:23.134709 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdf6f4-e39b-4a91-bbcd-e853693f5962 service nova] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:23.136139 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-1ccdf6f4-e39b-4a91-bbcd-e853693f5962 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:23.149120 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdf6f4-e39b-4a91-bbcd-e853693f5962 service nova] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:23.152861 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc08c83-830d-4e84-8248-eafc6341d95f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:23.153475 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc08c83-830d-4e84-8248-eafc6341d95f service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:23.153757 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc08c83-830d-4e84-8248-eafc6341d95f service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:23.154026 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc08c83-830d-4e84-8248-eafc6341d95f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:23.155698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-4fc08c83-830d-4e84-8248-eafc6341d95f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:23.235752 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc08c83-830d-4e84-8248-eafc6341d95f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:23.237168 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc08c83-830d-4e84-8248-eafc6341d95f service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:23.255775 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1336/2697] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:05:23 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:05:25.254269 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81982dd-f212-4c39-855f-78a67536483c None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:25.254785 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81982dd-f212-4c39-855f-78a67536483c None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:25.254785 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81982dd-f212-4c39-855f-78a67536483c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:25.274527 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-f81982dd-f212-4c39-855f-78a67536483c None None] MFA Rules not processed for user `16509e38d0eb491f8ccc940123536a73`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:25.275717 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-f81982dd-f212-4c39-855f-78a67536483c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:25.282558 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1362/2698] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:05:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:27.899153 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc08c83-830d-4e84-8248-eafc6341d95f service cinder] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:27.908479 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc08c83-830d-4e84-8248-eafc6341d95f service cinder] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:27.912557 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f085705-5b4a-448b-9c99-4a6dac64e7fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:27.913144 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f085705-5b4a-448b-9c99-4a6dac64e7fd service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:27.913457 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f085705-5b4a-448b-9c99-4a6dac64e7fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:27.913731 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f085705-5b4a-448b-9c99-4a6dac64e7fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:27.915478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-4f085705-5b4a-448b-9c99-4a6dac64e7fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:27.924688 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f085705-5b4a-448b-9c99-4a6dac64e7fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:27.926764 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f085705-5b4a-448b-9c99-4a6dac64e7fd service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:27.934571 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1337/2699] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:05:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:05:31.407178 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81982dd-f212-4c39-855f-78a67536483c None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:31.417653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81982dd-f212-4c39-855f-78a67536483c None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:31.421135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41157669-ee10-4d8d-85c1-7777a4ff5616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:31.421760 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41157669-ee10-4d8d-85c1-7777a4ff5616 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:31.422033 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41157669-ee10-4d8d-85c1-7777a4ff5616 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:31.422298 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41157669-ee10-4d8d-85c1-7777a4ff5616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:31.424014 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-41157669-ee10-4d8d-85c1-7777a4ff5616 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:31.435600 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41157669-ee10-4d8d-85c1-7777a4ff5616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:31.437003 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41157669-ee10-4d8d-85c1-7777a4ff5616 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:31.446660 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1363/2700] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:05:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:05:34.925027 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f085705-5b4a-448b-9c99-4a6dac64e7fd service neutron] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:34.928125 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-4f085705-5b4a-448b-9c99-4a6dac64e7fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:34.985876 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41157669-ee10-4d8d-85c1-7777a4ff5616 service neutron] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:34.987344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-41157669-ee10-4d8d-85c1-7777a4ff5616 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:35.000339 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41157669-ee10-4d8d-85c1-7777a4ff5616 service neutron] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:35.006086 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbc439-f1b2-4ff8-8d73-ce32d9877a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:35.006915 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbc439-f1b2-4ff8-8d73-ce32d9877a8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:35.007370 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbc439-f1b2-4ff8-8d73-ce32d9877a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:35.007815 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbc439-f1b2-4ff8-8d73-ce32d9877a8a admin admin] PATH_INFO: `/v3/users/ca2075ca15d44405a71e24955ec99da4` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:35.009058 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bbc439-f1b2-4ff8-8d73-ce32d9877a8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca2075ca15d44405a71e24955ec99da4)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:35.011724 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bbc439-f1b2-4ff8-8d73-ce32d9877a8a admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:35.035312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f085705-5b4a-448b-9c99-4a6dac64e7fd service neutron] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:35.042927 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a976f2e-82e6-4a39-84e4-58c13e48a64d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b33f797a9af946a4b296d973388891be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:35.043589 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a976f2e-82e6-4a39-84e4-58c13e48a64d service placement] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:35.043902 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a976f2e-82e6-4a39-84e4-58c13e48a64d service placement] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:35.044204 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a976f2e-82e6-4a39-84e4-58c13e48a64d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:35.046317 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-9a976f2e-82e6-4a39-84e4-58c13e48a64d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:35.060548 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a976f2e-82e6-4a39-84e4-58c13e48a64d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:35.062281 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a976f2e-82e6-4a39-84e4-58c13e48a64d service placement] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:35.068847 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-73bbc439-f1b2-4ff8-8d73-ce32d9877a8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca2075ca15d44405a71e24955ec99da4'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:35.074810 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1338/2701] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:05:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:05:35.086036 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-73bbc439-f1b2-4ff8-8d73-ce32d9877a8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca2075ca15d44405a71e24955ec99da4'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:35.086739 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-73bbc439-f1b2-4ff8-8d73-ce32d9877a8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca2075ca15d44405a71e24955ec99da4'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:35.098530 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-73bbc439-f1b2-4ff8-8d73-ce32d9877a8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca2075ca15d44405a71e24955ec99da4'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:35.108392 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-73bbc439-f1b2-4ff8-8d73-ce32d9877a8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca2075ca15d44405a71e24955ec99da4'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:35.119145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1364/2702] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:05:34 2022] DELETE /identity/v3/users/ca2075ca15d44405a71e24955ec99da4 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:05:35.329833 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a976f2e-82e6-4a39-84e4-58c13e48a64d service placement] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:35.350181 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a976f2e-82e6-4a39-84e4-58c13e48a64d service placement] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:35.394510 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:35.407530 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b3abb-ec26-4c20-b834-4dc69c7b08fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:35.408154 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b3abb-ec26-4c20-b834-4dc69c7b08fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:35.408432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b3abb-ec26-4c20-b834-4dc69c7b08fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:35.408703 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b3abb-ec26-4c20-b834-4dc69c7b08fc admin admin] PATH_INFO: `/v3/projects/398d222dff9a41ce9b5340145bcf61b2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:35.409870 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b3abb-ec26-4c20-b834-4dc69c7b08fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=398d222dff9a41ce9b5340145bcf61b2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:35.412280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b3abb-ec26-4c20-b834-4dc69c7b08fc admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:35.457253 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-c60b3abb-ec26-4c20-b834-4dc69c7b08fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '398d222dff9a41ce9b5340145bcf61b2', 'request_id': 'req-c60b3abb-ec26-4c20-b834-4dc69c7b08fc'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:35.463003 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-c60b3abb-ec26-4c20-b834-4dc69c7b08fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '398d222dff9a41ce9b5340145bcf61b2', 'request_id': 'req-c60b3abb-ec26-4c20-b834-4dc69c7b08fc'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:35.469247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-c60b3abb-ec26-4c20-b834-4dc69c7b08fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '398d222dff9a41ce9b5340145bcf61b2', 'request_id': 'req-c60b3abb-ec26-4c20-b834-4dc69c7b08fc'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:35.482154 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-c60b3abb-ec26-4c20-b834-4dc69c7b08fc admin admin] The token cache is being invalidate because project 398d222dff9a41ce9b5340145bcf61b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:05:35.482479 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-c60b3abb-ec26-4c20-b834-4dc69c7b08fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:35.483133 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-c60b3abb-ec26-4c20-b834-4dc69c7b08fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:35.484584 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1339/2703] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:05:35 2022] DELETE /identity/v3/projects/398d222dff9a41ce9b5340145bcf61b2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:05:35.490143 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b94bdf-8b7d-42b7-91bc-3e2fc7f41722 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:35.490489 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b94bdf-8b7d-42b7-91bc-3e2fc7f41722 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:35.490764 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b94bdf-8b7d-42b7-91bc-3e2fc7f41722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:35.510043 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-81b94bdf-8b7d-42b7-91bc-3e2fc7f41722 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:35.511374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-81b94bdf-8b7d-42b7-91bc-3e2fc7f41722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:35.570397 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1365/2704] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:35.578398 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c77b4-8e90-4160-beba-53846940c5c5 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:35.578675 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c77b4-8e90-4160-beba-53846940c5c5 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:35.578938 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c77b4-8e90-4160-beba-53846940c5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:35.598063 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-138c77b4-8e90-4160-beba-53846940c5c5 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:35.599803 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-138c77b4-8e90-4160-beba-53846940c5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:35.607935 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1340/2705] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:35.612096 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b94bdf-8b7d-42b7-91bc-3e2fc7f41722 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:35.622629 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b94bdf-8b7d-42b7-91bc-3e2fc7f41722 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:35.627170 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9a8e4-1c20-4b39-a8aa-0fff4277068e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:35.627807 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9a8e4-1c20-4b39-a8aa-0fff4277068e admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:35.628079 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9a8e4-1c20-4b39-a8aa-0fff4277068e admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:35.628341 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9a8e4-1c20-4b39-a8aa-0fff4277068e admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:35.629025 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d9a8e4-1c20-4b39-a8aa-0fff4277068e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 11:05:35.629348 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d9a8e4-1c20-4b39-a8aa-0fff4277068e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:35.630928 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d9a8e4-1c20-4b39-a8aa-0fff4277068e admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:35.642361 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1366/2706] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 11:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 11:05:35.647028 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c77b4-8e90-4160-beba-53846940c5c5 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:35.655959 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c77b4-8e90-4160-beba-53846940c5c5 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:35.660565 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc7c6e-9c7e-4a82-a098-c76f3d901486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:35.661746 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc7c6e-9c7e-4a82-a098-c76f3d901486 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:35.662021 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc7c6e-9c7e-4a82-a098-c76f3d901486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:35.662285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc7c6e-9c7e-4a82-a098-c76f3d901486 admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:35.662902 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc7c6e-9c7e-4a82-a098-c76f3d901486 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:35.664733 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc7c6e-9c7e-4a82-a098-c76f3d901486 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:35.690988 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1341/2707] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:05:35 2022] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 11:05:35.695062 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9a8e4-1c20-4b39-a8aa-0fff4277068e admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:35.705112 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9a8e4-1c20-4b39-a8aa-0fff4277068e admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:35.730287 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:35.763725 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624013f-def1-44d6-81fe-24304aa7176f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:35.764343 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624013f-def1-44d6-81fe-24304aa7176f admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:35.764655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624013f-def1-44d6-81fe-24304aa7176f admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:35.764924 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624013f-def1-44d6-81fe-24304aa7176f admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:35.765565 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624013f-def1-44d6-81fe-24304aa7176f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:35.767708 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624013f-def1-44d6-81fe-24304aa7176f admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:35.787966 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1367/2708] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:05:35 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:05:35.792297 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc7c6e-9c7e-4a82-a098-c76f3d901486 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:35.802852 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc7c6e-9c7e-4a82-a098-c76f3d901486 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:35.807692 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746bf420-a3aa-4b22-a6e6-c74d4072ef14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:35.808274 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bf420-a3aa-4b22-a6e6-c74d4072ef14 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:35.808548 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bf420-a3aa-4b22-a6e6-c74d4072ef14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:35.808816 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bf420-a3aa-4b22-a6e6-c74d4072ef14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:35.809495 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746bf420-a3aa-4b22-a6e6-c74d4072ef14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:35.811058 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746bf420-a3aa-4b22-a6e6-c74d4072ef14 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:35.821505 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1342/2709] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:05:35.825226 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624013f-def1-44d6-81fe-24304aa7176f admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:35.835100 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624013f-def1-44d6-81fe-24304aa7176f admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:35.839646 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdeb14d-1bf9-4f8b-8ceb-fda22defe4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:35.840217 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdeb14d-1bf9-4f8b-8ceb-fda22defe4ec admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:35.840491 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdeb14d-1bf9-4f8b-8ceb-fda22defe4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:35.840757 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdeb14d-1bf9-4f8b-8ceb-fda22defe4ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:35.841411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdeb14d-1bf9-4f8b-8ceb-fda22defe4ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:35.842964 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdeb14d-1bf9-4f8b-8ceb-fda22defe4ec admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:35.853126 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1368/2710] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 11:05:35.857148 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746bf420-a3aa-4b22-a6e6-c74d4072ef14 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:35.867485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746bf420-a3aa-4b22-a6e6-c74d4072ef14 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:35.872169 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97e1fc-a68c-4b22-9b11-e3e951ccc0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:35.872792 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97e1fc-a68c-4b22-9b11-e3e951ccc0d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:35.873063 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97e1fc-a68c-4b22-9b11-e3e951ccc0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:35.873341 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97e1fc-a68c-4b22-9b11-e3e951ccc0d2 admin admin] PATH_INFO: `/v3/projects/e048228339dd42b1803698dec6ace7d8/users/fd11364affab4ad6bd331d109a433931/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:35.887852 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97e1fc-a68c-4b22-9b11-e3e951ccc0d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e048228339dd42b1803698dec6ace7d8, user_id=fd11364affab4ad6bd331d109a433931, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:35.890474 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97e1fc-a68c-4b22-9b11-e3e951ccc0d2 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:35.904212 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1343/2711] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:05:35 2022] PUT /identity/v3/projects/e048228339dd42b1803698dec6ace7d8/users/fd11364affab4ad6bd331d109a433931/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:05:35.914850 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8afac-d54d-4837-81cc-ffe6bc98a258 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:35.915138 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8afac-d54d-4837-81cc-ffe6bc98a258 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:35.915405 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8afac-d54d-4837-81cc-ffe6bc98a258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:35.942922 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-8db8afac-d54d-4837-81cc-ffe6bc98a258 None None] MFA Rules not processed for user `fd11364affab4ad6bd331d109a433931`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:35.944114 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-8db8afac-d54d-4837-81cc-ffe6bc98a258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:36.006221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1369/2712] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:05:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 11:05:36.010569 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97e1fc-a68c-4b22-9b11-e3e951ccc0d2 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:36.071419 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97e1fc-a68c-4b22-9b11-e3e951ccc0d2 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:36.076195 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c3f54-e050-47bc-bea4-436a112ff8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:36.076791 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c3f54-e050-47bc-bea4-436a112ff8d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:36.077097 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c3f54-e050-47bc-bea4-436a112ff8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:36.077441 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c3f54-e050-47bc-bea4-436a112ff8d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:36.078159 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c3f54-e050-47bc-bea4-436a112ff8d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:36.080127 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c3f54-e050-47bc-bea4-436a112ff8d9 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:36.100824 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:36.109158 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1344/2713] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:05:36 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:05:36.113546 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db8afac-d54d-4837-81cc-ffe6bc98a258 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:36.127523 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db8afac-d54d-4837-81cc-ffe6bc98a258 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:36.186636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488654f7-01a9-4225-a8e9-d929c3c2548c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:36.187236 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488654f7-01a9-4225-a8e9-d929c3c2548c admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:36.187548 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488654f7-01a9-4225-a8e9-d929c3c2548c admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:36.187776 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488654f7-01a9-4225-a8e9-d929c3c2548c admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:36.188400 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488654f7-01a9-4225-a8e9-d929c3c2548c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:36.190365 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488654f7-01a9-4225-a8e9-d929c3c2548c admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:36.213020 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1370/2714] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:05:36 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 11:05:36.217042 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c3f54-e050-47bc-bea4-436a112ff8d9 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:36.227942 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c3f54-e050-47bc-bea4-436a112ff8d9 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:36.232517 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29801971-6426-41b5-a0e9-ec4b7e065981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:36.233095 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29801971-6426-41b5-a0e9-ec4b7e065981 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:36.233395 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29801971-6426-41b5-a0e9-ec4b7e065981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:36.233665 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29801971-6426-41b5-a0e9-ec4b7e065981 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:36.234302 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29801971-6426-41b5-a0e9-ec4b7e065981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:36.235900 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29801971-6426-41b5-a0e9-ec4b7e065981 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:36.247017 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1345/2715] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:05:36.251186 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488654f7-01a9-4225-a8e9-d929c3c2548c admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:36.261078 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488654f7-01a9-4225-a8e9-d929c3c2548c admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:36.265690 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cf1e2-fc08-4152-b474-1c22fd86bdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:36.266306 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cf1e2-fc08-4152-b474-1c22fd86bdee admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:36.266835 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cf1e2-fc08-4152-b474-1c22fd86bdee admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:36.267105 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cf1e2-fc08-4152-b474-1c22fd86bdee admin admin] PATH_INFO: `/v3/projects/4ce9a3ae32e54bf3b6e2a896fdac2cb3/users/d182ebcd996e41fbaa5875c42c6a575d/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:36.282353 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cf1e2-fc08-4152-b474-1c22fd86bdee admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce9a3ae32e54bf3b6e2a896fdac2cb3, user_id=d182ebcd996e41fbaa5875c42c6a575d, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:36.285027 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cf1e2-fc08-4152-b474-1c22fd86bdee admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:36.293952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:36.298883 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1371/2716] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:05:36 2022] PUT /identity/v3/projects/4ce9a3ae32e54bf3b6e2a896fdac2cb3/users/d182ebcd996e41fbaa5875c42c6a575d/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:05:36.303524 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29801971-6426-41b5-a0e9-ec4b7e065981 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:36.314329 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29801971-6426-41b5-a0e9-ec4b7e065981 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:36.383670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077e376-2ce5-4581-a920-0a284f844d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:36.384419 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077e376-2ce5-4581-a920-0a284f844d77 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:36.384691 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077e376-2ce5-4581-a920-0a284f844d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:36.384953 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077e376-2ce5-4581-a920-0a284f844d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:36.385756 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077e376-2ce5-4581-a920-0a284f844d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:36.387342 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077e376-2ce5-4581-a920-0a284f844d77 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:36.398195 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1346/2717] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:05:36.402400 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cf1e2-fc08-4152-b474-1c22fd86bdee admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:36.413266 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cf1e2-fc08-4152-b474-1c22fd86bdee admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:36.417952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf92a33-030d-48c5-89cf-b141b901d00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:36.418589 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf92a33-030d-48c5-89cf-b141b901d00c admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:36.418861 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf92a33-030d-48c5-89cf-b141b901d00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:36.419127 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf92a33-030d-48c5-89cf-b141b901d00c admin admin] PATH_INFO: `/v3/projects/4ce9a3ae32e54bf3b6e2a896fdac2cb3/users/d182ebcd996e41fbaa5875c42c6a575d/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:36.421011 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf92a33-030d-48c5-89cf-b141b901d00c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce9a3ae32e54bf3b6e2a896fdac2cb3, user_id=d182ebcd996e41fbaa5875c42c6a575d, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:36.423629 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf92a33-030d-48c5-89cf-b141b901d00c admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:36.433956 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1372/2718] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:05:36 2022] PUT /identity/v3/projects/4ce9a3ae32e54bf3b6e2a896fdac2cb3/users/d182ebcd996e41fbaa5875c42c6a575d/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 11:05:36.445732 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709243c2-26b4-4b7d-98bc-dd4439013dd9 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:36.446086 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709243c2-26b4-4b7d-98bc-dd4439013dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:36.446280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709243c2-26b4-4b7d-98bc-dd4439013dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:36.474276 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-709243c2-26b4-4b7d-98bc-dd4439013dd9 None None] MFA Rules not processed for user `d182ebcd996e41fbaa5875c42c6a575d`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:36.475475 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-709243c2-26b4-4b7d-98bc-dd4439013dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:36.544607 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1347/2719] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:05:36 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:36.556146 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf92a33-030d-48c5-89cf-b141b901d00c admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:36.557904 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-7cf92a33-030d-48c5-89cf-b141b901d00c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:36.616355 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf92a33-030d-48c5-89cf-b141b901d00c admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:36.620012 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977cd4d9-a895-4538-92bd-7c41ff827bf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:36.620600 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cd4d9-a895-4538-92bd-7c41ff827bf2 service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:36.620869 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cd4d9-a895-4538-92bd-7c41ff827bf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:36.621130 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977cd4d9-a895-4538-92bd-7c41ff827bf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:36.631438 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977cd4d9-a895-4538-92bd-7c41ff827bf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:36.632930 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977cd4d9-a895-4538-92bd-7c41ff827bf2 service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:36.643091 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1373/2720] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:05:36 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:05:37.067244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709243c2-26b4-4b7d-98bc-dd4439013dd9 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:37.130728 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709243c2-26b4-4b7d-98bc-dd4439013dd9 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:37.136106 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e68968-2e94-40e9-ac00-c4366ca91d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:37.136727 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e68968-2e94-40e9-ac00-c4366ca91d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:37.137048 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e68968-2e94-40e9-ac00-c4366ca91d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:37.137360 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e68968-2e94-40e9-ac00-c4366ca91d01 admin admin] PATH_INFO: `/v3/users/fd11364affab4ad6bd331d109a433931` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:37.138511 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e68968-2e94-40e9-ac00-c4366ca91d01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd11364affab4ad6bd331d109a433931)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:37.140425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e68968-2e94-40e9-ac00-c4366ca91d01 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:37.151199 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:37.185993 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-a9e68968-2e94-40e9-ac00-c4366ca91d01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd11364affab4ad6bd331d109a433931'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:37.197518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-a9e68968-2e94-40e9-ac00-c4366ca91d01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd11364affab4ad6bd331d109a433931'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:37.198199 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-a9e68968-2e94-40e9-ac00-c4366ca91d01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd11364affab4ad6bd331d109a433931'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:37.204979 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-a9e68968-2e94-40e9-ac00-c4366ca91d01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd11364affab4ad6bd331d109a433931'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:37.212577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-a9e68968-2e94-40e9-ac00-c4366ca91d01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd11364affab4ad6bd331d109a433931'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:37.218368 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1348/2721] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:05:37 2022] DELETE /identity/v3/users/fd11364affab4ad6bd331d109a433931 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:05:37.222786 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf54e7-c9ee-4ca2-b684-1bc710dc33d3 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:37.223303 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf54e7-c9ee-4ca2-b684-1bc710dc33d3 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:37.223303 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf54e7-c9ee-4ca2-b684-1bc710dc33d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:37.241828 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-01bf54e7-c9ee-4ca2-b684-1bc710dc33d3 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:37.242998 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-01bf54e7-c9ee-4ca2-b684-1bc710dc33d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:37.301160 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1374/2722] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:37.310635 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e68968-2e94-40e9-ac00-c4366ca91d01 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:37.312071 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a9e68968-2e94-40e9-ac00-c4366ca91d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:37.370391 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e68968-2e94-40e9-ac00-c4366ca91d01 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:37.374034 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf0627-7340-4c3c-8698-960894a4a31c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:37.374630 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf0627-7340-4c3c-8698-960894a4a31c service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:37.374911 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf0627-7340-4c3c-8698-960894a4a31c service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:37.375187 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf0627-7340-4c3c-8698-960894a4a31c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:37.383972 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf0627-7340-4c3c-8698-960894a4a31c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:37.385412 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf0627-7340-4c3c-8698-960894a4a31c service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:37.395975 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1349/2723] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:05:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:05:37.668198 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf54e7-c9ee-4ca2-b684-1bc710dc33d3 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:37.669635 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-01bf54e7-c9ee-4ca2-b684-1bc710dc33d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:37.681303 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf54e7-c9ee-4ca2-b684-1bc710dc33d3 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:37.685921 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6626a55-ddf9-4510-bd76-27562c816a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:37.686551 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6626a55-ddf9-4510-bd76-27562c816a4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:37.686817 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6626a55-ddf9-4510-bd76-27562c816a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:37.687087 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6626a55-ddf9-4510-bd76-27562c816a4a admin admin] PATH_INFO: `/v3/projects/e048228339dd42b1803698dec6ace7d8` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:37.688200 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6626a55-ddf9-4510-bd76-27562c816a4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e048228339dd42b1803698dec6ace7d8)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:37.690168 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6626a55-ddf9-4510-bd76-27562c816a4a admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:37.736655 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d6626a55-ddf9-4510-bd76-27562c816a4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e048228339dd42b1803698dec6ace7d8', 'request_id': 'req-d6626a55-ddf9-4510-bd76-27562c816a4a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:37.742186 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d6626a55-ddf9-4510-bd76-27562c816a4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e048228339dd42b1803698dec6ace7d8', 'request_id': 'req-d6626a55-ddf9-4510-bd76-27562c816a4a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:37.749144 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d6626a55-ddf9-4510-bd76-27562c816a4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e048228339dd42b1803698dec6ace7d8', 'request_id': 'req-d6626a55-ddf9-4510-bd76-27562c816a4a'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:37.761175 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d6626a55-ddf9-4510-bd76-27562c816a4a admin admin] The token cache is being invalidate because project e048228339dd42b1803698dec6ace7d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:05:37.761490 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d6626a55-ddf9-4510-bd76-27562c816a4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:37.762107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d6626a55-ddf9-4510-bd76-27562c816a4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:37.763567 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1375/2724] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:05:37 2022] DELETE /identity/v3/projects/e048228339dd42b1803698dec6ace7d8 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:05:37.767799 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf0627-7340-4c3c-8698-960894a4a31c service neutron] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:37.778223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf0627-7340-4c3c-8698-960894a4a31c service neutron] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:37.832397 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e66005-1463-49ae-9a71-cb04eb500698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:37.833506 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e66005-1463-49ae-9a71-cb04eb500698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:37.833781 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e66005-1463-49ae-9a71-cb04eb500698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:37.834068 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e66005-1463-49ae-9a71-cb04eb500698 admin admin] PATH_INFO: `/v3/users/d182ebcd996e41fbaa5875c42c6a575d` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:37.835234 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e66005-1463-49ae-9a71-cb04eb500698 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d182ebcd996e41fbaa5875c42c6a575d)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:37.837385 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e66005-1463-49ae-9a71-cb04eb500698 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:37.877753 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:37.892494 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-26e66005-1463-49ae-9a71-cb04eb500698 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd182ebcd996e41fbaa5875c42c6a575d'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:37.904258 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-26e66005-1463-49ae-9a71-cb04eb500698 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd182ebcd996e41fbaa5875c42c6a575d'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:37.904928 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-26e66005-1463-49ae-9a71-cb04eb500698 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd182ebcd996e41fbaa5875c42c6a575d'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:37.911996 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-26e66005-1463-49ae-9a71-cb04eb500698 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd182ebcd996e41fbaa5875c42c6a575d'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:37.919188 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-26e66005-1463-49ae-9a71-cb04eb500698 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd182ebcd996e41fbaa5875c42c6a575d'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:37.924958 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1350/2725] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:05:37 2022] DELETE /identity/v3/users/d182ebcd996e41fbaa5875c42c6a575d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:05:38.202009 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6626a55-ddf9-4510-bd76-27562c816a4a admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:38.203652 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-d6626a55-ddf9-4510-bd76-27562c816a4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:38.218135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6626a55-ddf9-4510-bd76-27562c816a4a admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:38.228283 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:38.277950 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a368edb-cf45-4019-9dfd-d16e6350a60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:38.278575 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a368edb-cf45-4019-9dfd-d16e6350a60d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:38.278860 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a368edb-cf45-4019-9dfd-d16e6350a60d admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:38.279129 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a368edb-cf45-4019-9dfd-d16e6350a60d admin admin] PATH_INFO: `/v3/projects/4ce9a3ae32e54bf3b6e2a896fdac2cb3` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:38.280243 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a368edb-cf45-4019-9dfd-d16e6350a60d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ce9a3ae32e54bf3b6e2a896fdac2cb3)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:38.282206 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a368edb-cf45-4019-9dfd-d16e6350a60d admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:38.327556 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-0a368edb-cf45-4019-9dfd-d16e6350a60d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ce9a3ae32e54bf3b6e2a896fdac2cb3', 'request_id': 'req-0a368edb-cf45-4019-9dfd-d16e6350a60d'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:38.335303 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-0a368edb-cf45-4019-9dfd-d16e6350a60d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ce9a3ae32e54bf3b6e2a896fdac2cb3', 'request_id': 'req-0a368edb-cf45-4019-9dfd-d16e6350a60d'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:38.342091 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-0a368edb-cf45-4019-9dfd-d16e6350a60d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ce9a3ae32e54bf3b6e2a896fdac2cb3', 'request_id': 'req-0a368edb-cf45-4019-9dfd-d16e6350a60d'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:38.354838 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-0a368edb-cf45-4019-9dfd-d16e6350a60d admin admin] The token cache is being invalidate because project 4ce9a3ae32e54bf3b6e2a896fdac2cb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:05:38.355129 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-0a368edb-cf45-4019-9dfd-d16e6350a60d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:38.355817 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-0a368edb-cf45-4019-9dfd-d16e6350a60d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:38.357386 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1376/2726] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:05:38 2022] DELETE /identity/v3/projects/4ce9a3ae32e54bf3b6e2a896fdac2cb3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 11:05:38.362496 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636502da-ca73-40f5-870b-92776f4ef5ca None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:38.362969 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636502da-ca73-40f5-870b-92776f4ef5ca None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:38.363069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636502da-ca73-40f5-870b-92776f4ef5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:38.383739 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-636502da-ca73-40f5-870b-92776f4ef5ca None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:38.384914 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-636502da-ca73-40f5-870b-92776f4ef5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:38.441756 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1351/2727] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:38.449735 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c30cd-a6e1-45ec-93bc-0c70944038e7 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:38.450014 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c30cd-a6e1-45ec-93bc-0c70944038e7 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:38.450284 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c30cd-a6e1-45ec-93bc-0c70944038e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:38.469479 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-806c30cd-a6e1-45ec-93bc-0c70944038e7 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:38.470659 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-806c30cd-a6e1-45ec-93bc-0c70944038e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:38.478996 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1377/2728] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 11:05:38.483059 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636502da-ca73-40f5-870b-92776f4ef5ca None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:38.493073 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636502da-ca73-40f5-870b-92776f4ef5ca None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:38.497680 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025444ad-d58d-4e60-b5c8-a7553f43efe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:38.498264 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025444ad-d58d-4e60-b5c8-a7553f43efe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:38.498543 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025444ad-d58d-4e60-b5c8-a7553f43efe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:38.498812 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025444ad-d58d-4e60-b5c8-a7553f43efe9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:38.499455 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025444ad-d58d-4e60-b5c8-a7553f43efe9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 11:05:38.499781 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025444ad-d58d-4e60-b5c8-a7553f43efe9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:38.501378 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025444ad-d58d-4e60-b5c8-a7553f43efe9 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:38.512788 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1352/2729] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 11:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 11:05:38.517109 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c30cd-a6e1-45ec-93bc-0c70944038e7 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:38.526757 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c30cd-a6e1-45ec-93bc-0c70944038e7 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:38.531464 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77b60f-bff1-4432-b583-bae49caa148a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:38.532042 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77b60f-bff1-4432-b583-bae49caa148a admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:38.532317 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77b60f-bff1-4432-b583-bae49caa148a admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:38.532586 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77b60f-bff1-4432-b583-bae49caa148a admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:38.533210 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb77b60f-bff1-4432-b583-bae49caa148a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:38.535114 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb77b60f-bff1-4432-b583-bae49caa148a admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:38.565338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1378/2730] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:05:38 2022] POST /identity/v3/projects => generated 401 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:05:38.566441 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025444ad-d58d-4e60-b5c8-a7553f43efe9 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:38.576390 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025444ad-d58d-4e60-b5c8-a7553f43efe9 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:38.632330 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2f643-d6ec-4088-ab3f-ec8a9913800c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:38.632924 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2f643-d6ec-4088-ab3f-ec8a9913800c admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:38.633201 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2f643-d6ec-4088-ab3f-ec8a9913800c admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:38.633504 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2f643-d6ec-4088-ab3f-ec8a9913800c admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:38.634128 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2f643-d6ec-4088-ab3f-ec8a9913800c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:38.636016 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2f643-d6ec-4088-ab3f-ec8a9913800c admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:38.657972 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1353/2731] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:05:38 2022] POST /identity/v3/users => generated 301 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 11:05:38.662845 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77b60f-bff1-4432-b583-bae49caa148a admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:38.673012 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77b60f-bff1-4432-b583-bae49caa148a admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:38.677663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302199ec-dc3f-434e-b3a4-b3e13a17b635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:38.678247 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302199ec-dc3f-434e-b3a4-b3e13a17b635 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:38.678553 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302199ec-dc3f-434e-b3a4-b3e13a17b635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:38.678823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302199ec-dc3f-434e-b3a4-b3e13a17b635 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:38.679459 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302199ec-dc3f-434e-b3a4-b3e13a17b635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:38.681076 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302199ec-dc3f-434e-b3a4-b3e13a17b635 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:38.690983 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1379/2732] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:05:38.694792 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2f643-d6ec-4088-ab3f-ec8a9913800c admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:38.704482 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2f643-d6ec-4088-ab3f-ec8a9913800c admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:38.709573 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468e3c2-abf1-4899-a6d8-59138ad64aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:38.710145 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468e3c2-abf1-4899-a6d8-59138ad64aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:38.710419 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468e3c2-abf1-4899-a6d8-59138ad64aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:38.710686 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468e3c2-abf1-4899-a6d8-59138ad64aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:38.711324 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0468e3c2-abf1-4899-a6d8-59138ad64aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:38.712910 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0468e3c2-abf1-4899-a6d8-59138ad64aa8 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:38.723055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1354/2733] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:05:38.727538 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302199ec-dc3f-434e-b3a4-b3e13a17b635 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:38.737393 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302199ec-dc3f-434e-b3a4-b3e13a17b635 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:38.741976 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97f722-b75e-4f9d-b85a-1686b284cfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:38.742602 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97f722-b75e-4f9d-b85a-1686b284cfc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:38.742882 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97f722-b75e-4f9d-b85a-1686b284cfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:38.743150 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97f722-b75e-4f9d-b85a-1686b284cfc2 admin admin] PATH_INFO: `/v3/projects/254f4bff1af7435db44782d61ece3e99/users/e0afd0756ace4b698f1481f7cca3806e/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:38.757298 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97f722-b75e-4f9d-b85a-1686b284cfc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=254f4bff1af7435db44782d61ece3e99, user_id=e0afd0756ace4b698f1481f7cca3806e, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:38.759930 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97f722-b75e-4f9d-b85a-1686b284cfc2 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:38.772881 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1380/2734] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:05:38 2022] PUT /identity/v3/projects/254f4bff1af7435db44782d61ece3e99/users/e0afd0756ace4b698f1481f7cca3806e/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:05:38.784558 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f122e-80e1-48d3-92b0-6dd7772073fa None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:38.784839 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f122e-80e1-48d3-92b0-6dd7772073fa None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:38.785107 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f122e-80e1-48d3-92b0-6dd7772073fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:38.811932 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-3d0f122e-80e1-48d3-92b0-6dd7772073fa None None] MFA Rules not processed for user `e0afd0756ace4b698f1481f7cca3806e`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:38.813095 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-3d0f122e-80e1-48d3-92b0-6dd7772073fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:38.816948 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:38.880936 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1355/2735] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:05:38 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:38.885654 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97f722-b75e-4f9d-b85a-1686b284cfc2 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:38.930161 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:38.951551 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97f722-b75e-4f9d-b85a-1686b284cfc2 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:38.956369 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691f9b5-3d9b-4771-90bc-d5b9b404036d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:38.957680 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691f9b5-3d9b-4771-90bc-d5b9b404036d admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:38.957969 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691f9b5-3d9b-4771-90bc-d5b9b404036d admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:38.958243 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691f9b5-3d9b-4771-90bc-d5b9b404036d admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:38.958914 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691f9b5-3d9b-4771-90bc-d5b9b404036d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:38.960772 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691f9b5-3d9b-4771-90bc-d5b9b404036d admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:38.987586 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1381/2736] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:05:38 2022] POST /identity/v3/projects => generated 399 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 11:05:38.992411 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f122e-80e1-48d3-92b0-6dd7772073fa None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:39.003258 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f122e-80e1-48d3-92b0-6dd7772073fa None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:39.062927 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a654ddd-ae6b-4c37-9121-2950a843bb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:39.063519 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a654ddd-ae6b-4c37-9121-2950a843bb51 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:39.063798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a654ddd-ae6b-4c37-9121-2950a843bb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:39.064064 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a654ddd-ae6b-4c37-9121-2950a843bb51 admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:39.064687 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a654ddd-ae6b-4c37-9121-2950a843bb51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:39.066672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a654ddd-ae6b-4c37-9121-2950a843bb51 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:39.093457 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1356/2737] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:05:38 2022] POST /identity/v3/users => generated 306 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:05:39.097542 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691f9b5-3d9b-4771-90bc-d5b9b404036d admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:39.114691 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691f9b5-3d9b-4771-90bc-d5b9b404036d admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:39.116334 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e85d7-5171-491c-8c44-8aba9730e9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:39.116940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e85d7-5171-491c-8c44-8aba9730e9fa admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:39.117221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e85d7-5171-491c-8c44-8aba9730e9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:39.117536 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e85d7-5171-491c-8c44-8aba9730e9fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:39.118184 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e85d7-5171-491c-8c44-8aba9730e9fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:39.119827 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e85d7-5171-491c-8c44-8aba9730e9fa admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:39.130872 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1382/2738] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:05:39.135632 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a654ddd-ae6b-4c37-9121-2950a843bb51 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:39.146506 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a654ddd-ae6b-4c37-9121-2950a843bb51 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:39.151478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49fe19e-bdaf-446d-b121-c0a01182b97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:39.152123 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fe19e-bdaf-446d-b121-c0a01182b97e admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:39.152407 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fe19e-bdaf-446d-b121-c0a01182b97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:39.152698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fe19e-bdaf-446d-b121-c0a01182b97e admin admin] PATH_INFO: `/v3/projects/b7396b9c10ce4fe7b76a3665d15fd385/users/391d00c12f124fe2b2365d845ff00c51/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:39.170256 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49fe19e-bdaf-446d-b121-c0a01182b97e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7396b9c10ce4fe7b76a3665d15fd385, user_id=391d00c12f124fe2b2365d845ff00c51, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:39.173178 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49fe19e-bdaf-446d-b121-c0a01182b97e admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:39.187876 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1357/2739] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:05:39 2022] PUT /identity/v3/projects/b7396b9c10ce4fe7b76a3665d15fd385/users/391d00c12f124fe2b2365d845ff00c51/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:05:39.192122 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e85d7-5171-491c-8c44-8aba9730e9fa admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:39.203114 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e85d7-5171-491c-8c44-8aba9730e9fa admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:39.221439 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66f56b-b09b-41aa-a747-64c1095d94f0 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:39.221721 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66f56b-b09b-41aa-a747-64c1095d94f0 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:39.221993 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66f56b-b09b-41aa-a747-64c1095d94f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:39.242647 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-3a66f56b-b09b-41aa-a747-64c1095d94f0 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:39.243832 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-3a66f56b-b09b-41aa-a747-64c1095d94f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:39.262068 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0eb104-c9fb-4829-b509-615012c9bd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:39.262666 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0eb104-c9fb-4829-b509-615012c9bd50 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:39.262944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0eb104-c9fb-4829-b509-615012c9bd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:39.263216 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0eb104-c9fb-4829-b509-615012c9bd50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:39.263856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0eb104-c9fb-4829-b509-615012c9bd50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:39.265457 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0eb104-c9fb-4829-b509-615012c9bd50 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:39.275957 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1383/2740] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:05:39.280193 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0eb104-c9fb-4829-b509-615012c9bd50 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:39.291843 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0eb104-c9fb-4829-b509-615012c9bd50 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:39.296671 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de2c60-e41f-4d82-af71-e59403536df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:39.297333 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de2c60-e41f-4d82-af71-e59403536df0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:39.297622 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de2c60-e41f-4d82-af71-e59403536df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:39.297893 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de2c60-e41f-4d82-af71-e59403536df0 admin admin] PATH_INFO: `/v3/projects/b7396b9c10ce4fe7b76a3665d15fd385/users/391d00c12f124fe2b2365d845ff00c51/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:39.299832 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de2c60-e41f-4d82-af71-e59403536df0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7396b9c10ce4fe7b76a3665d15fd385, user_id=391d00c12f124fe2b2365d845ff00c51, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:39.303108 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de2c60-e41f-4d82-af71-e59403536df0 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:39.306623 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1358/2741] 10.222.0.30 () {58 vars in 1016 bytes} [Sun Aug 7 11:05:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 11:05:39.313645 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1384/2742] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:05:39 2022] PUT /identity/v3/projects/b7396b9c10ce4fe7b76a3665d15fd385/users/391d00c12f124fe2b2365d845ff00c51/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 11:05:39.324653 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e91e3f-6d22-478e-a87d-b433118851a8 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:39.324843 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de2c60-e41f-4d82-af71-e59403536df0 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:39.324993 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e91e3f-6d22-478e-a87d-b433118851a8 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:39.325436 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e91e3f-6d22-478e-a87d-b433118851a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:39.326553 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-b7de2c60-e41f-4d82-af71-e59403536df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:39.347610 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:39.357718 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-c6e91e3f-6d22-478e-a87d-b433118851a8 None None] MFA Rules not processed for user `391d00c12f124fe2b2365d845ff00c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:39.359106 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-c6e91e3f-6d22-478e-a87d-b433118851a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:39.403754 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de2c60-e41f-4d82-af71-e59403536df0 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:39.409508 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9d25e-53e7-4d0d-8feb-63a1959bc1be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:39.410106 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9d25e-53e7-4d0d-8feb-63a1959bc1be service nova] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:39.410383 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9d25e-53e7-4d0d-8feb-63a1959bc1be service nova] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:39.410679 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9d25e-53e7-4d0d-8feb-63a1959bc1be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:39.429985 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1359/2743] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:05:39 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:39.440816 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e91e3f-6d22-478e-a87d-b433118851a8 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:39.442677 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-c6e91e3f-6d22-478e-a87d-b433118851a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:39.443970 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:39.478555 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9d25e-53e7-4d0d-8feb-63a1959bc1be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:39.480142 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9d25e-53e7-4d0d-8feb-63a1959bc1be service nova] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:39.490411 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1385/2744] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:05:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 11:05:39.502244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e91e3f-6d22-478e-a87d-b433118851a8 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:39.505890 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d45af9-0c81-4945-abd4-e57c0976ccd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:39.506481 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d45af9-0c81-4945-abd4-e57c0976ccd9 service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:39.506758 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d45af9-0c81-4945-abd4-e57c0976ccd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:39.507026 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d45af9-0c81-4945-abd4-e57c0976ccd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:39.521369 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d45af9-0c81-4945-abd4-e57c0976ccd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:39.523736 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d45af9-0c81-4945-abd4-e57c0976ccd9 service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:39.534002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1360/2745] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:05:39 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 11:05:39.613149 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9d25e-53e7-4d0d-8feb-63a1959bc1be service nova] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:39.622817 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9d25e-53e7-4d0d-8feb-63a1959bc1be service nova] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:39.626297 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e6a1f-dfb3-44b1-a72d-2de5e8dd87a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:39.626877 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e6a1f-dfb3-44b1-a72d-2de5e8dd87a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:39.627150 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e6a1f-dfb3-44b1-a72d-2de5e8dd87a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:39.627416 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e6a1f-dfb3-44b1-a72d-2de5e8dd87a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:39.682744 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e6a1f-dfb3-44b1-a72d-2de5e8dd87a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:39.684160 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e6a1f-dfb3-44b1-a72d-2de5e8dd87a5 service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:39.692800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1386/2746] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:05:39 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:05:42.493696 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c60a18-65c9-4a7b-9b74-09668d2c851b None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:42.493696 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c60a18-65c9-4a7b-9b74-09668d2c851b None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:42.493696 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c60a18-65c9-4a7b-9b74-09668d2c851b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:42.515667 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-31c60a18-65c9-4a7b-9b74-09668d2c851b None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:42.517138 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-31c60a18-65c9-4a7b-9b74-09668d2c851b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:42.525002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1361/2747] 10.222.0.30 () {58 vars in 1016 bytes} [Sun Aug 7 11:05:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:42.542483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e6a1f-dfb3-44b1-a72d-2de5e8dd87a5 service cinder] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:42.555976 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e6a1f-dfb3-44b1-a72d-2de5e8dd87a5 service cinder] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:42.562953 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a9e5a-6194-47cb-986a-a51042ab062e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:42.563975 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a9e5a-6194-47cb-986a-a51042ab062e service nova] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:42.564249 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a9e5a-6194-47cb-986a-a51042ab062e service nova] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:42.564523 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a9e5a-6194-47cb-986a-a51042ab062e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:42.573742 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a9e5a-6194-47cb-986a-a51042ab062e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:42.575359 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a9e5a-6194-47cb-986a-a51042ab062e service nova] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:42.585972 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1387/2748] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:05:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:05:43.761870 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c60a18-65c9-4a7b-9b74-09668d2c851b None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:43.772397 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c60a18-65c9-4a7b-9b74-09668d2c851b None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:43.776942 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605159f5-5959-4255-ae00-2a61c1960abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:43.777642 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605159f5-5959-4255-ae00-2a61c1960abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:43.777951 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605159f5-5959-4255-ae00-2a61c1960abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:43.778248 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605159f5-5959-4255-ae00-2a61c1960abe admin admin] PATH_INFO: `/v3/users/e0afd0756ace4b698f1481f7cca3806e` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:43.779432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605159f5-5959-4255-ae00-2a61c1960abe admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0afd0756ace4b698f1481f7cca3806e)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:43.781409 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605159f5-5959-4255-ae00-2a61c1960abe admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:43.831944 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-605159f5-5959-4255-ae00-2a61c1960abe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0afd0756ace4b698f1481f7cca3806e'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:43.844134 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-605159f5-5959-4255-ae00-2a61c1960abe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0afd0756ace4b698f1481f7cca3806e'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:43.844819 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-605159f5-5959-4255-ae00-2a61c1960abe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0afd0756ace4b698f1481f7cca3806e'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:43.851595 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-605159f5-5959-4255-ae00-2a61c1960abe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0afd0756ace4b698f1481f7cca3806e'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:43.859083 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-605159f5-5959-4255-ae00-2a61c1960abe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0afd0756ace4b698f1481f7cca3806e'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:43.865434 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1362/2749] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:05:43 2022] DELETE /identity/v3/users/e0afd0756ace4b698f1481f7cca3806e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:05:43.869916 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d78b3-d73d-4183-98e6-384160e0e0d6 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:43.870370 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d78b3-d73d-4183-98e6-384160e0e0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:43.870465 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d78b3-d73d-4183-98e6-384160e0e0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:43.890734 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-107d78b3-d73d-4183-98e6-384160e0e0d6 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:43.892178 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-107d78b3-d73d-4183-98e6-384160e0e0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:43.953337 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1388/2750] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:05:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:43.963093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605159f5-5959-4255-ae00-2a61c1960abe admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:43.964485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-605159f5-5959-4255-ae00-2a61c1960abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:43.970980 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:44.022022 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605159f5-5959-4255-ae00-2a61c1960abe admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:44.025836 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd837f-22cf-4d3c-9d1e-c1daf16c1a14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:44.026425 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd837f-22cf-4d3c-9d1e-c1daf16c1a14 service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:44.026698 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd837f-22cf-4d3c-9d1e-c1daf16c1a14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:44.026960 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd837f-22cf-4d3c-9d1e-c1daf16c1a14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:44.035753 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd837f-22cf-4d3c-9d1e-c1daf16c1a14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:44.037225 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd837f-22cf-4d3c-9d1e-c1daf16c1a14 service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:44.047492 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1363/2751] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:05:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:05:44.315003 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d78b3-d73d-4183-98e6-384160e0e0d6 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:44.316644 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-107d78b3-d73d-4183-98e6-384160e0e0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:44.328746 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d78b3-d73d-4183-98e6-384160e0e0d6 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:44.333809 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a95618-11ad-46ee-a4bd-79fb2fcd70be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:44.334441 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a95618-11ad-46ee-a4bd-79fb2fcd70be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:44.334713 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a95618-11ad-46ee-a4bd-79fb2fcd70be admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:44.335005 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a95618-11ad-46ee-a4bd-79fb2fcd70be admin admin] PATH_INFO: `/v3/projects/254f4bff1af7435db44782d61ece3e99` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:44.336137 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a95618-11ad-46ee-a4bd-79fb2fcd70be admin admin] RBAC: Authorizing `identity:delete_project(project_id=254f4bff1af7435db44782d61ece3e99)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:44.338097 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a95618-11ad-46ee-a4bd-79fb2fcd70be admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:44.391237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-49a95618-11ad-46ee-a4bd-79fb2fcd70be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '254f4bff1af7435db44782d61ece3e99', 'request_id': 'req-49a95618-11ad-46ee-a4bd-79fb2fcd70be'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:44.392721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:44.398619 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-49a95618-11ad-46ee-a4bd-79fb2fcd70be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '254f4bff1af7435db44782d61ece3e99', 'request_id': 'req-49a95618-11ad-46ee-a4bd-79fb2fcd70be'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:44.406220 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-49a95618-11ad-46ee-a4bd-79fb2fcd70be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '254f4bff1af7435db44782d61ece3e99', 'request_id': 'req-49a95618-11ad-46ee-a4bd-79fb2fcd70be'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:44.419408 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-49a95618-11ad-46ee-a4bd-79fb2fcd70be admin admin] The token cache is being invalidate because project 254f4bff1af7435db44782d61ece3e99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:05:44.419699 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-49a95618-11ad-46ee-a4bd-79fb2fcd70be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:44.420336 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-49a95618-11ad-46ee-a4bd-79fb2fcd70be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:44.421894 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1389/2752] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:05:44 2022] DELETE /identity/v3/projects/254f4bff1af7435db44782d61ece3e99 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 11:05:44.428982 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd837f-22cf-4d3c-9d1e-c1daf16c1a14 service neutron] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:44.436745 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd837f-22cf-4d3c-9d1e-c1daf16c1a14 service neutron] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:44.493653 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec9ac8-3b35-4a56-a94a-89ab35b1474e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:44.494267 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec9ac8-3b35-4a56-a94a-89ab35b1474e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:44.494540 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec9ac8-3b35-4a56-a94a-89ab35b1474e admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:44.494806 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec9ac8-3b35-4a56-a94a-89ab35b1474e admin admin] PATH_INFO: `/v3/users/391d00c12f124fe2b2365d845ff00c51` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:44.495957 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec9ac8-3b35-4a56-a94a-89ab35b1474e admin admin] RBAC: Authorizing `identity:delete_user(user_id=391d00c12f124fe2b2365d845ff00c51)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:44.497918 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec9ac8-3b35-4a56-a94a-89ab35b1474e admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:44.543885 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-a6ec9ac8-3b35-4a56-a94a-89ab35b1474e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '391d00c12f124fe2b2365d845ff00c51'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:44.555500 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-a6ec9ac8-3b35-4a56-a94a-89ab35b1474e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '391d00c12f124fe2b2365d845ff00c51'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:44.556159 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-a6ec9ac8-3b35-4a56-a94a-89ab35b1474e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '391d00c12f124fe2b2365d845ff00c51'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:44.562837 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-a6ec9ac8-3b35-4a56-a94a-89ab35b1474e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '391d00c12f124fe2b2365d845ff00c51'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:44.570501 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-a6ec9ac8-3b35-4a56-a94a-89ab35b1474e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '391d00c12f124fe2b2365d845ff00c51'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:44.576586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1364/2753] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:05:44 2022] DELETE /identity/v3/users/391d00c12f124fe2b2365d845ff00c51 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 11:05:44.845516 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a95618-11ad-46ee-a4bd-79fb2fcd70be admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:44.847007 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-49a95618-11ad-46ee-a4bd-79fb2fcd70be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:44.860550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a95618-11ad-46ee-a4bd-79fb2fcd70be admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:44.917899 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a42fb5-c64d-4f9f-a110-ae9b7cbde521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:44.918513 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a42fb5-c64d-4f9f-a110-ae9b7cbde521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:44.918710 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a42fb5-c64d-4f9f-a110-ae9b7cbde521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:44.918979 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a42fb5-c64d-4f9f-a110-ae9b7cbde521 admin admin] PATH_INFO: `/v3/projects/b7396b9c10ce4fe7b76a3665d15fd385` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:44.920089 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a42fb5-c64d-4f9f-a110-ae9b7cbde521 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7396b9c10ce4fe7b76a3665d15fd385)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:44.922008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a42fb5-c64d-4f9f-a110-ae9b7cbde521 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:44.967536 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d7a42fb5-c64d-4f9f-a110-ae9b7cbde521 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7396b9c10ce4fe7b76a3665d15fd385', 'request_id': 'req-d7a42fb5-c64d-4f9f-a110-ae9b7cbde521'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:44.973572 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d7a42fb5-c64d-4f9f-a110-ae9b7cbde521 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7396b9c10ce4fe7b76a3665d15fd385', 'request_id': 'req-d7a42fb5-c64d-4f9f-a110-ae9b7cbde521'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:44.980607 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d7a42fb5-c64d-4f9f-a110-ae9b7cbde521 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7396b9c10ce4fe7b76a3665d15fd385', 'request_id': 'req-d7a42fb5-c64d-4f9f-a110-ae9b7cbde521'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:44.991996 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d7a42fb5-c64d-4f9f-a110-ae9b7cbde521 admin admin] The token cache is being invalidate because project b7396b9c10ce4fe7b76a3665d15fd385 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:05:44.992309 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d7a42fb5-c64d-4f9f-a110-ae9b7cbde521 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:44.992939 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d7a42fb5-c64d-4f9f-a110-ae9b7cbde521 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:44.994419 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1390/2754] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:05:44 2022] DELETE /identity/v3/projects/b7396b9c10ce4fe7b76a3665d15fd385 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:05:44.999406 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fc0e3-c988-4315-99b8-390ce7457d0c None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:44.999863 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fc0e3-c988-4315-99b8-390ce7457d0c None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:45.000002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fc0e3-c988-4315-99b8-390ce7457d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:45.019614 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-ff2fc0e3-c988-4315-99b8-390ce7457d0c None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:45.020807 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ff2fc0e3-c988-4315-99b8-390ce7457d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:45.041426 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:45.082413 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1365/2755] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:45.090273 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8eccb-d9cc-48b6-b934-855475e86b8b None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:45.090557 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8eccb-d9cc-48b6-b934-855475e86b8b None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:45.090831 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8eccb-d9cc-48b6-b934-855475e86b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:45.111750 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-52a8eccb-d9cc-48b6-b934-855475e86b8b None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:45.113190 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-52a8eccb-d9cc-48b6-b934-855475e86b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:45.122196 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1391/2756] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:45.126666 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fc0e3-c988-4315-99b8-390ce7457d0c None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:45.137174 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fc0e3-c988-4315-99b8-390ce7457d0c None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:45.142187 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a154c2-e514-4e1b-9a02-a11aeb184d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:45.142774 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a154c2-e514-4e1b-9a02-a11aeb184d7a admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:45.143054 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a154c2-e514-4e1b-9a02-a11aeb184d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:45.143359 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a154c2-e514-4e1b-9a02-a11aeb184d7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:45.144039 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a154c2-e514-4e1b-9a02-a11aeb184d7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 11:05:45.144341 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a154c2-e514-4e1b-9a02-a11aeb184d7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:45.145962 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a154c2-e514-4e1b-9a02-a11aeb184d7a admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:45.161531 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1366/2757] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 11:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 11:05:45.166135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8eccb-d9cc-48b6-b934-855475e86b8b None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:45.175311 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8eccb-d9cc-48b6-b934-855475e86b8b None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:45.180563 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20db640-43a7-4a8d-9b27-4679c8192a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:45.181139 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20db640-43a7-4a8d-9b27-4679c8192a45 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:45.181446 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20db640-43a7-4a8d-9b27-4679c8192a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:45.181718 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20db640-43a7-4a8d-9b27-4679c8192a45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:45.182335 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20db640-43a7-4a8d-9b27-4679c8192a45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:45.184180 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20db640-43a7-4a8d-9b27-4679c8192a45 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:45.209911 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1392/2758] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:05:45 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:05:45.213881 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a154c2-e514-4e1b-9a02-a11aeb184d7a admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:45.224773 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a154c2-e514-4e1b-9a02-a11aeb184d7a admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:45.278800 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30146d98-6e7c-4e3a-8396-47eae72eca36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:45.279384 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30146d98-6e7c-4e3a-8396-47eae72eca36 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:45.279654 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30146d98-6e7c-4e3a-8396-47eae72eca36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:45.279917 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30146d98-6e7c-4e3a-8396-47eae72eca36 admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:45.280534 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30146d98-6e7c-4e3a-8396-47eae72eca36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:45.282443 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30146d98-6e7c-4e3a-8396-47eae72eca36 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:45.303408 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1367/2759] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:05:45 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:05:45.307480 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20db640-43a7-4a8d-9b27-4679c8192a45 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:45.317833 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20db640-43a7-4a8d-9b27-4679c8192a45 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:45.322579 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1424c-4cff-418f-af3f-bc1cb601aeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:45.323160 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1424c-4cff-418f-af3f-bc1cb601aeb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:45.323432 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1424c-4cff-418f-af3f-bc1cb601aeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:45.323695 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1424c-4cff-418f-af3f-bc1cb601aeb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:45.324448 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d1424c-4cff-418f-af3f-bc1cb601aeb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:45.326081 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d1424c-4cff-418f-af3f-bc1cb601aeb1 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:45.338663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1393/2760] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:05:45.342750 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30146d98-6e7c-4e3a-8396-47eae72eca36 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:45.353550 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30146d98-6e7c-4e3a-8396-47eae72eca36 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:45.358302 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570331d-5937-41ea-b357-1acb539e50f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:45.358908 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570331d-5937-41ea-b357-1acb539e50f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:45.359316 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570331d-5937-41ea-b357-1acb539e50f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:45.359458 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570331d-5937-41ea-b357-1acb539e50f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:45.360100 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570331d-5937-41ea-b357-1acb539e50f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:45.361821 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570331d-5937-41ea-b357-1acb539e50f1 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:45.372185 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1368/2761] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:05:45.376203 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1424c-4cff-418f-af3f-bc1cb601aeb1 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:45.386220 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1424c-4cff-418f-af3f-bc1cb601aeb1 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:45.390783 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9b5be-321f-4e0f-888c-8d53b2a68b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:45.391673 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9b5be-321f-4e0f-888c-8d53b2a68b63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:45.391955 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9b5be-321f-4e0f-888c-8d53b2a68b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:45.392227 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9b5be-321f-4e0f-888c-8d53b2a68b63 admin admin] PATH_INFO: `/v3/projects/52cebf90dc3f4e6c8a5456f28016a548/users/e3790f2e80234f55a22605e308966795/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:45.406873 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9b5be-321f-4e0f-888c-8d53b2a68b63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52cebf90dc3f4e6c8a5456f28016a548, user_id=e3790f2e80234f55a22605e308966795, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:45.409527 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9b5be-321f-4e0f-888c-8d53b2a68b63 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:45.422691 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1394/2762] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:05:45 2022] PUT /identity/v3/projects/52cebf90dc3f4e6c8a5456f28016a548/users/e3790f2e80234f55a22605e308966795/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 11:05:45.433890 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe16906-4be5-46b6-a57e-6e2dfadeca5c None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:45.434199 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe16906-4be5-46b6-a57e-6e2dfadeca5c None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:45.434469 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe16906-4be5-46b6-a57e-6e2dfadeca5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:45.461763 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-bfe16906-4be5-46b6-a57e-6e2dfadeca5c None None] MFA Rules not processed for user `e3790f2e80234f55a22605e308966795`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:45.462949 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-bfe16906-4be5-46b6-a57e-6e2dfadeca5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:45.529585 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1369/2763] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:05:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:45.534293 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9b5be-321f-4e0f-888c-8d53b2a68b63 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:45.540685 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:45.563057 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0732ab-2ba6-43a0-ac79-056d522428a4 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:45.563339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0732ab-2ba6-43a0-ac79-056d522428a4 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:45.563610 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0732ab-2ba6-43a0-ac79-056d522428a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:45.583602 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-0f0732ab-2ba6-43a0-ac79-056d522428a4 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:45.584793 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-0f0732ab-2ba6-43a0-ac79-056d522428a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:45.598806 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9b5be-321f-4e0f-888c-8d53b2a68b63 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:45.602065 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:45.603499 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e9298-76cc-4f81-922a-63bdc526190a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:45.604091 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e9298-76cc-4f81-922a-63bdc526190a admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:45.604362 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e9298-76cc-4f81-922a-63bdc526190a admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:45.604632 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e9298-76cc-4f81-922a-63bdc526190a admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:45.605244 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e9298-76cc-4f81-922a-63bdc526190a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:45.607139 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e9298-76cc-4f81-922a-63bdc526190a admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:45.633692 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1395/2764] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:05:45 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:05:45.637398 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e9298-76cc-4f81-922a-63bdc526190a admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:45.647015 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1370/2765] 10.222.0.30 () {58 vars in 1016 bytes} [Sun Aug 7 11:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 11:05:45.666275 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0732ab-2ba6-43a0-ac79-056d522428a4 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:45.667589 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-0f0732ab-2ba6-43a0-ac79-056d522428a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:45.699115 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e9298-76cc-4f81-922a-63bdc526190a admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:45.704090 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1c0a4-b449-45a1-b92d-4625afb4e7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:45.704673 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1c0a4-b449-45a1-b92d-4625afb4e7e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:45.704947 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1c0a4-b449-45a1-b92d-4625afb4e7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:45.705212 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1c0a4-b449-45a1-b92d-4625afb4e7e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:45.705849 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1c0a4-b449-45a1-b92d-4625afb4e7e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:45.708297 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1c0a4-b449-45a1-b92d-4625afb4e7e3 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:45.732099 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1396/2766] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:05:45 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 11:05:45.733088 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1c0a4-b449-45a1-b92d-4625afb4e7e3 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:45.738431 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0732ab-2ba6-43a0-ac79-056d522428a4 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:45.742348 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1c0a4-b449-45a1-b92d-4625afb4e7e3 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:45.746967 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980fafc-08bc-43c6-87b9-ce0f1f45208f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:45.747521 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980fafc-08bc-43c6-87b9-ce0f1f45208f admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:45.747796 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980fafc-08bc-43c6-87b9-ce0f1f45208f admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:45.748063 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980fafc-08bc-43c6-87b9-ce0f1f45208f admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:45.748688 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980fafc-08bc-43c6-87b9-ce0f1f45208f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:45.750260 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980fafc-08bc-43c6-87b9-ce0f1f45208f admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:45.760962 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1397/2767] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:05:45.764681 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980fafc-08bc-43c6-87b9-ce0f1f45208f admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:45.774734 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980fafc-08bc-43c6-87b9-ce0f1f45208f admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:45.779291 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4cb985-e5d6-493b-a70e-f991ac32e766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:45.779843 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4cb985-e5d6-493b-a70e-f991ac32e766 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:45.780113 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4cb985-e5d6-493b-a70e-f991ac32e766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:45.780378 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4cb985-e5d6-493b-a70e-f991ac32e766 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:45.780990 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4cb985-e5d6-493b-a70e-f991ac32e766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:45.782593 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4cb985-e5d6-493b-a70e-f991ac32e766 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:45.793347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1398/2768] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:05:45.796054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4cb985-e5d6-493b-a70e-f991ac32e766 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:45.802712 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b386eb-372b-4e07-973d-5931d230779a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:45.803311 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b386eb-372b-4e07-973d-5931d230779a service nova] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:45.803586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b386eb-372b-4e07-973d-5931d230779a service nova] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:45.803856 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b386eb-372b-4e07-973d-5931d230779a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:45.805102 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4cb985-e5d6-493b-a70e-f991ac32e766 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:45.809629 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2014a1-1981-477e-842b-c019057c7230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:45.810219 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2014a1-1981-477e-842b-c019057c7230 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:45.810489 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2014a1-1981-477e-842b-c019057c7230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:45.810756 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2014a1-1981-477e-842b-c019057c7230 admin admin] PATH_INFO: `/v3/projects/398186b9a527486e8f7d4bc8767e5677/users/afba128525874340ac48b678a9aa0928/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:45.812002 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b386eb-372b-4e07-973d-5931d230779a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:45.813598 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b386eb-372b-4e07-973d-5931d230779a service nova] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:45.824692 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1371/2769] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:05:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 11:05:45.827663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2014a1-1981-477e-842b-c019057c7230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=398186b9a527486e8f7d4bc8767e5677, user_id=afba128525874340ac48b678a9aa0928, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:45.830312 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2014a1-1981-477e-842b-c019057c7230 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:45.844958 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1399/2770] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:05:45 2022] PUT /identity/v3/projects/398186b9a527486e8f7d4bc8767e5677/users/afba128525874340ac48b678a9aa0928/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 11:05:45.857362 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7ba4d-ba09-4834-8007-70ea878a7907 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:45.857649 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7ba4d-ba09-4834-8007-70ea878a7907 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:45.857941 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7ba4d-ba09-4834-8007-70ea878a7907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:45.886050 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-a1b7ba4d-ba09-4834-8007-70ea878a7907 None None] MFA Rules not processed for user `afba128525874340ac48b678a9aa0928`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:45.887267 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a1b7ba4d-ba09-4834-8007-70ea878a7907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:45.922883 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=100 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:45.954920 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1372/2771] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:05:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:45.960237 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2014a1-1981-477e-842b-c019057c7230 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:45.993255 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:46.021280 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2014a1-1981-477e-842b-c019057c7230 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:46.026108 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894f0f4-0982-475a-b08b-f3411157370a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:46.026702 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894f0f4-0982-475a-b08b-f3411157370a admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:46.026969 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894f0f4-0982-475a-b08b-f3411157370a admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:46.027236 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894f0f4-0982-475a-b08b-f3411157370a admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:46.027852 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894f0f4-0982-475a-b08b-f3411157370a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:46.029753 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894f0f4-0982-475a-b08b-f3411157370a admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:46.055001 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1400/2772] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:05:45 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:05:46.059050 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7ba4d-ba09-4834-8007-70ea878a7907 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:46.070140 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7ba4d-ba09-4834-8007-70ea878a7907 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:46.125802 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585d8ae-59d6-43ad-adfe-5c5446490766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:46.126396 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585d8ae-59d6-43ad-adfe-5c5446490766 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:46.126670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585d8ae-59d6-43ad-adfe-5c5446490766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:46.126938 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585d8ae-59d6-43ad-adfe-5c5446490766 admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:46.127556 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585d8ae-59d6-43ad-adfe-5c5446490766 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:46.130107 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585d8ae-59d6-43ad-adfe-5c5446490766 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:46.152181 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1373/2773] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:05:46 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:05:46.156169 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894f0f4-0982-475a-b08b-f3411157370a admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:46.166349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894f0f4-0982-475a-b08b-f3411157370a admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:46.170814 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4240bc-b898-4723-88b6-c15dd2453842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:46.171391 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4240bc-b898-4723-88b6-c15dd2453842 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:46.171664 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4240bc-b898-4723-88b6-c15dd2453842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:46.171929 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4240bc-b898-4723-88b6-c15dd2453842 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:46.172557 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4240bc-b898-4723-88b6-c15dd2453842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:46.174141 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4240bc-b898-4723-88b6-c15dd2453842 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:46.185293 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1401/2774] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:05:46.189474 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585d8ae-59d6-43ad-adfe-5c5446490766 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:46.200413 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585d8ae-59d6-43ad-adfe-5c5446490766 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:46.205490 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1398ed7-3763-4fa4-9bf8-c7dbf8b15586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:46.206093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1398ed7-3763-4fa4-9bf8-c7dbf8b15586 admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:46.206371 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1398ed7-3763-4fa4-9bf8-c7dbf8b15586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:46.206643 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1398ed7-3763-4fa4-9bf8-c7dbf8b15586 admin admin] PATH_INFO: `/v3/projects/932223f757f84f969ff8b3d8c03105ac/users/55395432d9ec406cb9df15cbb29a3cbb/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:46.222990 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1398ed7-3763-4fa4-9bf8-c7dbf8b15586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=932223f757f84f969ff8b3d8c03105ac, user_id=55395432d9ec406cb9df15cbb29a3cbb, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:46.225640 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1398ed7-3763-4fa4-9bf8-c7dbf8b15586 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:46.237841 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1374/2775] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:05:46 2022] PUT /identity/v3/projects/932223f757f84f969ff8b3d8c03105ac/users/55395432d9ec406cb9df15cbb29a3cbb/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:05:46.242250 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4240bc-b898-4723-88b6-c15dd2453842 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:46.252019 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4240bc-b898-4723-88b6-c15dd2453842 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:46.308145 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54becbbb-3841-4135-b374-14a648ec6377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:46.308740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54becbbb-3841-4135-b374-14a648ec6377 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:46.309013 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54becbbb-3841-4135-b374-14a648ec6377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:46.309281 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54becbbb-3841-4135-b374-14a648ec6377 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:46.309946 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54becbbb-3841-4135-b374-14a648ec6377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:46.311507 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54becbbb-3841-4135-b374-14a648ec6377 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:46.321556 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1402/2776] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:05:46.325816 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1398ed7-3763-4fa4-9bf8-c7dbf8b15586 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:46.336007 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1398ed7-3763-4fa4-9bf8-c7dbf8b15586 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:46.340768 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f927928-de68-4415-8a19-943c6558d846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:46.341449 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f927928-de68-4415-8a19-943c6558d846 admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:46.341726 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f927928-de68-4415-8a19-943c6558d846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:46.341996 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f927928-de68-4415-8a19-943c6558d846 admin admin] PATH_INFO: `/v3/projects/932223f757f84f969ff8b3d8c03105ac/users/55395432d9ec406cb9df15cbb29a3cbb/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:46.343892 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f927928-de68-4415-8a19-943c6558d846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=932223f757f84f969ff8b3d8c03105ac, user_id=55395432d9ec406cb9df15cbb29a3cbb, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:46.346528 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f927928-de68-4415-8a19-943c6558d846 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:46.357055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1375/2777] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:05:46 2022] PUT /identity/v3/projects/932223f757f84f969ff8b3d8c03105ac/users/55395432d9ec406cb9df15cbb29a3cbb/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:05:46.367745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d858a-fba3-4c85-bbec-94db63247fde None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:46.368027 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d858a-fba3-4c85-bbec-94db63247fde None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:46.368324 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d858a-fba3-4c85-bbec-94db63247fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:46.395879 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-6c6d858a-fba3-4c85-bbec-94db63247fde None None] MFA Rules not processed for user `55395432d9ec406cb9df15cbb29a3cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:46.397087 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-6c6d858a-fba3-4c85-bbec-94db63247fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:46.464268 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1403/2778] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:05:46 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:46.475909 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f927928-de68-4415-8a19-943c6558d846 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:46.477662 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-1f927928-de68-4415-8a19-943c6558d846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:46.533873 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f927928-de68-4415-8a19-943c6558d846 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:46.538143 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc62467-013c-4291-8d98-17637c2f9b68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:46.538724 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc62467-013c-4291-8d98-17637c2f9b68 service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:46.538995 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc62467-013c-4291-8d98-17637c2f9b68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:46.539285 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc62467-013c-4291-8d98-17637c2f9b68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:46.548651 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc62467-013c-4291-8d98-17637c2f9b68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:46.550093 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc62467-013c-4291-8d98-17637c2f9b68 service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:46.560251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1376/2779] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:05:46 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:05:46.601513 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d858a-fba3-4c85-bbec-94db63247fde None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:46.602951 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-6c6d858a-fba3-4c85-bbec-94db63247fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:46.615597 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d858a-fba3-4c85-bbec-94db63247fde None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:46.619403 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe264393-fa72-4b00-8498-63946e829f8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:46.619988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe264393-fa72-4b00-8498-63946e829f8d service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:46.620270 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe264393-fa72-4b00-8498-63946e829f8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:46.620542 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe264393-fa72-4b00-8498-63946e829f8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:46.647659 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:46.679069 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe264393-fa72-4b00-8498-63946e829f8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:46.680549 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe264393-fa72-4b00-8498-63946e829f8d service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:46.689536 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1404/2780] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:05:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:05:48.715232 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c71389-7fc4-46b0-9b7c-21ac1f626df7 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:48.715699 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c71389-7fc4-46b0-9b7c-21ac1f626df7 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:48.715850 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c71389-7fc4-46b0-9b7c-21ac1f626df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:48.737356 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-60c71389-7fc4-46b0-9b7c-21ac1f626df7 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:48.738699 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-60c71389-7fc4-46b0-9b7c-21ac1f626df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:48.768549 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:48.805388 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1377/2781] 10.222.0.30 () {58 vars in 1016 bytes} [Sun Aug 7 11:05:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:48.825106 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe264393-fa72-4b00-8498-63946e829f8d service cinder] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:48.894335 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe264393-fa72-4b00-8498-63946e829f8d service cinder] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:48.899830 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27badcb9-e661-4eb0-8f4a-a9d810a474b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:48.900422 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27badcb9-e661-4eb0-8f4a-a9d810a474b7 service nova] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:48.900695 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27badcb9-e661-4eb0-8f4a-a9d810a474b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:48.900964 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27badcb9-e661-4eb0-8f4a-a9d810a474b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:48.909062 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27badcb9-e661-4eb0-8f4a-a9d810a474b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:48.910672 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27badcb9-e661-4eb0-8f4a-a9d810a474b7 service nova] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:48.920406 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1405/2782] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:05:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:05:49.563659 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c71389-7fc4-46b0-9b7c-21ac1f626df7 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:49.573896 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c71389-7fc4-46b0-9b7c-21ac1f626df7 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:49.578404 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee034672-d33f-45be-b938-b1c7b541c5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:49.579012 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee034672-d33f-45be-b938-b1c7b541c5e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:49.579287 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee034672-d33f-45be-b938-b1c7b541c5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:49.579557 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee034672-d33f-45be-b938-b1c7b541c5e4 admin admin] PATH_INFO: `/v3/users/e3790f2e80234f55a22605e308966795` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:49.580672 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee034672-d33f-45be-b938-b1c7b541c5e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3790f2e80234f55a22605e308966795)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:49.582605 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee034672-d33f-45be-b938-b1c7b541c5e4 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:49.626703 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ee034672-d33f-45be-b938-b1c7b541c5e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3790f2e80234f55a22605e308966795'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:49.638893 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ee034672-d33f-45be-b938-b1c7b541c5e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3790f2e80234f55a22605e308966795'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:49.639552 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ee034672-d33f-45be-b938-b1c7b541c5e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3790f2e80234f55a22605e308966795'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:49.646508 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ee034672-d33f-45be-b938-b1c7b541c5e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3790f2e80234f55a22605e308966795'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:49.653470 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-ee034672-d33f-45be-b938-b1c7b541c5e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3790f2e80234f55a22605e308966795'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:49.659198 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1378/2783] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:05:49 2022] DELETE /identity/v3/users/e3790f2e80234f55a22605e308966795 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:05:49.664315 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251e82d-f79f-440a-bd1d-66fc2ac05f56 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:49.664600 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251e82d-f79f-440a-bd1d-66fc2ac05f56 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:49.664868 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251e82d-f79f-440a-bd1d-66fc2ac05f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:49.683244 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-4251e82d-f79f-440a-bd1d-66fc2ac05f56 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:49.684541 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-4251e82d-f79f-440a-bd1d-66fc2ac05f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:49.750904 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1406/2784] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:49.760934 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee034672-d33f-45be-b938-b1c7b541c5e4 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:49.762347 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ee034672-d33f-45be-b938-b1c7b541c5e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:49.818653 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee034672-d33f-45be-b938-b1c7b541c5e4 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:49.822247 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77169ee2-99a7-4cff-88bc-29fd26fe7c3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:49.822836 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77169ee2-99a7-4cff-88bc-29fd26fe7c3a service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:49.823107 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77169ee2-99a7-4cff-88bc-29fd26fe7c3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:49.823370 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77169ee2-99a7-4cff-88bc-29fd26fe7c3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:49.832649 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77169ee2-99a7-4cff-88bc-29fd26fe7c3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:49.834729 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77169ee2-99a7-4cff-88bc-29fd26fe7c3a service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:49.844058 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1379/2785] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:05:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:05:50.122915 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251e82d-f79f-440a-bd1d-66fc2ac05f56 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:50.124414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-4251e82d-f79f-440a-bd1d-66fc2ac05f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:50.136925 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251e82d-f79f-440a-bd1d-66fc2ac05f56 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:50.142030 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb65a71-db19-4d27-82fd-7fd1b1c94919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:50.142679 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb65a71-db19-4d27-82fd-7fd1b1c94919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:50.142961 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb65a71-db19-4d27-82fd-7fd1b1c94919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:50.143227 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb65a71-db19-4d27-82fd-7fd1b1c94919 admin admin] PATH_INFO: `/v3/projects/52cebf90dc3f4e6c8a5456f28016a548` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:50.144331 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb65a71-db19-4d27-82fd-7fd1b1c94919 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52cebf90dc3f4e6c8a5456f28016a548)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:50.146816 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb65a71-db19-4d27-82fd-7fd1b1c94919 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:50.194209 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:50.195653 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-1fb65a71-db19-4d27-82fd-7fd1b1c94919 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52cebf90dc3f4e6c8a5456f28016a548', 'request_id': 'req-1fb65a71-db19-4d27-82fd-7fd1b1c94919'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:50.202504 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-1fb65a71-db19-4d27-82fd-7fd1b1c94919 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52cebf90dc3f4e6c8a5456f28016a548', 'request_id': 'req-1fb65a71-db19-4d27-82fd-7fd1b1c94919'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:50.210397 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-1fb65a71-db19-4d27-82fd-7fd1b1c94919 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52cebf90dc3f4e6c8a5456f28016a548', 'request_id': 'req-1fb65a71-db19-4d27-82fd-7fd1b1c94919'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:50.221346 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-1fb65a71-db19-4d27-82fd-7fd1b1c94919 admin admin] The token cache is being invalidate because project 52cebf90dc3f4e6c8a5456f28016a548 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:05:50.221658 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-1fb65a71-db19-4d27-82fd-7fd1b1c94919 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:50.222265 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-1fb65a71-db19-4d27-82fd-7fd1b1c94919 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:50.224389 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1407/2786] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:05:50 2022] DELETE /identity/v3/projects/52cebf90dc3f4e6c8a5456f28016a548 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:05:50.228412 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77169ee2-99a7-4cff-88bc-29fd26fe7c3a service neutron] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:50.237985 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77169ee2-99a7-4cff-88bc-29fd26fe7c3a service neutron] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:50.281114 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:50.295251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df090e09-acab-4668-a87f-d5b3018c928d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:50.295928 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df090e09-acab-4668-a87f-d5b3018c928d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:50.296205 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df090e09-acab-4668-a87f-d5b3018c928d admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:50.296473 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df090e09-acab-4668-a87f-d5b3018c928d admin admin] PATH_INFO: `/v3/users/afba128525874340ac48b678a9aa0928` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:50.297687 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df090e09-acab-4668-a87f-d5b3018c928d admin admin] RBAC: Authorizing `identity:delete_user(user_id=afba128525874340ac48b678a9aa0928)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:50.299723 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df090e09-acab-4668-a87f-d5b3018c928d admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:50.345105 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-df090e09-acab-4668-a87f-d5b3018c928d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afba128525874340ac48b678a9aa0928'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:50.357166 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-df090e09-acab-4668-a87f-d5b3018c928d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afba128525874340ac48b678a9aa0928'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:50.357896 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-df090e09-acab-4668-a87f-d5b3018c928d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afba128525874340ac48b678a9aa0928'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:50.364714 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-df090e09-acab-4668-a87f-d5b3018c928d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afba128525874340ac48b678a9aa0928'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:50.372036 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-df090e09-acab-4668-a87f-d5b3018c928d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afba128525874340ac48b678a9aa0928'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:50.378008 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1380/2787] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:05:50 2022] DELETE /identity/v3/users/afba128525874340ac48b678a9aa0928 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:05:50.649566 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb65a71-db19-4d27-82fd-7fd1b1c94919 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:50.651049 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-1fb65a71-db19-4d27-82fd-7fd1b1c94919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:50.664250 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb65a71-db19-4d27-82fd-7fd1b1c94919 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:50.721288 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43afd2b-8d84-4cc9-b023-6a1f21a59b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:50.721878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43afd2b-8d84-4cc9-b023-6a1f21a59b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:50.722139 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43afd2b-8d84-4cc9-b023-6a1f21a59b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:50.722404 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43afd2b-8d84-4cc9-b023-6a1f21a59b22 admin admin] PATH_INFO: `/v3/projects/398186b9a527486e8f7d4bc8767e5677` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:50.723563 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43afd2b-8d84-4cc9-b023-6a1f21a59b22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=398186b9a527486e8f7d4bc8767e5677)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:50.725462 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43afd2b-8d84-4cc9-b023-6a1f21a59b22 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:50.774099 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d43afd2b-8d84-4cc9-b023-6a1f21a59b22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '398186b9a527486e8f7d4bc8767e5677', 'request_id': 'req-d43afd2b-8d84-4cc9-b023-6a1f21a59b22'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:50.779576 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d43afd2b-8d84-4cc9-b023-6a1f21a59b22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '398186b9a527486e8f7d4bc8767e5677', 'request_id': 'req-d43afd2b-8d84-4cc9-b023-6a1f21a59b22'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:50.786891 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d43afd2b-8d84-4cc9-b023-6a1f21a59b22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '398186b9a527486e8f7d4bc8767e5677', 'request_id': 'req-d43afd2b-8d84-4cc9-b023-6a1f21a59b22'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:50.797718 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d43afd2b-8d84-4cc9-b023-6a1f21a59b22 admin admin] The token cache is being invalidate because project 398186b9a527486e8f7d4bc8767e5677 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:05:50.798005 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d43afd2b-8d84-4cc9-b023-6a1f21a59b22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:50.798664 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d43afd2b-8d84-4cc9-b023-6a1f21a59b22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:50.800152 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1408/2788] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:05:50 2022] DELETE /identity/v3/projects/398186b9a527486e8f7d4bc8767e5677 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:05:50.804886 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df090e09-acab-4668-a87f-d5b3018c928d admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:50.806312 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-df090e09-acab-4668-a87f-d5b3018c928d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:50.819236 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df090e09-acab-4668-a87f-d5b3018c928d admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:50.873622 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eae60a-f3c4-4e85-aca2-b38e47fb58fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:50.874236 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eae60a-f3c4-4e85-aca2-b38e47fb58fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:50.874508 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eae60a-f3c4-4e85-aca2-b38e47fb58fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:50.874775 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eae60a-f3c4-4e85-aca2-b38e47fb58fb admin admin] PATH_INFO: `/v3/users/55395432d9ec406cb9df15cbb29a3cbb` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:50.875863 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eae60a-f3c4-4e85-aca2-b38e47fb58fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=55395432d9ec406cb9df15cbb29a3cbb)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:50.877774 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eae60a-f3c4-4e85-aca2-b38e47fb58fb admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:50.922558 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-26eae60a-f3c4-4e85-aca2-b38e47fb58fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55395432d9ec406cb9df15cbb29a3cbb'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:50.935596 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-26eae60a-f3c4-4e85-aca2-b38e47fb58fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55395432d9ec406cb9df15cbb29a3cbb'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:50.936255 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-26eae60a-f3c4-4e85-aca2-b38e47fb58fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55395432d9ec406cb9df15cbb29a3cbb'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:50.938233 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:50.945785 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-26eae60a-f3c4-4e85-aca2-b38e47fb58fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55395432d9ec406cb9df15cbb29a3cbb'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:50.953450 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-26eae60a-f3c4-4e85-aca2-b38e47fb58fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55395432d9ec406cb9df15cbb29a3cbb'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:50.959379 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1381/2789] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:05:50 2022] DELETE /identity/v3/users/55395432d9ec406cb9df15cbb29a3cbb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:05:51.235243 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43afd2b-8d84-4cc9-b023-6a1f21a59b22 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:51.237105 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-d43afd2b-8d84-4cc9-b023-6a1f21a59b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:51.250148 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43afd2b-8d84-4cc9-b023-6a1f21a59b22 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:51.307960 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b1268-aa03-4110-a64f-8b9b9a85d68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:51.308579 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b1268-aa03-4110-a64f-8b9b9a85d68f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:51.308857 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b1268-aa03-4110-a64f-8b9b9a85d68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:51.309128 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b1268-aa03-4110-a64f-8b9b9a85d68f admin admin] PATH_INFO: `/v3/projects/932223f757f84f969ff8b3d8c03105ac` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:51.310278 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b1268-aa03-4110-a64f-8b9b9a85d68f admin admin] RBAC: Authorizing `identity:delete_project(project_id=932223f757f84f969ff8b3d8c03105ac)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:51.312160 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b1268-aa03-4110-a64f-8b9b9a85d68f admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:51.320374 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:51.360125 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-629b1268-aa03-4110-a64f-8b9b9a85d68f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '932223f757f84f969ff8b3d8c03105ac', 'request_id': 'req-629b1268-aa03-4110-a64f-8b9b9a85d68f'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:51.366031 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-629b1268-aa03-4110-a64f-8b9b9a85d68f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '932223f757f84f969ff8b3d8c03105ac', 'request_id': 'req-629b1268-aa03-4110-a64f-8b9b9a85d68f'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:51.373306 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-629b1268-aa03-4110-a64f-8b9b9a85d68f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '932223f757f84f969ff8b3d8c03105ac', 'request_id': 'req-629b1268-aa03-4110-a64f-8b9b9a85d68f'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:51.384366 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-629b1268-aa03-4110-a64f-8b9b9a85d68f admin admin] The token cache is being invalidate because project 932223f757f84f969ff8b3d8c03105ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:05:51.384651 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-629b1268-aa03-4110-a64f-8b9b9a85d68f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:51.385357 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-629b1268-aa03-4110-a64f-8b9b9a85d68f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:51.386826 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1409/2790] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:05:51 2022] DELETE /identity/v3/projects/932223f757f84f969ff8b3d8c03105ac => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:05:51.393642 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504b018-73a1-4c25-95d7-89b2b7718ada None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:51.393923 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504b018-73a1-4c25-95d7-89b2b7718ada None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:51.394194 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504b018-73a1-4c25-95d7-89b2b7718ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:51.413949 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-e504b018-73a1-4c25-95d7-89b2b7718ada None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:51.415121 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-e504b018-73a1-4c25-95d7-89b2b7718ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:51.471867 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1382/2791] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:51.480954 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b62e3-27d6-495c-b76b-92ada2402ea0 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:51.481170 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b62e3-27d6-495c-b76b-92ada2402ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:51.481569 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b62e3-27d6-495c-b76b-92ada2402ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:51.500939 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-0b6b62e3-27d6-495c-b76b-92ada2402ea0 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:51.502170 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-0b6b62e3-27d6-495c-b76b-92ada2402ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:51.510065 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1410/2792] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:51.514081 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504b018-73a1-4c25-95d7-89b2b7718ada None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:51.524316 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504b018-73a1-4c25-95d7-89b2b7718ada None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:51.528799 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22aca37-faf8-44f6-9760-5300b1fea250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:51.529410 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22aca37-faf8-44f6-9760-5300b1fea250 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:51.529685 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22aca37-faf8-44f6-9760-5300b1fea250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:51.529953 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22aca37-faf8-44f6-9760-5300b1fea250 admin admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:51.530597 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22aca37-faf8-44f6-9760-5300b1fea250 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 11:05:51.530890 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22aca37-faf8-44f6-9760-5300b1fea250 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:51.532448 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22aca37-faf8-44f6-9760-5300b1fea250 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:51.544128 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1383/2793] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 11:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 11:05:51.548285 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b62e3-27d6-495c-b76b-92ada2402ea0 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:51.559307 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b62e3-27d6-495c-b76b-92ada2402ea0 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:51.564050 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991ea20-485a-4e93-9d58-816da0fb492f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:51.564693 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991ea20-485a-4e93-9d58-816da0fb492f admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:51.564968 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991ea20-485a-4e93-9d58-816da0fb492f admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:51.565234 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991ea20-485a-4e93-9d58-816da0fb492f admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:51.565878 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991ea20-485a-4e93-9d58-816da0fb492f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:51.567737 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991ea20-485a-4e93-9d58-816da0fb492f admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:51.595021 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1411/2794] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:05:51 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:05:51.599741 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22aca37-faf8-44f6-9760-5300b1fea250 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:51.609713 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22aca37-faf8-44f6-9760-5300b1fea250 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:51.664459 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35cbbe-a0b3-4b7d-b595-1365b5f75479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:51.665043 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35cbbe-a0b3-4b7d-b595-1365b5f75479 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:51.665333 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35cbbe-a0b3-4b7d-b595-1365b5f75479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:51.665612 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35cbbe-a0b3-4b7d-b595-1365b5f75479 admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:51.666218 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35cbbe-a0b3-4b7d-b595-1365b5f75479 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:51.668119 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35cbbe-a0b3-4b7d-b595-1365b5f75479 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:51.688072 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1384/2795] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:05:51 2022] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:05:51.692135 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991ea20-485a-4e93-9d58-816da0fb492f admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:51.702169 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991ea20-485a-4e93-9d58-816da0fb492f admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:51.706975 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff1444-f3e7-42ba-b113-cbdb1c7ebe8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:51.708047 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff1444-f3e7-42ba-b113-cbdb1c7ebe8c admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:51.708323 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff1444-f3e7-42ba-b113-cbdb1c7ebe8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:51.708589 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff1444-f3e7-42ba-b113-cbdb1c7ebe8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:51.709222 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff1444-f3e7-42ba-b113-cbdb1c7ebe8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:51.710815 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff1444-f3e7-42ba-b113-cbdb1c7ebe8c admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:51.720377 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1412/2796] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:05:51.724666 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35cbbe-a0b3-4b7d-b595-1365b5f75479 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:51.734528 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35cbbe-a0b3-4b7d-b595-1365b5f75479 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:51.739025 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231dac45-5062-4bd4-8523-4628cefc9631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:51.739600 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dac45-5062-4bd4-8523-4628cefc9631 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:51.739876 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dac45-5062-4bd4-8523-4628cefc9631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:51.740132 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dac45-5062-4bd4-8523-4628cefc9631 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:51.740763 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231dac45-5062-4bd4-8523-4628cefc9631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:51.742360 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231dac45-5062-4bd4-8523-4628cefc9631 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:51.752474 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1385/2797] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:05:51.756874 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff1444-f3e7-42ba-b113-cbdb1c7ebe8c admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:51.767366 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff1444-f3e7-42ba-b113-cbdb1c7ebe8c admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:51.773270 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878b6f2-d487-4b64-b14d-40b71142a032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:51.774196 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878b6f2-d487-4b64-b14d-40b71142a032 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:51.774511 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878b6f2-d487-4b64-b14d-40b71142a032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:51.774809 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878b6f2-d487-4b64-b14d-40b71142a032 admin admin] PATH_INFO: `/v3/projects/f38475cc91a6488292d70a57ce0073a1/users/10c570c621f94c5c88c3cfe9141c5368/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:51.790964 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878b6f2-d487-4b64-b14d-40b71142a032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f38475cc91a6488292d70a57ce0073a1, user_id=10c570c621f94c5c88c3cfe9141c5368, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:51.793856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878b6f2-d487-4b64-b14d-40b71142a032 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:51.806641 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1413/2798] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:05:51 2022] PUT /identity/v3/projects/f38475cc91a6488292d70a57ce0073a1/users/10c570c621f94c5c88c3cfe9141c5368/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:05:51.818666 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05de63c-399b-4832-9c23-726afd941256 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:51.819124 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05de63c-399b-4832-9c23-726afd941256 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:51.819221 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05de63c-399b-4832-9c23-726afd941256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:51.846690 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-d05de63c-399b-4832-9c23-726afd941256 None None] MFA Rules not processed for user `10c570c621f94c5c88c3cfe9141c5368`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:51.847873 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-d05de63c-399b-4832-9c23-726afd941256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:51.887324 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:51.913646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1386/2799] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:05:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:51.918063 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878b6f2-d487-4b64-b14d-40b71142a032 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:51.979565 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878b6f2-d487-4b64-b14d-40b71142a032 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:51.984286 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78849a9-f558-4350-8700-7bcf462b9aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:51.984967 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78849a9-f558-4350-8700-7bcf462b9aeb admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:51.985171 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78849a9-f558-4350-8700-7bcf462b9aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:51.985473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78849a9-f558-4350-8700-7bcf462b9aeb admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:51.986130 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78849a9-f558-4350-8700-7bcf462b9aeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:51.988017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78849a9-f558-4350-8700-7bcf462b9aeb admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:52.014006 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1414/2800] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:05:51 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:05:52.018394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05de63c-399b-4832-9c23-726afd941256 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:52.029836 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05de63c-399b-4832-9c23-726afd941256 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:52.088638 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0231499-cbb3-4e6b-aaaa-23d832d607b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:52.089392 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0231499-cbb3-4e6b-aaaa-23d832d607b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:52.089736 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0231499-cbb3-4e6b-aaaa-23d832d607b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:52.090031 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0231499-cbb3-4e6b-aaaa-23d832d607b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:52.090722 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0231499-cbb3-4e6b-aaaa-23d832d607b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:52.092725 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0231499-cbb3-4e6b-aaaa-23d832d607b5 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:52.113645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1387/2801] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:05:52 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:05:52.118387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78849a9-f558-4350-8700-7bcf462b9aeb admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:52.130119 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78849a9-f558-4350-8700-7bcf462b9aeb admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:52.135195 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e163d11-d3cd-494c-83c2-24175e17274f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:52.135867 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e163d11-d3cd-494c-83c2-24175e17274f admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:52.136173 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e163d11-d3cd-494c-83c2-24175e17274f admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:52.136485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e163d11-d3cd-494c-83c2-24175e17274f admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:52.137223 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e163d11-d3cd-494c-83c2-24175e17274f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:52.138969 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e163d11-d3cd-494c-83c2-24175e17274f admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:52.150574 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1415/2802] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:05:52.154877 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0231499-cbb3-4e6b-aaaa-23d832d607b5 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:52.164624 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0231499-cbb3-4e6b-aaaa-23d832d607b5 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:52.169579 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fa4d8-3562-40a6-ac87-303548d0e90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:52.170257 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fa4d8-3562-40a6-ac87-303548d0e90f admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:52.170591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fa4d8-3562-40a6-ac87-303548d0e90f admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:52.170949 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fa4d8-3562-40a6-ac87-303548d0e90f admin admin] PATH_INFO: `/v3/projects/f61fff2281c04382a7d96bbacefb481d/users/8d2ea5966c864240bb184e5750c7cb25/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:52.186482 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8fa4d8-3562-40a6-ac87-303548d0e90f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f61fff2281c04382a7d96bbacefb481d, user_id=8d2ea5966c864240bb184e5750c7cb25, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:52.189225 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8fa4d8-3562-40a6-ac87-303548d0e90f admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:52.201661 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1388/2803] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:05:52 2022] PUT /identity/v3/projects/f61fff2281c04382a7d96bbacefb481d/users/8d2ea5966c864240bb184e5750c7cb25/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:05:52.205548 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e163d11-d3cd-494c-83c2-24175e17274f admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:52.215405 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e163d11-d3cd-494c-83c2-24175e17274f admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:52.218942 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:52.271885 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abe5ec-1bbd-4c5d-b5de-3d1131e659d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:52.272475 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abe5ec-1bbd-4c5d-b5de-3d1131e659d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:52.272682 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abe5ec-1bbd-4c5d-b5de-3d1131e659d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:52.272955 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abe5ec-1bbd-4c5d-b5de-3d1131e659d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:52.273628 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abe5ec-1bbd-4c5d-b5de-3d1131e659d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:52.275216 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abe5ec-1bbd-4c5d-b5de-3d1131e659d8 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:52.284943 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1416/2804] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 11:05:52.289057 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fa4d8-3562-40a6-ac87-303548d0e90f admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:52.299429 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fa4d8-3562-40a6-ac87-303548d0e90f admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:52.304591 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7ca54-3257-46da-819b-ce937efd75c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:52.305223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7ca54-3257-46da-819b-ce937efd75c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:52.305532 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7ca54-3257-46da-819b-ce937efd75c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:52.305804 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7ca54-3257-46da-819b-ce937efd75c7 admin admin] PATH_INFO: `/v3/projects/f61fff2281c04382a7d96bbacefb481d/users/8d2ea5966c864240bb184e5750c7cb25/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:52.307717 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7ca54-3257-46da-819b-ce937efd75c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f61fff2281c04382a7d96bbacefb481d, user_id=8d2ea5966c864240bb184e5750c7cb25, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:52.310362 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7ca54-3257-46da-819b-ce937efd75c7 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:52.320868 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1389/2805] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:05:52 2022] PUT /identity/v3/projects/f61fff2281c04382a7d96bbacefb481d/users/8d2ea5966c864240bb184e5750c7cb25/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:05:52.331808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc531d-5954-4d77-8707-76ed497e3cb9 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:52.332241 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc531d-5954-4d77-8707-76ed497e3cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:52.332444 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc531d-5954-4d77-8707-76ed497e3cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:52.359737 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-a7dc531d-5954-4d77-8707-76ed497e3cb9 None None] MFA Rules not processed for user `8d2ea5966c864240bb184e5750c7cb25`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:52.360944 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-a7dc531d-5954-4d77-8707-76ed497e3cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:52.428180 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1417/2806] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:05:52 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:52.439629 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7ca54-3257-46da-819b-ce937efd75c7 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:52.441440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-d2d7ca54-3257-46da-819b-ce937efd75c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:52.498925 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7ca54-3257-46da-819b-ce937efd75c7 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:52.502585 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd32b9-46ee-4b3f-a7fa-8105fbfc274c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:52.503178 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd32b9-46ee-4b3f-a7fa-8105fbfc274c service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:52.503454 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd32b9-46ee-4b3f-a7fa-8105fbfc274c service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:52.503724 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd32b9-46ee-4b3f-a7fa-8105fbfc274c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:52.512541 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd32b9-46ee-4b3f-a7fa-8105fbfc274c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:52.513983 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd32b9-46ee-4b3f-a7fa-8105fbfc274c service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:52.523611 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1390/2807] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:05:52 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:05:52.912049 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff17cd-a0c9-4fb2-bf1a-fafd82345dd2 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:52.912330 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff17cd-a0c9-4fb2-bf1a-fafd82345dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:52.912601 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff17cd-a0c9-4fb2-bf1a-fafd82345dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:52.932227 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-0eff17cd-a0c9-4fb2-bf1a-fafd82345dd2 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:52.933671 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-0eff17cd-a0c9-4fb2-bf1a-fafd82345dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:52.999221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1418/2808] 10.222.0.30 () {58 vars in 1016 bytes} [Sun Aug 7 11:05:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:53.025289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd32b9-46ee-4b3f-a7fa-8105fbfc274c service cinder] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:53.026710 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-dacd32b9-46ee-4b3f-a7fa-8105fbfc274c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:53.063208 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff17cd-a0c9-4fb2-bf1a-fafd82345dd2 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:53.069001 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:53.073382 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff17cd-a0c9-4fb2-bf1a-fafd82345dd2 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:53.078061 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95111987-69d6-4277-96ac-ed7f321aebac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:53.078670 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95111987-69d6-4277-96ac-ed7f321aebac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:53.078941 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95111987-69d6-4277-96ac-ed7f321aebac admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:53.079207 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95111987-69d6-4277-96ac-ed7f321aebac admin admin] PATH_INFO: `/v3/users/10c570c621f94c5c88c3cfe9141c5368` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:53.080337 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95111987-69d6-4277-96ac-ed7f321aebac admin admin] RBAC: Authorizing `identity:delete_user(user_id=10c570c621f94c5c88c3cfe9141c5368)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:53.082299 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95111987-69d6-4277-96ac-ed7f321aebac admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:53.103853 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd32b9-46ee-4b3f-a7fa-8105fbfc274c service cinder] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:53.104666 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:53.110004 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb00f0-66c5-433b-a6a4-8cf62c284637 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:53.110608 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb00f0-66c5-433b-a6a4-8cf62c284637 service nova] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:53.110885 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb00f0-66c5-433b-a6a4-8cf62c284637 service nova] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:53.111153 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb00f0-66c5-433b-a6a4-8cf62c284637 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:53.120676 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb00f0-66c5-433b-a6a4-8cf62c284637 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:53.122385 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb00f0-66c5-433b-a6a4-8cf62c284637 service nova] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:53.131346 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-95111987-69d6-4277-96ac-ed7f321aebac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10c570c621f94c5c88c3cfe9141c5368'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:53.132535 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1391/2809] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:05:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:05:53.145205 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-95111987-69d6-4277-96ac-ed7f321aebac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10c570c621f94c5c88c3cfe9141c5368'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:53.145955 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-95111987-69d6-4277-96ac-ed7f321aebac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10c570c621f94c5c88c3cfe9141c5368'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:53.152713 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-95111987-69d6-4277-96ac-ed7f321aebac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10c570c621f94c5c88c3cfe9141c5368'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:53.161466 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-95111987-69d6-4277-96ac-ed7f321aebac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10c570c621f94c5c88c3cfe9141c5368'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:53.167447 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1419/2810] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:05:53 2022] DELETE /identity/v3/users/10c570c621f94c5c88c3cfe9141c5368 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:05:53.171912 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b412c0b-d0b8-4886-94bf-2917a085a94f None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:53.172197 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b412c0b-d0b8-4886-94bf-2917a085a94f None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:53.172493 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b412c0b-d0b8-4886-94bf-2917a085a94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:53.191646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-0b412c0b-d0b8-4886-94bf-2917a085a94f None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:53.192910 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-0b412c0b-d0b8-4886-94bf-2917a085a94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:53.255215 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1392/2811] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:05:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:53.264849 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95111987-69d6-4277-96ac-ed7f321aebac admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:53.266248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-95111987-69d6-4277-96ac-ed7f321aebac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:53.323164 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95111987-69d6-4277-96ac-ed7f321aebac admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:53.326877 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a92223-4bf3-4b85-b638-956d905c2331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:53.327462 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a92223-4bf3-4b85-b638-956d905c2331 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:53.327734 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a92223-4bf3-4b85-b638-956d905c2331 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:53.327998 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a92223-4bf3-4b85-b638-956d905c2331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:53.337385 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a92223-4bf3-4b85-b638-956d905c2331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:53.338845 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a92223-4bf3-4b85-b638-956d905c2331 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:53.348886 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1420/2812] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:05:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:05:53.619106 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b412c0b-d0b8-4886-94bf-2917a085a94f None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:53.620619 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-0b412c0b-d0b8-4886-94bf-2917a085a94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:53.636682 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b412c0b-d0b8-4886-94bf-2917a085a94f None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:53.642050 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e9fdf0-2051-4757-bdd6-2bb8d723816b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:53.642670 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9fdf0-2051-4757-bdd6-2bb8d723816b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:53.642946 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9fdf0-2051-4757-bdd6-2bb8d723816b admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:53.643216 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9fdf0-2051-4757-bdd6-2bb8d723816b admin admin] PATH_INFO: `/v3/projects/f38475cc91a6488292d70a57ce0073a1` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:53.644382 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e9fdf0-2051-4757-bdd6-2bb8d723816b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f38475cc91a6488292d70a57ce0073a1)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:53.646868 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e9fdf0-2051-4757-bdd6-2bb8d723816b admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:53.693522 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-84e9fdf0-2051-4757-bdd6-2bb8d723816b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f38475cc91a6488292d70a57ce0073a1', 'request_id': 'req-84e9fdf0-2051-4757-bdd6-2bb8d723816b'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:53.699005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-84e9fdf0-2051-4757-bdd6-2bb8d723816b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f38475cc91a6488292d70a57ce0073a1', 'request_id': 'req-84e9fdf0-2051-4757-bdd6-2bb8d723816b'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:53.705083 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-84e9fdf0-2051-4757-bdd6-2bb8d723816b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f38475cc91a6488292d70a57ce0073a1', 'request_id': 'req-84e9fdf0-2051-4757-bdd6-2bb8d723816b'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:53.717226 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-84e9fdf0-2051-4757-bdd6-2bb8d723816b admin admin] The token cache is being invalidate because project f38475cc91a6488292d70a57ce0073a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:05:53.717543 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-84e9fdf0-2051-4757-bdd6-2bb8d723816b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:53.718166 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-84e9fdf0-2051-4757-bdd6-2bb8d723816b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:53.719645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1393/2813] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:05:53 2022] DELETE /identity/v3/projects/f38475cc91a6488292d70a57ce0073a1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:05:53.724391 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a92223-4bf3-4b85-b638-956d905c2331 service neutron] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:53.734235 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a92223-4bf3-4b85-b638-956d905c2331 service neutron] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:53.789777 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feffdab-06df-49d2-a39e-0c5e5326a776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:53.790383 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feffdab-06df-49d2-a39e-0c5e5326a776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:53.790663 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feffdab-06df-49d2-a39e-0c5e5326a776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:53.790929 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feffdab-06df-49d2-a39e-0c5e5326a776 admin admin] PATH_INFO: `/v3/users/8d2ea5966c864240bb184e5750c7cb25` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:53.792039 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feffdab-06df-49d2-a39e-0c5e5326a776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d2ea5966c864240bb184e5750c7cb25)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:53.793965 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feffdab-06df-49d2-a39e-0c5e5326a776 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:53.837445 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:53.839274 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-3feffdab-06df-49d2-a39e-0c5e5326a776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d2ea5966c864240bb184e5750c7cb25'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:53.853420 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-3feffdab-06df-49d2-a39e-0c5e5326a776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d2ea5966c864240bb184e5750c7cb25'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:53.854081 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-3feffdab-06df-49d2-a39e-0c5e5326a776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d2ea5966c864240bb184e5750c7cb25'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:53.860768 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-3feffdab-06df-49d2-a39e-0c5e5326a776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d2ea5966c864240bb184e5750c7cb25'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:53.868589 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-3feffdab-06df-49d2-a39e-0c5e5326a776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d2ea5966c864240bb184e5750c7cb25'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:53.874333 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1421/2814] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:05:53 2022] DELETE /identity/v3/users/8d2ea5966c864240bb184e5750c7cb25 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:05:54.153209 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e9fdf0-2051-4757-bdd6-2bb8d723816b admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:54.154682 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-84e9fdf0-2051-4757-bdd6-2bb8d723816b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:54.168251 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e9fdf0-2051-4757-bdd6-2bb8d723816b admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:54.209176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:54.225949 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77354256-5708-471d-ae48-19ea490a181a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:54.226588 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77354256-5708-471d-ae48-19ea490a181a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:54.226860 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77354256-5708-471d-ae48-19ea490a181a admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:54.227123 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77354256-5708-471d-ae48-19ea490a181a admin admin] PATH_INFO: `/v3/projects/f61fff2281c04382a7d96bbacefb481d` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:54.228211 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77354256-5708-471d-ae48-19ea490a181a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f61fff2281c04382a7d96bbacefb481d)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:54.230224 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77354256-5708-471d-ae48-19ea490a181a admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:54.274969 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-77354256-5708-471d-ae48-19ea490a181a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f61fff2281c04382a7d96bbacefb481d', 'request_id': 'req-77354256-5708-471d-ae48-19ea490a181a'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:54.280294 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-77354256-5708-471d-ae48-19ea490a181a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f61fff2281c04382a7d96bbacefb481d', 'request_id': 'req-77354256-5708-471d-ae48-19ea490a181a'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:54.286658 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-77354256-5708-471d-ae48-19ea490a181a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f61fff2281c04382a7d96bbacefb481d', 'request_id': 'req-77354256-5708-471d-ae48-19ea490a181a'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:54.298543 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-77354256-5708-471d-ae48-19ea490a181a admin admin] The token cache is being invalidate because project f61fff2281c04382a7d96bbacefb481d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:05:54.298832 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-77354256-5708-471d-ae48-19ea490a181a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:54.299446 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-77354256-5708-471d-ae48-19ea490a181a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:54.300927 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1394/2815] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:05:54 2022] DELETE /identity/v3/projects/f61fff2281c04382a7d96bbacefb481d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:05:54.306395 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e92593-9672-41a1-aea2-87615c85fb72 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:54.306679 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e92593-9672-41a1-aea2-87615c85fb72 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:54.306952 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e92593-9672-41a1-aea2-87615c85fb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:54.325839 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-d1e92593-9672-41a1-aea2-87615c85fb72 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:54.327028 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-d1e92593-9672-41a1-aea2-87615c85fb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:54.386646 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1422/2816] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:54.394801 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b92472-507c-439e-907b-c7548b5ef071 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:54.395581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b92472-507c-439e-907b-c7548b5ef071 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:54.395851 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b92472-507c-439e-907b-c7548b5ef071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:54.415632 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-85b92472-507c-439e-907b-c7548b5ef071 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:54.416759 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-85b92472-507c-439e-907b-c7548b5ef071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:54.424700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1395/2817] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:54.428901 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e92593-9672-41a1-aea2-87615c85fb72 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:54.438660 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e92593-9672-41a1-aea2-87615c85fb72 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:54.443230 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719b3d6-44b7-4128-82b1-25ffdfaff718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:54.443809 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719b3d6-44b7-4128-82b1-25ffdfaff718 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:54.444078 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719b3d6-44b7-4128-82b1-25ffdfaff718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:54.444340 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719b3d6-44b7-4128-82b1-25ffdfaff718 admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:54.444974 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719b3d6-44b7-4128-82b1-25ffdfaff718 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 11:05:54.445271 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719b3d6-44b7-4128-82b1-25ffdfaff718 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:54.446843 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719b3d6-44b7-4128-82b1-25ffdfaff718 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:54.458552 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1423/2818] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 11:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 11:05:54.462700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b92472-507c-439e-907b-c7548b5ef071 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:54.471664 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b92472-507c-439e-907b-c7548b5ef071 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:54.476833 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8b4fe-aac0-45b7-bb30-c0051ee3a2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:54.477440 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8b4fe-aac0-45b7-bb30-c0051ee3a2d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:54.477717 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8b4fe-aac0-45b7-bb30-c0051ee3a2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:54.477987 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8b4fe-aac0-45b7-bb30-c0051ee3a2d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:54.478598 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b8b4fe-aac0-45b7-bb30-c0051ee3a2d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:54.480454 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b8b4fe-aac0-45b7-bb30-c0051ee3a2d4 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:54.506808 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1396/2819] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:05:54 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:05:54.510858 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719b3d6-44b7-4128-82b1-25ffdfaff718 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:54.521882 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719b3d6-44b7-4128-82b1-25ffdfaff718 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:54.584794 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2597ad-4cd8-42b1-8857-9aafbb957177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:54.585498 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2597ad-4cd8-42b1-8857-9aafbb957177 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:54.585801 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2597ad-4cd8-42b1-8857-9aafbb957177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:54.586065 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2597ad-4cd8-42b1-8857-9aafbb957177 admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:54.586771 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2597ad-4cd8-42b1-8857-9aafbb957177 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:54.588783 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2597ad-4cd8-42b1-8857-9aafbb957177 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:54.616087 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1424/2820] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:05:54 2022] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 11:05:54.617380 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8b4fe-aac0-45b7-bb30-c0051ee3a2d4 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:54.627962 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8b4fe-aac0-45b7-bb30-c0051ee3a2d4 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:54.633444 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5392f7d-5c4f-4616-86ef-83bce54bc366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:54.634049 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5392f7d-5c4f-4616-86ef-83bce54bc366 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:54.634322 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5392f7d-5c4f-4616-86ef-83bce54bc366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:54.634590 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5392f7d-5c4f-4616-86ef-83bce54bc366 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:54.635236 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5392f7d-5c4f-4616-86ef-83bce54bc366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:54.636875 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5392f7d-5c4f-4616-86ef-83bce54bc366 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:54.647315 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1397/2821] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:05:54.651360 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2597ad-4cd8-42b1-8857-9aafbb957177 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:54.661216 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2597ad-4cd8-42b1-8857-9aafbb957177 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:54.665928 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef46a9-008f-45d7-a05c-4fb7a1058fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:54.666458 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef46a9-008f-45d7-a05c-4fb7a1058fdb admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:54.666733 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef46a9-008f-45d7-a05c-4fb7a1058fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:54.667004 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef46a9-008f-45d7-a05c-4fb7a1058fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:54.667662 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef46a9-008f-45d7-a05c-4fb7a1058fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:54.669277 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef46a9-008f-45d7-a05c-4fb7a1058fdb admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:54.680260 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1425/2822] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 11:05:54.684005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5392f7d-5c4f-4616-86ef-83bce54bc366 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:54.694707 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5392f7d-5c4f-4616-86ef-83bce54bc366 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:54.699331 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d1de4-f6fb-4bc4-92c9-b7c69a71d2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:54.699957 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d1de4-f6fb-4bc4-92c9-b7c69a71d2b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:54.700235 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d1de4-f6fb-4bc4-92c9-b7c69a71d2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:54.700503 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d1de4-f6fb-4bc4-92c9-b7c69a71d2b8 admin admin] PATH_INFO: `/v3/projects/70b1c3f4dcd54b1495c12e7575bfeb5c/users/4141d115c518481999aa1ef0d27d10b3/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:54.715955 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d1de4-f6fb-4bc4-92c9-b7c69a71d2b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70b1c3f4dcd54b1495c12e7575bfeb5c, user_id=4141d115c518481999aa1ef0d27d10b3, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:54.718643 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d1de4-f6fb-4bc4-92c9-b7c69a71d2b8 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:54.731263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1398/2823] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:05:54 2022] PUT /identity/v3/projects/70b1c3f4dcd54b1495c12e7575bfeb5c/users/4141d115c518481999aa1ef0d27d10b3/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:05:54.742189 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f91add-3c06-46b7-bf20-432f71df610e None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:54.742559 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f91add-3c06-46b7-bf20-432f71df610e None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:54.742834 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f91add-3c06-46b7-bf20-432f71df610e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:54.769916 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-72f91add-3c06-46b7-bf20-432f71df610e None None] MFA Rules not processed for user `4141d115c518481999aa1ef0d27d10b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:54.771142 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-72f91add-3c06-46b7-bf20-432f71df610e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:54.787868 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:54.836662 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1426/2824] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:05:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:54.847736 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d1de4-f6fb-4bc4-92c9-b7c69a71d2b8 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:54.850053 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ee0d1de4-f6fb-4bc4-92c9-b7c69a71d2b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:54.906148 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d1de4-f6fb-4bc4-92c9-b7c69a71d2b8 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:54.909891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee0eb5-1ae1-4e29-aa53-8cdb0b4c937f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:54.911028 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee0eb5-1ae1-4e29-aa53-8cdb0b4c937f service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:54.911309 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee0eb5-1ae1-4e29-aa53-8cdb0b4c937f service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:54.911576 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee0eb5-1ae1-4e29-aa53-8cdb0b4c937f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:54.920766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee0eb5-1ae1-4e29-aa53-8cdb0b4c937f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:54.922168 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee0eb5-1ae1-4e29-aa53-8cdb0b4c937f service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:54.931960 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1399/2825] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:05:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:05:54.953720 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f91add-3c06-46b7-bf20-432f71df610e None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:55.015765 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f91add-3c06-46b7-bf20-432f71df610e None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:55.020674 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c74cc-b32b-4712-b74f-7b5261a07a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:55.021281 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c74cc-b32b-4712-b74f-7b5261a07a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:55.021591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c74cc-b32b-4712-b74f-7b5261a07a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:55.021861 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c74cc-b32b-4712-b74f-7b5261a07a81 admin admin] PATH_INFO: `/v3/users/4141d115c518481999aa1ef0d27d10b3` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:55.022992 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c74cc-b32b-4712-b74f-7b5261a07a81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4141d115c518481999aa1ef0d27d10b3)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:55.024882 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c74cc-b32b-4712-b74f-7b5261a07a81 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:55.074149 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-226c74cc-b32b-4712-b74f-7b5261a07a81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4141d115c518481999aa1ef0d27d10b3'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:55.086213 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-226c74cc-b32b-4712-b74f-7b5261a07a81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4141d115c518481999aa1ef0d27d10b3'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:55.086900 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-226c74cc-b32b-4712-b74f-7b5261a07a81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4141d115c518481999aa1ef0d27d10b3'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:55.093730 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-226c74cc-b32b-4712-b74f-7b5261a07a81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4141d115c518481999aa1ef0d27d10b3'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:55.101603 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-226c74cc-b32b-4712-b74f-7b5261a07a81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4141d115c518481999aa1ef0d27d10b3'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:55.107423 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1427/2826] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:05:54 2022] DELETE /identity/v3/users/4141d115c518481999aa1ef0d27d10b3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:05:55.111857 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0510ae-7d29-4254-9911-966b3c587e52 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:55.112161 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0510ae-7d29-4254-9911-966b3c587e52 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:55.112423 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0510ae-7d29-4254-9911-966b3c587e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:55.131365 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-ac0510ae-7d29-4254-9911-966b3c587e52 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:55.132560 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ac0510ae-7d29-4254-9911-966b3c587e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:55.140714 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:55.194569 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1400/2827] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:55.204119 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c74cc-b32b-4712-b74f-7b5261a07a81 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:55.205526 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-226c74cc-b32b-4712-b74f-7b5261a07a81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:55.247349 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:55.264984 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c74cc-b32b-4712-b74f-7b5261a07a81 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:55.269026 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e2c6a-8b8e-4060-8ffb-3034a6588617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:55.269659 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e2c6a-8b8e-4060-8ffb-3034a6588617 service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:55.269937 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e2c6a-8b8e-4060-8ffb-3034a6588617 service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:55.270229 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e2c6a-8b8e-4060-8ffb-3034a6588617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:55.279070 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e2c6a-8b8e-4060-8ffb-3034a6588617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:55.280551 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e2c6a-8b8e-4060-8ffb-3034a6588617 service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:55.290329 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1428/2828] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:05:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:05:55.553619 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0510ae-7d29-4254-9911-966b3c587e52 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:55.555349 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ac0510ae-7d29-4254-9911-966b3c587e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:55.569788 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0510ae-7d29-4254-9911-966b3c587e52 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:55.574334 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eabf36-c099-46a7-96b5-fc2c018cdf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:55.575008 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eabf36-c099-46a7-96b5-fc2c018cdf2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:55.575287 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eabf36-c099-46a7-96b5-fc2c018cdf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:55.575557 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eabf36-c099-46a7-96b5-fc2c018cdf2d admin admin] PATH_INFO: `/v3/projects/70b1c3f4dcd54b1495c12e7575bfeb5c` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:55.576736 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eabf36-c099-46a7-96b5-fc2c018cdf2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=70b1c3f4dcd54b1495c12e7575bfeb5c)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:55.578694 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eabf36-c099-46a7-96b5-fc2c018cdf2d admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:55.626013 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-00eabf36-c099-46a7-96b5-fc2c018cdf2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70b1c3f4dcd54b1495c12e7575bfeb5c', 'request_id': 'req-00eabf36-c099-46a7-96b5-fc2c018cdf2d'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:55.632203 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-00eabf36-c099-46a7-96b5-fc2c018cdf2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70b1c3f4dcd54b1495c12e7575bfeb5c', 'request_id': 'req-00eabf36-c099-46a7-96b5-fc2c018cdf2d'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:55.638704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-00eabf36-c099-46a7-96b5-fc2c018cdf2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70b1c3f4dcd54b1495c12e7575bfeb5c', 'request_id': 'req-00eabf36-c099-46a7-96b5-fc2c018cdf2d'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:55.651702 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-00eabf36-c099-46a7-96b5-fc2c018cdf2d admin admin] The token cache is being invalidate because project 70b1c3f4dcd54b1495c12e7575bfeb5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:05:55.651990 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-00eabf36-c099-46a7-96b5-fc2c018cdf2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:55.652607 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-00eabf36-c099-46a7-96b5-fc2c018cdf2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:05:55.654216 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1401/2829] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:05:55 2022] DELETE /identity/v3/projects/70b1c3f4dcd54b1495c12e7575bfeb5c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:05:55.659024 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd78ef-2d12-48fd-9460-7301271f6412 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:55.659499 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd78ef-2d12-48fd-9460-7301271f6412 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:55.659612 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd78ef-2d12-48fd-9460-7301271f6412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:55.678324 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-ebfd78ef-2d12-48fd-9460-7301271f6412 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:55.679515 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-ebfd78ef-2d12-48fd-9460-7301271f6412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:55.736661 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1429/2830] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:55.799881 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d7666-63db-4cd6-b3c3-d923d62dad5f None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:55.800164 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d7666-63db-4cd6-b3c3-d923d62dad5f None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:55.800436 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d7666-63db-4cd6-b3c3-d923d62dad5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:55.820254 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-ba7d7666-63db-4cd6-b3c3-d923d62dad5f None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:55.821467 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ba7d7666-63db-4cd6-b3c3-d923d62dad5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:55.829176 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1402/2831] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:55.833940 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd78ef-2d12-48fd-9460-7301271f6412 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:55.843534 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd78ef-2d12-48fd-9460-7301271f6412 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:55.848173 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d125527-4223-4604-9909-a640078793ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:55.848751 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d125527-4223-4604-9909-a640078793ac admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:55.849023 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d125527-4223-4604-9909-a640078793ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:55.849290 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d125527-4223-4604-9909-a640078793ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:55.849955 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d125527-4223-4604-9909-a640078793ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 11:05:55.850252 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d125527-4223-4604-9909-a640078793ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:55.851811 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d125527-4223-4604-9909-a640078793ac admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:55.863343 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1430/2832] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 11:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 11:05:55.868174 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d7666-63db-4cd6-b3c3-d923d62dad5f None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:55.877448 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d7666-63db-4cd6-b3c3-d923d62dad5f None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:55.882600 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1436e84-854e-42cd-8ddf-16f329c3c565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:55.883179 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1436e84-854e-42cd-8ddf-16f329c3c565 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:55.883456 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1436e84-854e-42cd-8ddf-16f329c3c565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:55.883726 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1436e84-854e-42cd-8ddf-16f329c3c565 admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:55.884348 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1436e84-854e-42cd-8ddf-16f329c3c565 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:55.886255 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1436e84-854e-42cd-8ddf-16f329c3c565 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:55.912872 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1403/2833] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:05:55 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:05:55.917210 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d125527-4223-4604-9909-a640078793ac admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:55.927566 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d125527-4223-4604-9909-a640078793ac admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:55.987045 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffd4b7-e4b8-4cbc-afb6-fda989e9ce41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:55.987579 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffd4b7-e4b8-4cbc-afb6-fda989e9ce41 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:55.987851 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffd4b7-e4b8-4cbc-afb6-fda989e9ce41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:55.988114 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffd4b7-e4b8-4cbc-afb6-fda989e9ce41 admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:55.989220 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffd4b7-e4b8-4cbc-afb6-fda989e9ce41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:55.991241 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffd4b7-e4b8-4cbc-afb6-fda989e9ce41 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:56.016574 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1431/2834] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:05:55 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:05:56.017825 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1436e84-854e-42cd-8ddf-16f329c3c565 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:56.028249 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1436e84-854e-42cd-8ddf-16f329c3c565 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:56.033985 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcf2aa-d07f-4846-8e32-94a9a19057ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:56.034605 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcf2aa-d07f-4846-8e32-94a9a19057ba admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:56.034887 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcf2aa-d07f-4846-8e32-94a9a19057ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:56.035155 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcf2aa-d07f-4846-8e32-94a9a19057ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:56.035830 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fcf2aa-d07f-4846-8e32-94a9a19057ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:56.037431 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fcf2aa-d07f-4846-8e32-94a9a19057ba admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:56.047801 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1404/2835] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:05:56.052419 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffd4b7-e4b8-4cbc-afb6-fda989e9ce41 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:56.062414 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffd4b7-e4b8-4cbc-afb6-fda989e9ce41 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:56.067738 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812dec1-9a64-4391-8842-6f64e1dfb5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:56.068321 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812dec1-9a64-4391-8842-6f64e1dfb5cb admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:56.068593 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812dec1-9a64-4391-8842-6f64e1dfb5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:56.068861 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812dec1-9a64-4391-8842-6f64e1dfb5cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:56.069535 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812dec1-9a64-4391-8842-6f64e1dfb5cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:56.071130 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812dec1-9a64-4391-8842-6f64e1dfb5cb admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:56.084926 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1432/2836] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:05:56.086107 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcf2aa-d07f-4846-8e32-94a9a19057ba admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:56.096394 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcf2aa-d07f-4846-8e32-94a9a19057ba admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:56.101504 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66023e3-cd09-437c-a208-70a5173ded12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:56.102142 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66023e3-cd09-437c-a208-70a5173ded12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:56.103616 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66023e3-cd09-437c-a208-70a5173ded12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:56.103616 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66023e3-cd09-437c-a208-70a5173ded12 admin admin] PATH_INFO: `/v3/projects/63588b0beacb4fd3b31fce4fdee1aa02/users/cda1475b39924b1ca1cb55910b1d36fc/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:56.118646 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66023e3-cd09-437c-a208-70a5173ded12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63588b0beacb4fd3b31fce4fdee1aa02, user_id=cda1475b39924b1ca1cb55910b1d36fc, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:56.121195 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66023e3-cd09-437c-a208-70a5173ded12 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:56.137191 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1405/2837] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:05:56 2022] PUT /identity/v3/projects/63588b0beacb4fd3b31fce4fdee1aa02/users/cda1475b39924b1ca1cb55910b1d36fc/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:05:56.148338 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dbd5a-9448-4343-8d38-8ecc1ec8f11d None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:56.148619 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dbd5a-9448-4343-8d38-8ecc1ec8f11d None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:56.148889 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dbd5a-9448-4343-8d38-8ecc1ec8f11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:56.180217 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-c84dbd5a-9448-4343-8d38-8ecc1ec8f11d None None] MFA Rules not processed for user `cda1475b39924b1ca1cb55910b1d36fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:56.181453 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-c84dbd5a-9448-4343-8d38-8ecc1ec8f11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:56.217491 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:56.257030 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1433/2838] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:05:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:56.261711 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66023e3-cd09-437c-a208-70a5173ded12 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:56.296656 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:56.324855 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66023e3-cd09-437c-a208-70a5173ded12 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:56.329532 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ed8c5-569d-474c-a94f-73933c0cdd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:56.330131 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ed8c5-569d-474c-a94f-73933c0cdd82 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:56.330405 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ed8c5-569d-474c-a94f-73933c0cdd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:56.330673 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ed8c5-569d-474c-a94f-73933c0cdd82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:56.331292 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ed8c5-569d-474c-a94f-73933c0cdd82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:56.333177 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ed8c5-569d-474c-a94f-73933c0cdd82 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:56.360271 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1406/2839] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:05:56 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 11:05:56.365098 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84dbd5a-9448-4343-8d38-8ecc1ec8f11d None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:56.375855 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84dbd5a-9448-4343-8d38-8ecc1ec8f11d None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:56.430887 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a4ab6-1cea-4f48-919b-88b0c64136fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:56.431537 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a4ab6-1cea-4f48-919b-88b0c64136fa admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:56.431816 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a4ab6-1cea-4f48-919b-88b0c64136fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:56.432086 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a4ab6-1cea-4f48-919b-88b0c64136fa admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:56.432697 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a4ab6-1cea-4f48-919b-88b0c64136fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:56.434619 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a4ab6-1cea-4f48-919b-88b0c64136fa admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:56.455600 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1434/2840] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:05:56 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:05:56.459754 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ed8c5-569d-474c-a94f-73933c0cdd82 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:56.469867 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ed8c5-569d-474c-a94f-73933c0cdd82 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:56.475018 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1eecac-3ae6-49ec-8927-dc0d4549c25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:56.475600 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1eecac-3ae6-49ec-8927-dc0d4549c25b admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:56.475876 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1eecac-3ae6-49ec-8927-dc0d4549c25b admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:56.476142 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1eecac-3ae6-49ec-8927-dc0d4549c25b admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:56.476816 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1eecac-3ae6-49ec-8927-dc0d4549c25b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:56.478453 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1eecac-3ae6-49ec-8927-dc0d4549c25b admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:56.489725 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1407/2841] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:05:56.493497 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a4ab6-1cea-4f48-919b-88b0c64136fa admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:56.503350 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a4ab6-1cea-4f48-919b-88b0c64136fa admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:56.507831 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59594c7e-e5c2-4f29-b811-2039c0ac7c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:56.508403 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59594c7e-e5c2-4f29-b811-2039c0ac7c6a admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:56.508676 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59594c7e-e5c2-4f29-b811-2039c0ac7c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:56.508941 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59594c7e-e5c2-4f29-b811-2039c0ac7c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:56.509609 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59594c7e-e5c2-4f29-b811-2039c0ac7c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:56.511150 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59594c7e-e5c2-4f29-b811-2039c0ac7c6a admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:56.521027 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1435/2842] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:05:56.525103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1eecac-3ae6-49ec-8927-dc0d4549c25b admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:56.535165 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1eecac-3ae6-49ec-8927-dc0d4549c25b admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:56.540432 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa67ed-6e94-4413-828c-120787eeb1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:56.541101 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa67ed-6e94-4413-828c-120787eeb1cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:56.541473 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa67ed-6e94-4413-828c-120787eeb1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:56.541825 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa67ed-6e94-4413-828c-120787eeb1cc admin admin] PATH_INFO: `/v3/projects/4f5db998a52a445b85ac3114b77a0b53/users/37295522100942379e3dd9012413c9af/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:56.557894 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa67ed-6e94-4413-828c-120787eeb1cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f5db998a52a445b85ac3114b77a0b53, user_id=37295522100942379e3dd9012413c9af, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:56.560501 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa67ed-6e94-4413-828c-120787eeb1cc admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:56.573067 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1408/2843] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:05:56 2022] PUT /identity/v3/projects/4f5db998a52a445b85ac3114b77a0b53/users/37295522100942379e3dd9012413c9af/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:05:56.589300 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54e6cf-8971-42dc-8874-3154183171f1 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:56.589618 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54e6cf-8971-42dc-8874-3154183171f1 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:56.589890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54e6cf-8971-42dc-8874-3154183171f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:56.620445 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-1c54e6cf-8971-42dc-8874-3154183171f1 None None] MFA Rules not processed for user `37295522100942379e3dd9012413c9af`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:56.621715 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-1c54e6cf-8971-42dc-8874-3154183171f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:56.684650 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1436/2844] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:05:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:56.689130 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa67ed-6e94-4413-828c-120787eeb1cc admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:56.747916 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa67ed-6e94-4413-828c-120787eeb1cc admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:56.752460 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d84fa8-87d6-42a7-a18e-d7a4413c02f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:56.753035 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d84fa8-87d6-42a7-a18e-d7a4413c02f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:56.753326 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d84fa8-87d6-42a7-a18e-d7a4413c02f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:56.753653 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d84fa8-87d6-42a7-a18e-d7a4413c02f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:56.754220 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d84fa8-87d6-42a7-a18e-d7a4413c02f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:56.756077 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d84fa8-87d6-42a7-a18e-d7a4413c02f4 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:56.782513 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1409/2845] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:05:56 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 11:05:56.787107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54e6cf-8971-42dc-8874-3154183171f1 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:56.797683 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54e6cf-8971-42dc-8874-3154183171f1 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:56.840736 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:56.856930 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e083cb-a664-4511-87ca-fc984364777d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:56.857571 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e083cb-a664-4511-87ca-fc984364777d admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:56.857849 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e083cb-a664-4511-87ca-fc984364777d admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:56.858119 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e083cb-a664-4511-87ca-fc984364777d admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:56.858740 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e083cb-a664-4511-87ca-fc984364777d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:56.860634 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e083cb-a664-4511-87ca-fc984364777d admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:56.880361 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1437/2846] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:05:56 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:05:56.884970 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d84fa8-87d6-42a7-a18e-d7a4413c02f4 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:56.898934 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d84fa8-87d6-42a7-a18e-d7a4413c02f4 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:56.903778 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4190a42-52b2-4a81-af50-9c9af1ce25c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:56.904338 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4190a42-52b2-4a81-af50-9c9af1ce25c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:56.904840 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4190a42-52b2-4a81-af50-9c9af1ce25c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:56.905347 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4190a42-52b2-4a81-af50-9c9af1ce25c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:56.906578 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4190a42-52b2-4a81-af50-9c9af1ce25c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:56.908985 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4190a42-52b2-4a81-af50-9c9af1ce25c4 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:56.924029 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1410/2847] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:05:56.925228 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e083cb-a664-4511-87ca-fc984364777d admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:56.937262 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e083cb-a664-4511-87ca-fc984364777d admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:56.942412 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca2738-db8f-4192-8fa4-c2603e0646e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:56.943081 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca2738-db8f-4192-8fa4-c2603e0646e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:56.943364 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca2738-db8f-4192-8fa4-c2603e0646e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:56.943637 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca2738-db8f-4192-8fa4-c2603e0646e5 admin admin] PATH_INFO: `/v3/projects/f5b28776b1c6493aa0d1292ab161eb7b/users/9efaf48a77ed4a93a9a41a46443aadcc/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:56.959674 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca2738-db8f-4192-8fa4-c2603e0646e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b28776b1c6493aa0d1292ab161eb7b, user_id=9efaf48a77ed4a93a9a41a46443aadcc, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:56.962471 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca2738-db8f-4192-8fa4-c2603e0646e5 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:56.975764 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1438/2848] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:05:56 2022] PUT /identity/v3/projects/f5b28776b1c6493aa0d1292ab161eb7b/users/9efaf48a77ed4a93a9a41a46443aadcc/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:05:56.979823 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4190a42-52b2-4a81-af50-9c9af1ce25c4 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:56.989907 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4190a42-52b2-4a81-af50-9c9af1ce25c4 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:57.042574 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:05:57.050006 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d0727-15dc-4e91-9096-a739fd96f0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:57.050660 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d0727-15dc-4e91-9096-a739fd96f0fd admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:57.051501 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d0727-15dc-4e91-9096-a739fd96f0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:57.051830 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d0727-15dc-4e91-9096-a739fd96f0fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:57.052479 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d0727-15dc-4e91-9096-a739fd96f0fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:57.054091 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d0727-15dc-4e91-9096-a739fd96f0fd admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:57.066075 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1411/2849] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:05:57.070875 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca2738-db8f-4192-8fa4-c2603e0646e5 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:57.081509 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca2738-db8f-4192-8fa4-c2603e0646e5 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:57.086839 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29037a8-d568-495c-90a6-c7c490397183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:57.087480 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29037a8-d568-495c-90a6-c7c490397183 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:57.087753 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29037a8-d568-495c-90a6-c7c490397183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:57.088018 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29037a8-d568-495c-90a6-c7c490397183 admin admin] PATH_INFO: `/v3/projects/f5b28776b1c6493aa0d1292ab161eb7b/users/9efaf48a77ed4a93a9a41a46443aadcc/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:57.090083 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29037a8-d568-495c-90a6-c7c490397183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b28776b1c6493aa0d1292ab161eb7b, user_id=9efaf48a77ed4a93a9a41a46443aadcc, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:57.092609 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29037a8-d568-495c-90a6-c7c490397183 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:57.103696 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1439/2850] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:05:57 2022] PUT /identity/v3/projects/f5b28776b1c6493aa0d1292ab161eb7b/users/9efaf48a77ed4a93a9a41a46443aadcc/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:05:57.115288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638165da-0f72-49c6-a14a-0ae385e17b88 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:57.115568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638165da-0f72-49c6-a14a-0ae385e17b88 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:57.115881 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638165da-0f72-49c6-a14a-0ae385e17b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:57.144181 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-638165da-0f72-49c6-a14a-0ae385e17b88 None None] MFA Rules not processed for user `9efaf48a77ed4a93a9a41a46443aadcc`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:05:57.145994 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-638165da-0f72-49c6-a14a-0ae385e17b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:57.213921 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1412/2851] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:05:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:05:57.226271 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29037a8-d568-495c-90a6-c7c490397183 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:57.228001 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-f29037a8-d568-495c-90a6-c7c490397183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:57.290375 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29037a8-d568-495c-90a6-c7c490397183 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:57.294198 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6982778-3405-48bc-9719-bf1206d8a4e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:57.294821 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6982778-3405-48bc-9719-bf1206d8a4e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:57.295096 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6982778-3405-48bc-9719-bf1206d8a4e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:57.295364 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6982778-3405-48bc-9719-bf1206d8a4e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:57.356574 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6982778-3405-48bc-9719-bf1206d8a4e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:57.358221 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6982778-3405-48bc-9719-bf1206d8a4e9 service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:57.368377 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1440/2852] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:05:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:05:58.919850 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638165da-0f72-49c6-a14a-0ae385e17b88 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:58.921213 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-638165da-0f72-49c6-a14a-0ae385e17b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:05:58.933258 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638165da-0f72-49c6-a14a-0ae385e17b88 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:58.936802 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdea7cc-0f0d-45f8-95da-98ec6f274b0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:58.937782 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdea7cc-0f0d-45f8-95da-98ec6f274b0c service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:58.937782 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdea7cc-0f0d-45f8-95da-98ec6f274b0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:58.938005 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdea7cc-0f0d-45f8-95da-98ec6f274b0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:58.992443 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdea7cc-0f0d-45f8-95da-98ec6f274b0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:58.993885 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdea7cc-0f0d-45f8-95da-98ec6f274b0c service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:59.002856 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1413/2853] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:05:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:05:59.512997 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6982778-3405-48bc-9719-bf1206d8a4e9 service cinder] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:05:59.522403 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6982778-3405-48bc-9719-bf1206d8a4e9 service cinder] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:05:59.526012 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5099c5-2509-451c-8eed-4d8b6105f176 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:05:59.526602 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5099c5-2509-451c-8eed-4d8b6105f176 service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:05:59.526879 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5099c5-2509-451c-8eed-4d8b6105f176 service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:05:59.527150 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5099c5-2509-451c-8eed-4d8b6105f176 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:05:59.535920 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5099c5-2509-451c-8eed-4d8b6105f176 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:05:59.537380 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5099c5-2509-451c-8eed-4d8b6105f176 service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:05:59.546643 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1441/2854] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:05:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:06:03.440367 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdea7cc-0f0d-45f8-95da-98ec6f274b0c service cinder] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:03.505368 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdea7cc-0f0d-45f8-95da-98ec6f274b0c service cinder] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:03.509839 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97382709-0754-4603-8f41-973f81334112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:03.510452 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97382709-0754-4603-8f41-973f81334112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:03.510722 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97382709-0754-4603-8f41-973f81334112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:03.510993 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97382709-0754-4603-8f41-973f81334112 admin admin] PATH_INFO: `/v3/users/cda1475b39924b1ca1cb55910b1d36fc` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:03.512120 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97382709-0754-4603-8f41-973f81334112 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cda1475b39924b1ca1cb55910b1d36fc)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:03.514069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97382709-0754-4603-8f41-973f81334112 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:03.535788 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:06:03.563654 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-97382709-0754-4603-8f41-973f81334112 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cda1475b39924b1ca1cb55910b1d36fc'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:03.579680 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-97382709-0754-4603-8f41-973f81334112 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cda1475b39924b1ca1cb55910b1d36fc'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:03.580693 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-97382709-0754-4603-8f41-973f81334112 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cda1475b39924b1ca1cb55910b1d36fc'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:03.591675 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-97382709-0754-4603-8f41-973f81334112 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cda1475b39924b1ca1cb55910b1d36fc'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:03.604921 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-97382709-0754-4603-8f41-973f81334112 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cda1475b39924b1ca1cb55910b1d36fc'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:03.614461 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1414/2855] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:06:03 2022] DELETE /identity/v3/users/cda1475b39924b1ca1cb55910b1d36fc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:06:03.619200 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a141434-c039-4159-b3bb-d3a883ce4a0a None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:03.619649 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a141434-c039-4159-b3bb-d3a883ce4a0a None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:03.619766 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a141434-c039-4159-b3bb-d3a883ce4a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:03.642404 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-1a141434-c039-4159-b3bb-d3a883ce4a0a None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:06:03.644345 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-1a141434-c039-4159-b3bb-d3a883ce4a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:06:03.679948 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:06:03.708577 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1442/2856] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:06:03.718112 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97382709-0754-4603-8f41-973f81334112 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:03.719506 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-97382709-0754-4603-8f41-973f81334112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:06:03.777654 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97382709-0754-4603-8f41-973f81334112 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:03.781259 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33358ae2-53eb-4250-8679-661fd656c451 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:03.781884 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33358ae2-53eb-4250-8679-661fd656c451 service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:03.782159 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33358ae2-53eb-4250-8679-661fd656c451 service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:03.782433 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33358ae2-53eb-4250-8679-661fd656c451 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:03.791805 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33358ae2-53eb-4250-8679-661fd656c451 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:03.793215 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33358ae2-53eb-4250-8679-661fd656c451 service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:03.803067 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1415/2857] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:06:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:06:04.087681 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a141434-c039-4159-b3bb-d3a883ce4a0a None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:04.089176 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-1a141434-c039-4159-b3bb-d3a883ce4a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:06:04.102594 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a141434-c039-4159-b3bb-d3a883ce4a0a None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:04.107727 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b71a6b-c77b-4dfa-97fa-db87ca0ca888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:04.108355 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b71a6b-c77b-4dfa-97fa-db87ca0ca888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:04.108629 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b71a6b-c77b-4dfa-97fa-db87ca0ca888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:04.108898 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b71a6b-c77b-4dfa-97fa-db87ca0ca888 admin admin] PATH_INFO: `/v3/projects/63588b0beacb4fd3b31fce4fdee1aa02` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:04.110052 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b71a6b-c77b-4dfa-97fa-db87ca0ca888 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63588b0beacb4fd3b31fce4fdee1aa02)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:04.111921 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b71a6b-c77b-4dfa-97fa-db87ca0ca888 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:04.162906 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-35b71a6b-c77b-4dfa-97fa-db87ca0ca888 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63588b0beacb4fd3b31fce4fdee1aa02', 'request_id': 'req-35b71a6b-c77b-4dfa-97fa-db87ca0ca888'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:04.168254 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-35b71a6b-c77b-4dfa-97fa-db87ca0ca888 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63588b0beacb4fd3b31fce4fdee1aa02', 'request_id': 'req-35b71a6b-c77b-4dfa-97fa-db87ca0ca888'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:04.174979 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-35b71a6b-c77b-4dfa-97fa-db87ca0ca888 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63588b0beacb4fd3b31fce4fdee1aa02', 'request_id': 'req-35b71a6b-c77b-4dfa-97fa-db87ca0ca888'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:04.186072 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-35b71a6b-c77b-4dfa-97fa-db87ca0ca888 admin admin] The token cache is being invalidate because project 63588b0beacb4fd3b31fce4fdee1aa02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:06:04.186410 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-35b71a6b-c77b-4dfa-97fa-db87ca0ca888 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:04.187048 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-35b71a6b-c77b-4dfa-97fa-db87ca0ca888 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:04.188510 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1443/2858] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:06:04 2022] DELETE /identity/v3/projects/63588b0beacb4fd3b31fce4fdee1aa02 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:06:04.192527 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33358ae2-53eb-4250-8679-661fd656c451 service neutron] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:04.202460 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33358ae2-53eb-4250-8679-661fd656c451 service neutron] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:04.257236 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9dd1d-4a42-4f68-adad-ee632f29f1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:04.257874 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9dd1d-4a42-4f68-adad-ee632f29f1f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:04.258151 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9dd1d-4a42-4f68-adad-ee632f29f1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:04.258430 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9dd1d-4a42-4f68-adad-ee632f29f1f3 admin admin] PATH_INFO: `/v3/users/37295522100942379e3dd9012413c9af` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:04.259501 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9dd1d-4a42-4f68-adad-ee632f29f1f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37295522100942379e3dd9012413c9af)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:04.261391 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9dd1d-4a42-4f68-adad-ee632f29f1f3 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:04.302483 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:06:04.308148 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-c1f9dd1d-4a42-4f68-adad-ee632f29f1f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37295522100942379e3dd9012413c9af'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:04.320236 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-c1f9dd1d-4a42-4f68-adad-ee632f29f1f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37295522100942379e3dd9012413c9af'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:04.321004 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-c1f9dd1d-4a42-4f68-adad-ee632f29f1f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37295522100942379e3dd9012413c9af'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:04.328168 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-c1f9dd1d-4a42-4f68-adad-ee632f29f1f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37295522100942379e3dd9012413c9af'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:04.336161 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-c1f9dd1d-4a42-4f68-adad-ee632f29f1f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37295522100942379e3dd9012413c9af'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:04.342229 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1416/2859] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:06:04 2022] DELETE /identity/v3/users/37295522100942379e3dd9012413c9af => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:06:04.606555 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b71a6b-c77b-4dfa-97fa-db87ca0ca888 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:04.608008 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-35b71a6b-c77b-4dfa-97fa-db87ca0ca888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:06:04.625124 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b71a6b-c77b-4dfa-97fa-db87ca0ca888 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:04.685098 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957cf0f-ace2-44d8-8dfb-ed395a0ba891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:04.685759 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957cf0f-ace2-44d8-8dfb-ed395a0ba891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:04.686042 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957cf0f-ace2-44d8-8dfb-ed395a0ba891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:04.686307 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957cf0f-ace2-44d8-8dfb-ed395a0ba891 admin admin] PATH_INFO: `/v3/projects/4f5db998a52a445b85ac3114b77a0b53` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:04.687428 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957cf0f-ace2-44d8-8dfb-ed395a0ba891 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f5db998a52a445b85ac3114b77a0b53)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:04.689300 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957cf0f-ace2-44d8-8dfb-ed395a0ba891 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:04.739617 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-7957cf0f-ace2-44d8-8dfb-ed395a0ba891 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f5db998a52a445b85ac3114b77a0b53', 'request_id': 'req-7957cf0f-ace2-44d8-8dfb-ed395a0ba891'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:04.746910 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-7957cf0f-ace2-44d8-8dfb-ed395a0ba891 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f5db998a52a445b85ac3114b77a0b53', 'request_id': 'req-7957cf0f-ace2-44d8-8dfb-ed395a0ba891'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:04.750743 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:06:04.756004 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-7957cf0f-ace2-44d8-8dfb-ed395a0ba891 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f5db998a52a445b85ac3114b77a0b53', 'request_id': 'req-7957cf0f-ace2-44d8-8dfb-ed395a0ba891'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:04.770295 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-7957cf0f-ace2-44d8-8dfb-ed395a0ba891 admin admin] The token cache is being invalidate because project 4f5db998a52a445b85ac3114b77a0b53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:06:04.770716 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-7957cf0f-ace2-44d8-8dfb-ed395a0ba891 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:04.771359 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-7957cf0f-ace2-44d8-8dfb-ed395a0ba891 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:04.772849 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1444/2860] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:06:04 2022] DELETE /identity/v3/projects/4f5db998a52a445b85ac3114b77a0b53 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:06:04.776796 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9dd1d-4a42-4f68-adad-ee632f29f1f3 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:04.778392 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-c1f9dd1d-4a42-4f68-adad-ee632f29f1f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:06:04.793047 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9dd1d-4a42-4f68-adad-ee632f29f1f3 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:04.855615 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c782764-5526-4ba2-a965-28b184103fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:04.856299 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c782764-5526-4ba2-a965-28b184103fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:04.856576 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c782764-5526-4ba2-a965-28b184103fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:04.856843 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c782764-5526-4ba2-a965-28b184103fe9 admin admin] PATH_INFO: `/v3/users/9efaf48a77ed4a93a9a41a46443aadcc` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:04.857968 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c782764-5526-4ba2-a965-28b184103fe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9efaf48a77ed4a93a9a41a46443aadcc)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:04.859973 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c782764-5526-4ba2-a965-28b184103fe9 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:04.906788 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0c782764-5526-4ba2-a965-28b184103fe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9efaf48a77ed4a93a9a41a46443aadcc'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:04.918888 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0c782764-5526-4ba2-a965-28b184103fe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9efaf48a77ed4a93a9a41a46443aadcc'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:04.919576 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0c782764-5526-4ba2-a965-28b184103fe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9efaf48a77ed4a93a9a41a46443aadcc'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:04.926939 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0c782764-5526-4ba2-a965-28b184103fe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9efaf48a77ed4a93a9a41a46443aadcc'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:04.933728 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0c782764-5526-4ba2-a965-28b184103fe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9efaf48a77ed4a93a9a41a46443aadcc'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:04.939697 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1417/2861] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:06:04 2022] DELETE /identity/v3/users/9efaf48a77ed4a93a9a41a46443aadcc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:06:05.208438 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957cf0f-ace2-44d8-8dfb-ed395a0ba891 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:05.209933 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-7957cf0f-ace2-44d8-8dfb-ed395a0ba891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:06:05.223265 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957cf0f-ace2-44d8-8dfb-ed395a0ba891 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:05.281218 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665752b0-8305-4f69-b30d-bc01768af5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:05.281871 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665752b0-8305-4f69-b30d-bc01768af5fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:05.282152 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665752b0-8305-4f69-b30d-bc01768af5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:05.282420 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665752b0-8305-4f69-b30d-bc01768af5fb admin admin] PATH_INFO: `/v3/projects/f5b28776b1c6493aa0d1292ab161eb7b` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:05.283526 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665752b0-8305-4f69-b30d-bc01768af5fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5b28776b1c6493aa0d1292ab161eb7b)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:05.285948 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665752b0-8305-4f69-b30d-bc01768af5fb admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:05.336513 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-665752b0-8305-4f69-b30d-bc01768af5fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5b28776b1c6493aa0d1292ab161eb7b', 'request_id': 'req-665752b0-8305-4f69-b30d-bc01768af5fb'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:05.341965 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-665752b0-8305-4f69-b30d-bc01768af5fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5b28776b1c6493aa0d1292ab161eb7b', 'request_id': 'req-665752b0-8305-4f69-b30d-bc01768af5fb'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:05.350344 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-665752b0-8305-4f69-b30d-bc01768af5fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5b28776b1c6493aa0d1292ab161eb7b', 'request_id': 'req-665752b0-8305-4f69-b30d-bc01768af5fb'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:05.361726 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-665752b0-8305-4f69-b30d-bc01768af5fb admin admin] The token cache is being invalidate because project f5b28776b1c6493aa0d1292ab161eb7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:06:05.362010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-665752b0-8305-4f69-b30d-bc01768af5fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:05.362625 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-665752b0-8305-4f69-b30d-bc01768af5fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:05.364745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1445/2862] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:06:05 2022] DELETE /identity/v3/projects/f5b28776b1c6493aa0d1292ab161eb7b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:06:05.369692 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755eb17e-fda7-41a9-a0c1-c1b2eff93030 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:05.370000 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755eb17e-fda7-41a9-a0c1-c1b2eff93030 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:05.370271 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755eb17e-fda7-41a9-a0c1-c1b2eff93030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:05.389353 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-755eb17e-fda7-41a9-a0c1-c1b2eff93030 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:06:05.390480 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-755eb17e-fda7-41a9-a0c1-c1b2eff93030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:06:05.422287 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:06:05.450561 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1418/2863] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:06:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:06:05.458581 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a758d5e-61e3-47b8-8260-eacc187c4091 None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:05.458929 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a758d5e-61e3-47b8-8260-eacc187c4091 None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:05.459204 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a758d5e-61e3-47b8-8260-eacc187c4091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:05.478798 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-2a758d5e-61e3-47b8-8260-eacc187c4091 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:06:05.479988 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-2a758d5e-61e3-47b8-8260-eacc187c4091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:06:05.487800 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1446/2864] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:06:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:06:05.492438 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755eb17e-fda7-41a9-a0c1-c1b2eff93030 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:05.502106 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755eb17e-fda7-41a9-a0c1-c1b2eff93030 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:05.506706 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b75353-d421-4137-bd46-0b903e268d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:05.507293 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b75353-d421-4137-bd46-0b903e268d2e admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:05.507571 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b75353-d421-4137-bd46-0b903e268d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:05.507842 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b75353-d421-4137-bd46-0b903e268d2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:05.508513 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b75353-d421-4137-bd46-0b903e268d2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 11:06:05.508819 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b75353-d421-4137-bd46-0b903e268d2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:05.510435 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b75353-d421-4137-bd46-0b903e268d2e admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:05.522083 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1419/2865] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 11:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 11:06:05.526113 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a758d5e-61e3-47b8-8260-eacc187c4091 None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:05.535768 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a758d5e-61e3-47b8-8260-eacc187c4091 None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:05.540331 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bab92f-5900-472e-a425-70b01c042502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:05.540909 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bab92f-5900-472e-a425-70b01c042502 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:05.541182 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bab92f-5900-472e-a425-70b01c042502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:05.541487 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bab92f-5900-472e-a425-70b01c042502 admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:05.542110 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bab92f-5900-472e-a425-70b01c042502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:05.543989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bab92f-5900-472e-a425-70b01c042502 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:05.570721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1447/2866] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:06:05 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:06:05.574735 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b75353-d421-4137-bd46-0b903e268d2e admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:05.585058 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b75353-d421-4137-bd46-0b903e268d2e admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:05.648553 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60523994-2810-4774-855d-5608cb103e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:05.649067 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60523994-2810-4774-855d-5608cb103e23 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:05.649374 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60523994-2810-4774-855d-5608cb103e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:05.649649 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60523994-2810-4774-855d-5608cb103e23 admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:05.650269 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60523994-2810-4774-855d-5608cb103e23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:05.652167 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60523994-2810-4774-855d-5608cb103e23 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:05.673055 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1420/2867] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:06:05 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:06:05.677265 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bab92f-5900-472e-a425-70b01c042502 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:05.687449 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bab92f-5900-472e-a425-70b01c042502 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:05.693745 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1130b-de5c-4633-8f76-0b81c01e8454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:05.694341 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1130b-de5c-4633-8f76-0b81c01e8454 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:05.694617 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1130b-de5c-4633-8f76-0b81c01e8454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:05.694890 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1130b-de5c-4633-8f76-0b81c01e8454 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:05.695530 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1130b-de5c-4633-8f76-0b81c01e8454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:05.697103 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1130b-de5c-4633-8f76-0b81c01e8454 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:05.706970 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1448/2868] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:06:05.711406 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60523994-2810-4774-855d-5608cb103e23 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:05.721123 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60523994-2810-4774-855d-5608cb103e23 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:05.726379 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301eac19-6339-431d-beb8-1190b5dfc222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:05.726958 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301eac19-6339-431d-beb8-1190b5dfc222 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:05.727234 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301eac19-6339-431d-beb8-1190b5dfc222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:05.727504 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301eac19-6339-431d-beb8-1190b5dfc222 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:05.728143 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301eac19-6339-431d-beb8-1190b5dfc222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:05.729768 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301eac19-6339-431d-beb8-1190b5dfc222 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:05.739971 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1421/2869] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:06:05.744000 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1130b-de5c-4633-8f76-0b81c01e8454 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:05.754332 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1130b-de5c-4633-8f76-0b81c01e8454 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:05.759279 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbe355-9cdc-4486-89e5-f3cdd9e313fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:05.759945 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbe355-9cdc-4486-89e5-f3cdd9e313fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:05.760251 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbe355-9cdc-4486-89e5-f3cdd9e313fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:05.760550 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbe355-9cdc-4486-89e5-f3cdd9e313fd admin admin] PATH_INFO: `/v3/projects/7c1f8796e03a42ba8bec84ad63093a66/users/72162e3bb34749b39b6b9f56af6cf94d/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:05.776016 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbe355-9cdc-4486-89e5-f3cdd9e313fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c1f8796e03a42ba8bec84ad63093a66, user_id=72162e3bb34749b39b6b9f56af6cf94d, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:05.778691 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbe355-9cdc-4486-89e5-f3cdd9e313fd admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:05.792101 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1449/2870] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:06:05 2022] PUT /identity/v3/projects/7c1f8796e03a42ba8bec84ad63093a66/users/72162e3bb34749b39b6b9f56af6cf94d/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:06:05.803385 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829c33f-69c8-45d2-ab91-854e438ee5ed None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:05.803858 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829c33f-69c8-45d2-ab91-854e438ee5ed None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:05.803958 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829c33f-69c8-45d2-ab91-854e438ee5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:05.830581 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-6829c33f-69c8-45d2-ab91-854e438ee5ed None None] MFA Rules not processed for user `72162e3bb34749b39b6b9f56af6cf94d`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:06:05.831767 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-6829c33f-69c8-45d2-ab91-854e438ee5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:06:05.898871 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1422/2871] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:06:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:06:05.903384 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbe355-9cdc-4486-89e5-f3cdd9e313fd admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:05.923542 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:06:05.974231 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbe355-9cdc-4486-89e5-f3cdd9e313fd admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:05.979939 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b3d17-915e-4d94-bfc2-b761106620c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:05.980548 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b3d17-915e-4d94-bfc2-b761106620c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:05.980819 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b3d17-915e-4d94-bfc2-b761106620c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:05.981094 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b3d17-915e-4d94-bfc2-b761106620c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:05.981770 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b3d17-915e-4d94-bfc2-b761106620c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:05.983669 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b3d17-915e-4d94-bfc2-b761106620c9 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:06.011437 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1450/2872] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:06:05 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:06:06.016361 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829c33f-69c8-45d2-ab91-854e438ee5ed None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:06.028271 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829c33f-69c8-45d2-ab91-854e438ee5ed None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:06.059732 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:06:06.091700 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e56a1-bf56-4c88-b39e-69704630fe12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:06.092380 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e56a1-bf56-4c88-b39e-69704630fe12 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:06.092660 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e56a1-bf56-4c88-b39e-69704630fe12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:06.092935 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e56a1-bf56-4c88-b39e-69704630fe12 admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:06.093611 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e56a1-bf56-4c88-b39e-69704630fe12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:06.095586 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e56a1-bf56-4c88-b39e-69704630fe12 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:06.120329 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1423/2873] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:06:06 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:06:06.121718 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b3d17-915e-4d94-bfc2-b761106620c9 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:06.133119 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b3d17-915e-4d94-bfc2-b761106620c9 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:06.139171 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125a271-7d79-49e1-a2ab-5170d13c6bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:06.140075 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125a271-7d79-49e1-a2ab-5170d13c6bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:06.140601 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125a271-7d79-49e1-a2ab-5170d13c6bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:06.140856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f125a271-7d79-49e1-a2ab-5170d13c6bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:06.141801 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125a271-7d79-49e1-a2ab-5170d13c6bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:06.143389 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f125a271-7d79-49e1-a2ab-5170d13c6bf9 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:06.157379 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1451/2874] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:06:06.159991 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e56a1-bf56-4c88-b39e-69704630fe12 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:06.170378 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e56a1-bf56-4c88-b39e-69704630fe12 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:06.175068 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbc3a4-a132-4e6f-98f7-a7056259e855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:06.175657 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbc3a4-a132-4e6f-98f7-a7056259e855 admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:06.175935 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbc3a4-a132-4e6f-98f7-a7056259e855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:06.176435 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbc3a4-a132-4e6f-98f7-a7056259e855 admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:06.176847 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abbc3a4-a132-4e6f-98f7-a7056259e855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:06.178648 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abbc3a4-a132-4e6f-98f7-a7056259e855 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:06.194891 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1424/2875] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:06:06.196451 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125a271-7d79-49e1-a2ab-5170d13c6bf9 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:06.215355 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f125a271-7d79-49e1-a2ab-5170d13c6bf9 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:06.220761 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e4f99-728d-4ba1-9a3b-2f3958cf0bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:06.221446 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e4f99-728d-4ba1-9a3b-2f3958cf0bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:06.221727 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e4f99-728d-4ba1-9a3b-2f3958cf0bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:06.222000 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e4f99-728d-4ba1-9a3b-2f3958cf0bf8 admin admin] PATH_INFO: `/v3/projects/fe8d7628367449ccafed0640d1d2caf1/users/0b7a3768bc45400ea73784c09de51058/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:06.237256 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e4f99-728d-4ba1-9a3b-2f3958cf0bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe8d7628367449ccafed0640d1d2caf1, user_id=0b7a3768bc45400ea73784c09de51058, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:06.240113 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e4f99-728d-4ba1-9a3b-2f3958cf0bf8 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:06.253628 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1452/2876] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:06:06 2022] PUT /identity/v3/projects/fe8d7628367449ccafed0640d1d2caf1/users/0b7a3768bc45400ea73784c09de51058/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:06:06.264541 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a678c-dc6f-47d7-9490-56e24e6656ac None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:06.264829 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a678c-dc6f-47d7-9490-56e24e6656ac None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:06.265107 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a678c-dc6f-47d7-9490-56e24e6656ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:06.295551 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-ea0a678c-dc6f-47d7-9490-56e24e6656ac None None] MFA Rules not processed for user `0b7a3768bc45400ea73784c09de51058`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:06:06.296766 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-ea0a678c-dc6f-47d7-9490-56e24e6656ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:06:06.360518 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1425/2877] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:06:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:06:06.365760 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e4f99-728d-4ba1-9a3b-2f3958cf0bf8 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:06.426641 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e4f99-728d-4ba1-9a3b-2f3958cf0bf8 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:06.431181 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269171cb-86d2-4b16-8b77-781265d31dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:06.431764 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269171cb-86d2-4b16-8b77-781265d31dbb admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:06.432037 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269171cb-86d2-4b16-8b77-781265d31dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:06.432301 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269171cb-86d2-4b16-8b77-781265d31dbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:06.432967 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269171cb-86d2-4b16-8b77-781265d31dbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:06.434856 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269171cb-86d2-4b16-8b77-781265d31dbb admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:06.460866 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1453/2878] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:06:06 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:06:06.464989 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a678c-dc6f-47d7-9490-56e24e6656ac None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:06.475474 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a678c-dc6f-47d7-9490-56e24e6656ac None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:06.530811 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e6509-8828-4c6f-9e9d-5e63247472e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:06.531396 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e6509-8828-4c6f-9e9d-5e63247472e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:06.531673 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e6509-8828-4c6f-9e9d-5e63247472e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:06.531940 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e6509-8828-4c6f-9e9d-5e63247472e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:06.532558 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e6509-8828-4c6f-9e9d-5e63247472e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:06.534476 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e6509-8828-4c6f-9e9d-5e63247472e7 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:06.555447 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1426/2879] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:06:06 2022] POST /identity/v3/users => generated 298 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:06:06.559458 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269171cb-86d2-4b16-8b77-781265d31dbb admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:06.570505 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269171cb-86d2-4b16-8b77-781265d31dbb admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:06.575131 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bd77d-231b-4327-85fb-3397df2bdccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:06.575714 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bd77d-231b-4327-85fb-3397df2bdccd admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:06.575995 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bd77d-231b-4327-85fb-3397df2bdccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:06.576268 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bd77d-231b-4327-85fb-3397df2bdccd admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:06.576903 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097bd77d-231b-4327-85fb-3397df2bdccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:06.578517 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097bd77d-231b-4327-85fb-3397df2bdccd admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:06.589945 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1454/2880] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:06:06.593933 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e6509-8828-4c6f-9e9d-5e63247472e7 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:06.603903 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e6509-8828-4c6f-9e9d-5e63247472e7 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:06.608589 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518cdd48-81b9-4ff6-8d02-24e040912fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:06.609215 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cdd48-81b9-4ff6-8d02-24e040912fcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:06.609512 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cdd48-81b9-4ff6-8d02-24e040912fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:06.609778 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cdd48-81b9-4ff6-8d02-24e040912fcd admin admin] PATH_INFO: `/v3/projects/3ed82f852f034a5d8df0ceca35cc63cd/users/a0c7488335794e8788c9e4159146e203/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:06.624354 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518cdd48-81b9-4ff6-8d02-24e040912fcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ed82f852f034a5d8df0ceca35cc63cd, user_id=a0c7488335794e8788c9e4159146e203, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:06.626993 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518cdd48-81b9-4ff6-8d02-24e040912fcd admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:06.639711 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1427/2881] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:06:06 2022] PUT /identity/v3/projects/3ed82f852f034a5d8df0ceca35cc63cd/users/a0c7488335794e8788c9e4159146e203/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:06:06.643823 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bd77d-231b-4327-85fb-3397df2bdccd admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:06.653905 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bd77d-231b-4327-85fb-3397df2bdccd admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:06.692538 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:06:06.709923 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42615cd7-6cb0-4005-8148-ffabf4293781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:06.710524 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42615cd7-6cb0-4005-8148-ffabf4293781 admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:06.710801 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42615cd7-6cb0-4005-8148-ffabf4293781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:06.711073 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42615cd7-6cb0-4005-8148-ffabf4293781 admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:06.711711 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42615cd7-6cb0-4005-8148-ffabf4293781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:06.713281 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42615cd7-6cb0-4005-8148-ffabf4293781 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:06.722987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1455/2882] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 11:06:06.727145 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518cdd48-81b9-4ff6-8d02-24e040912fcd admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:06.737170 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518cdd48-81b9-4ff6-8d02-24e040912fcd admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:06.742291 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2abac-4ec3-4fce-bacd-7bed2611a886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:06.742913 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2abac-4ec3-4fce-bacd-7bed2611a886 admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:06.743195 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2abac-4ec3-4fce-bacd-7bed2611a886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:06.743457 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2abac-4ec3-4fce-bacd-7bed2611a886 admin admin] PATH_INFO: `/v3/projects/3ed82f852f034a5d8df0ceca35cc63cd/users/a0c7488335794e8788c9e4159146e203/roles/9da6e501237c405ca021a9d9f6173caf` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:06.745502 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2abac-4ec3-4fce-bacd-7bed2611a886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ed82f852f034a5d8df0ceca35cc63cd, user_id=a0c7488335794e8788c9e4159146e203, role_id=9da6e501237c405ca021a9d9f6173caf)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:06.748076 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2abac-4ec3-4fce-bacd-7bed2611a886 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:06.750244 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:06:06.760478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1428/2883] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:06:06 2022] PUT /identity/v3/projects/3ed82f852f034a5d8df0ceca35cc63cd/users/a0c7488335794e8788c9e4159146e203/roles/9da6e501237c405ca021a9d9f6173caf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:06:06.770886 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6accbb8-329e-4ce1-a2d2-e3c5a605d92d None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:06.771169 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6accbb8-329e-4ce1-a2d2-e3c5a605d92d None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:06.771439 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6accbb8-329e-4ce1-a2d2-e3c5a605d92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:06.798304 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-a6accbb8-329e-4ce1-a2d2-e3c5a605d92d None None] MFA Rules not processed for user `a0c7488335794e8788c9e4159146e203`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:06:06.799513 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-a6accbb8-329e-4ce1-a2d2-e3c5a605d92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:06:06.866446 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1456/2884] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:06:06 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 11:06:06.877981 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2abac-4ec3-4fce-bacd-7bed2611a886 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:06.879659 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-d1f2abac-4ec3-4fce-bacd-7bed2611a886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:06:06.936519 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2abac-4ec3-4fce-bacd-7bed2611a886 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:06.940263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f269bb-d082-4235-a455-87529c2d30bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:06.940849 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f269bb-d082-4235-a455-87529c2d30bf service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:06.941125 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f269bb-d082-4235-a455-87529c2d30bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:06.941445 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f269bb-d082-4235-a455-87529c2d30bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:06.996441 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f269bb-d082-4235-a455-87529c2d30bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:06.998702 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f269bb-d082-4235-a455-87529c2d30bf service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:07.012517 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1429/2885] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:06:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:06:08.507235 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6accbb8-329e-4ce1-a2d2-e3c5a605d92d None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:08.517107 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6accbb8-329e-4ce1-a2d2-e3c5a605d92d None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:08.521249 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca85121-c6b9-4994-b794-092791af38b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:08.521820 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca85121-c6b9-4994-b794-092791af38b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:08.522091 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca85121-c6b9-4994-b794-092791af38b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:08.522351 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca85121-c6b9-4994-b794-092791af38b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:08.580026 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca85121-c6b9-4994-b794-092791af38b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:08.581581 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca85121-c6b9-4994-b794-092791af38b9 service cinder] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:08.591220 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1457/2886] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:06:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:06:09.107943 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f269bb-d082-4235-a455-87529c2d30bf service cinder] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:09.117012 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f269bb-d082-4235-a455-87529c2d30bf service cinder] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:09.120588 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a82f6-0bf5-4d36-b233-cc6a065c267f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:09.121170 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a82f6-0bf5-4d36-b233-cc6a065c267f service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:09.121485 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a82f6-0bf5-4d36-b233-cc6a065c267f service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:09.121757 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a82f6-0bf5-4d36-b233-cc6a065c267f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:09.131103 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a82f6-0bf5-4d36-b233-cc6a065c267f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:09.132510 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a82f6-0bf5-4d36-b233-cc6a065c267f service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:09.142417 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1430/2887] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:06:09 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:06:13.005548 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca85121-c6b9-4994-b794-092791af38b9 service cinder] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:13.067561 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca85121-c6b9-4994-b794-092791af38b9 service cinder] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:13.072106 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ee910-2de0-4a25-8208-aebfdb71d406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:13.072712 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ee910-2de0-4a25-8208-aebfdb71d406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:13.072987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ee910-2de0-4a25-8208-aebfdb71d406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:13.073258 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ee910-2de0-4a25-8208-aebfdb71d406 admin admin] PATH_INFO: `/v3/users/72162e3bb34749b39b6b9f56af6cf94d` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:13.074393 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ee910-2de0-4a25-8208-aebfdb71d406 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72162e3bb34749b39b6b9f56af6cf94d)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:13.076282 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ee910-2de0-4a25-8208-aebfdb71d406 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:13.078546 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=100 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:06:13.122391 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-c98ee910-2de0-4a25-8208-aebfdb71d406 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72162e3bb34749b39b6b9f56af6cf94d'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:13.133941 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-c98ee910-2de0-4a25-8208-aebfdb71d406 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72162e3bb34749b39b6b9f56af6cf94d'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:13.134761 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-c98ee910-2de0-4a25-8208-aebfdb71d406 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72162e3bb34749b39b6b9f56af6cf94d'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:13.142865 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-c98ee910-2de0-4a25-8208-aebfdb71d406 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72162e3bb34749b39b6b9f56af6cf94d'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:13.149711 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-c98ee910-2de0-4a25-8208-aebfdb71d406 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72162e3bb34749b39b6b9f56af6cf94d'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:13.156531 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1458/2888] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:06:13 2022] DELETE /identity/v3/users/72162e3bb34749b39b6b9f56af6cf94d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:06:13.161034 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3a147-2177-473d-a369-9b5704f3cfa2 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:13.161519 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3a147-2177-473d-a369-9b5704f3cfa2 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:13.161653 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3a147-2177-473d-a369-9b5704f3cfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:13.181204 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-2dc3a147-2177-473d-a369-9b5704f3cfa2 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:06:13.182659 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-2dc3a147-2177-473d-a369-9b5704f3cfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:06:13.254568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1431/2889] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:06:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:06:13.264483 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ee910-2de0-4a25-8208-aebfdb71d406 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:13.265923 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-c98ee910-2de0-4a25-8208-aebfdb71d406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:06:13.323147 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ee910-2de0-4a25-8208-aebfdb71d406 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:13.326757 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5896aa-1cce-401e-a20b-625c2963777d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:13.327343 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5896aa-1cce-401e-a20b-625c2963777d service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:13.327613 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5896aa-1cce-401e-a20b-625c2963777d service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:13.327876 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5896aa-1cce-401e-a20b-625c2963777d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:13.337456 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5896aa-1cce-401e-a20b-625c2963777d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:13.338876 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5896aa-1cce-401e-a20b-625c2963777d service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:13.349095 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1459/2890] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:06:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:06:13.632963 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3a147-2177-473d-a369-9b5704f3cfa2 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:13.634484 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-2dc3a147-2177-473d-a369-9b5704f3cfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:06:13.654877 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3a147-2177-473d-a369-9b5704f3cfa2 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:13.660685 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a05b2-1baf-4476-8d71-2d130ccad62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:13.661343 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a05b2-1baf-4476-8d71-2d130ccad62b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:13.661695 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a05b2-1baf-4476-8d71-2d130ccad62b admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:13.662007 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a05b2-1baf-4476-8d71-2d130ccad62b admin admin] PATH_INFO: `/v3/projects/7c1f8796e03a42ba8bec84ad63093a66` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:13.663839 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a05b2-1baf-4476-8d71-2d130ccad62b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c1f8796e03a42ba8bec84ad63093a66)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:13.666860 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a05b2-1baf-4476-8d71-2d130ccad62b admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:13.701989 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:INSERT=1,keystone:SELECT=97,keystone:DELETE=2 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:06:13.717051 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-210a05b2-1baf-4476-8d71-2d130ccad62b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c1f8796e03a42ba8bec84ad63093a66', 'request_id': 'req-210a05b2-1baf-4476-8d71-2d130ccad62b'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:13.722846 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-210a05b2-1baf-4476-8d71-2d130ccad62b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c1f8796e03a42ba8bec84ad63093a66', 'request_id': 'req-210a05b2-1baf-4476-8d71-2d130ccad62b'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:13.729529 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-210a05b2-1baf-4476-8d71-2d130ccad62b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c1f8796e03a42ba8bec84ad63093a66', 'request_id': 'req-210a05b2-1baf-4476-8d71-2d130ccad62b'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:13.741129 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-210a05b2-1baf-4476-8d71-2d130ccad62b admin admin] The token cache is being invalidate because project 7c1f8796e03a42ba8bec84ad63093a66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:06:13.741452 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-210a05b2-1baf-4476-8d71-2d130ccad62b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:13.742070 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-210a05b2-1baf-4476-8d71-2d130ccad62b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:13.743564 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1432/2891] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:06:13 2022] DELETE /identity/v3/projects/7c1f8796e03a42ba8bec84ad63093a66 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:06:13.747590 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5896aa-1cce-401e-a20b-625c2963777d service neutron] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:13.757576 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5896aa-1cce-401e-a20b-625c2963777d service neutron] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:13.813449 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8045477-8c0f-4468-b42e-4278f3102acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:13.814079 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8045477-8c0f-4468-b42e-4278f3102acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:13.814365 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8045477-8c0f-4468-b42e-4278f3102acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:13.814636 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8045477-8c0f-4468-b42e-4278f3102acb admin admin] PATH_INFO: `/v3/users/0b7a3768bc45400ea73784c09de51058` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:13.815752 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8045477-8c0f-4468-b42e-4278f3102acb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b7a3768bc45400ea73784c09de51058)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:13.817681 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8045477-8c0f-4468-b42e-4278f3102acb admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:13.845387 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:06:13.865422 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d8045477-8c0f-4468-b42e-4278f3102acb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b7a3768bc45400ea73784c09de51058'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:13.877259 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d8045477-8c0f-4468-b42e-4278f3102acb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b7a3768bc45400ea73784c09de51058'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:13.877949 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d8045477-8c0f-4468-b42e-4278f3102acb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b7a3768bc45400ea73784c09de51058'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:13.885228 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d8045477-8c0f-4468-b42e-4278f3102acb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b7a3768bc45400ea73784c09de51058'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:13.892026 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d8045477-8c0f-4468-b42e-4278f3102acb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b7a3768bc45400ea73784c09de51058'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:13.898321 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1460/2892] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:06:13 2022] DELETE /identity/v3/users/0b7a3768bc45400ea73784c09de51058 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:06:14.168493 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a05b2-1baf-4476-8d71-2d130ccad62b admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:14.170538 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-210a05b2-1baf-4476-8d71-2d130ccad62b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:06:14.185941 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a05b2-1baf-4476-8d71-2d130ccad62b admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:14.241143 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e985b4-68ae-4c7c-85a6-fe3dc323c823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:14.241806 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e985b4-68ae-4c7c-85a6-fe3dc323c823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:14.242082 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e985b4-68ae-4c7c-85a6-fe3dc323c823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:14.242352 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e985b4-68ae-4c7c-85a6-fe3dc323c823 admin admin] PATH_INFO: `/v3/projects/fe8d7628367449ccafed0640d1d2caf1` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:14.243449 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e985b4-68ae-4c7c-85a6-fe3dc323c823 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe8d7628367449ccafed0640d1d2caf1)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:14.245354 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e985b4-68ae-4c7c-85a6-fe3dc323c823 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:14.290357 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-a6e985b4-68ae-4c7c-85a6-fe3dc323c823 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe8d7628367449ccafed0640d1d2caf1', 'request_id': 'req-a6e985b4-68ae-4c7c-85a6-fe3dc323c823'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:14.295787 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-a6e985b4-68ae-4c7c-85a6-fe3dc323c823 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe8d7628367449ccafed0640d1d2caf1', 'request_id': 'req-a6e985b4-68ae-4c7c-85a6-fe3dc323c823'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:14.301683 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-a6e985b4-68ae-4c7c-85a6-fe3dc323c823 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe8d7628367449ccafed0640d1d2caf1', 'request_id': 'req-a6e985b4-68ae-4c7c-85a6-fe3dc323c823'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:14.314310 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-a6e985b4-68ae-4c7c-85a6-fe3dc323c823 admin admin] The token cache is being invalidate because project fe8d7628367449ccafed0640d1d2caf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:06:14.314594 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-a6e985b4-68ae-4c7c-85a6-fe3dc323c823 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:14.315781 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-a6e985b4-68ae-4c7c-85a6-fe3dc323c823 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:14.317242 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1433/2893] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:06:14 2022] DELETE /identity/v3/projects/fe8d7628367449ccafed0640d1d2caf1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:06:14.321840 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8045477-8c0f-4468-b42e-4278f3102acb admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:14.323203 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-d8045477-8c0f-4468-b42e-4278f3102acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:06:14.336013 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8045477-8c0f-4468-b42e-4278f3102acb admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:14.392587 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed535c6-5b2d-49c4-aeeb-43253664b898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:14.393210 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed535c6-5b2d-49c4-aeeb-43253664b898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:14.393521 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed535c6-5b2d-49c4-aeeb-43253664b898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:14.393792 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed535c6-5b2d-49c4-aeeb-43253664b898 admin admin] PATH_INFO: `/v3/users/a0c7488335794e8788c9e4159146e203` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:14.394912 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed535c6-5b2d-49c4-aeeb-43253664b898 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0c7488335794e8788c9e4159146e203)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:14.396813 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed535c6-5b2d-49c4-aeeb-43253664b898 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:14.440389 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-0ed535c6-5b2d-49c4-aeeb-43253664b898 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0c7488335794e8788c9e4159146e203'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:14.452570 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-0ed535c6-5b2d-49c4-aeeb-43253664b898 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0c7488335794e8788c9e4159146e203'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:14.453238 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-0ed535c6-5b2d-49c4-aeeb-43253664b898 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0c7488335794e8788c9e4159146e203'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:14.460053 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-0ed535c6-5b2d-49c4-aeeb-43253664b898 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0c7488335794e8788c9e4159146e203'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:14.466750 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-0ed535c6-5b2d-49c4-aeeb-43253664b898 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0c7488335794e8788c9e4159146e203'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:14.472463 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1461/2894] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:06:14 2022] DELETE /identity/v3/users/a0c7488335794e8788c9e4159146e203 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:06:14.748776 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e985b4-68ae-4c7c-85a6-fe3dc323c823 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:14.750249 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-a6e985b4-68ae-4c7c-85a6-fe3dc323c823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:06:14.763411 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e985b4-68ae-4c7c-85a6-fe3dc323c823 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:14.809689 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:06:14.822322 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f980f-e04f-4ed8-b7b5-0211433032eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:14.822879 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f980f-e04f-4ed8-b7b5-0211433032eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:14.823152 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f980f-e04f-4ed8-b7b5-0211433032eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:14.823418 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f980f-e04f-4ed8-b7b5-0211433032eb admin admin] PATH_INFO: `/v3/projects/3ed82f852f034a5d8df0ceca35cc63cd` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:14.824510 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f980f-e04f-4ed8-b7b5-0211433032eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ed82f852f034a5d8df0ceca35cc63cd)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:14.826435 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f980f-e04f-4ed8-b7b5-0211433032eb admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:14.872555 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-538f980f-e04f-4ed8-b7b5-0211433032eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ed82f852f034a5d8df0ceca35cc63cd', 'request_id': 'req-538f980f-e04f-4ed8-b7b5-0211433032eb'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:14.878041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-538f980f-e04f-4ed8-b7b5-0211433032eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ed82f852f034a5d8df0ceca35cc63cd', 'request_id': 'req-538f980f-e04f-4ed8-b7b5-0211433032eb'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:14.884058 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-538f980f-e04f-4ed8-b7b5-0211433032eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ed82f852f034a5d8df0ceca35cc63cd', 'request_id': 'req-538f980f-e04f-4ed8-b7b5-0211433032eb'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:14.895858 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-538f980f-e04f-4ed8-b7b5-0211433032eb admin admin] The token cache is being invalidate because project 3ed82f852f034a5d8df0ceca35cc63cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:06:14.896144 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-538f980f-e04f-4ed8-b7b5-0211433032eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:14.896752 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-538f980f-e04f-4ed8-b7b5-0211433032eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:14.898738 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1434/2895] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:06:14 2022] DELETE /identity/v3/projects/3ed82f852f034a5d8df0ceca35cc63cd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:06:14.903584 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10adb7f-84ad-4cdf-adb5-4da6b267504f None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:14.903866 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10adb7f-84ad-4cdf-adb5-4da6b267504f None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:14.904136 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10adb7f-84ad-4cdf-adb5-4da6b267504f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:14.924810 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-e10adb7f-84ad-4cdf-adb5-4da6b267504f None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:06:14.926059 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-e10adb7f-84ad-4cdf-adb5-4da6b267504f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:06:14.942156 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:06:14.986012 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1462/2896] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:06:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:06:14.994376 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccc35d-4eb1-460d-b600-e68b77123829 None None] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:14.994659 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccc35d-4eb1-460d-b600-e68b77123829 None None] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:14.994929 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccc35d-4eb1-460d-b600-e68b77123829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:15.014699 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.auth.core [None req-53ccc35d-4eb1-460d-b600-e68b77123829 None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:06:15.015926 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-53ccc35d-4eb1-460d-b600-e68b77123829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:06:15.024168 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1435/2897] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:06:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:06:15.028194 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10adb7f-84ad-4cdf-adb5-4da6b267504f None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:15.037786 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10adb7f-84ad-4cdf-adb5-4da6b267504f None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:15.042309 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd024a20-997b-43ac-a45c-81b51bf6b1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:15.042888 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd024a20-997b-43ac-a45c-81b51bf6b1dd admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:15.043165 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd024a20-997b-43ac-a45c-81b51bf6b1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:15.043431 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd024a20-997b-43ac-a45c-81b51bf6b1dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:15.044069 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd024a20-997b-43ac-a45c-81b51bf6b1dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80144) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 11:06:15.044366 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd024a20-997b-43ac-a45c-81b51bf6b1dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:15.045974 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd024a20-997b-43ac-a45c-81b51bf6b1dd admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:15.058058 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1463/2898] 10.222.0.27 () {58 vars in 1153 bytes} [Sun Aug 7 11:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 11:06:15.062181 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ccc35d-4eb1-460d-b600-e68b77123829 None None] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:15.072034 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ccc35d-4eb1-460d-b600-e68b77123829 None None] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:15.077067 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca2ea8-cc4a-4361-8156-f4dbd150ec74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:15.077645 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca2ea8-cc4a-4361-8156-f4dbd150ec74 admin admin] REQUEST_METHOD: `POST` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:15.077922 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca2ea8-cc4a-4361-8156-f4dbd150ec74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:15.078233 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca2ea8-cc4a-4361-8156-f4dbd150ec74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:15.078876 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca2ea8-cc4a-4361-8156-f4dbd150ec74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:15.080788 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca2ea8-cc4a-4361-8156-f4dbd150ec74 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:15.106305 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1436/2899] 10.222.0.27 () {60 vars in 1153 bytes} [Sun Aug 7 11:06:15 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:06:15.110285 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd024a20-997b-43ac-a45c-81b51bf6b1dd admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:15.120675 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd024a20-997b-43ac-a45c-81b51bf6b1dd admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:15.177830 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1b351-7ab5-4ce5-b1d8-ec9b92606d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:15.178938 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1b351-7ab5-4ce5-b1d8-ec9b92606d9e admin admin] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:15.179218 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1b351-7ab5-4ce5-b1d8-ec9b92606d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:15.179490 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1b351-7ab5-4ce5-b1d8-ec9b92606d9e admin admin] PATH_INFO: `/v3/users` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:15.180093 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1b351-7ab5-4ce5-b1d8-ec9b92606d9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:15.182044 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1b351-7ab5-4ce5-b1d8-ec9b92606d9e admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:15.202772 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1464/2900] 10.222.0.27 () {60 vars in 1144 bytes} [Sun Aug 7 11:06:15 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 11:06:15.206869 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca2ea8-cc4a-4361-8156-f4dbd150ec74 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:15.217217 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca2ea8-cc4a-4361-8156-f4dbd150ec74 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:15.221950 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d1b73-8811-4846-88aa-81f8e15c7a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:15.222535 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d1b73-8811-4846-88aa-81f8e15c7a3d admin admin] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:15.222811 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d1b73-8811-4846-88aa-81f8e15c7a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:15.223081 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d1b73-8811-4846-88aa-81f8e15c7a3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:15.223724 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d1b73-8811-4846-88aa-81f8e15c7a3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:15.225331 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d1b73-8811-4846-88aa-81f8e15c7a3d admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:15.235121 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1437/2901] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 11:06:15.238868 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1b351-7ab5-4ce5-b1d8-ec9b92606d9e admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:15.249153 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1b351-7ab5-4ce5-b1d8-ec9b92606d9e admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:15.253742 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1890a8-eb3a-4b61-bd7a-75a5533356ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:15.254315 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1890a8-eb3a-4b61-bd7a-75a5533356ea admin admin] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:15.254588 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1890a8-eb3a-4b61-bd7a-75a5533356ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:15.254858 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1890a8-eb3a-4b61-bd7a-75a5533356ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:15.255485 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1890a8-eb3a-4b61-bd7a-75a5533356ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:15.257702 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1890a8-eb3a-4b61-bd7a-75a5533356ea admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:15.268232 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1465/2902] 10.222.0.27 () {58 vars in 1122 bytes} [Sun Aug 7 11:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 11:06:15.272333 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d1b73-8811-4846-88aa-81f8e15c7a3d admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:15.282156 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d1b73-8811-4846-88aa-81f8e15c7a3d admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:15.286794 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5cc7f-e050-435e-a236-cfecba9a6482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:15.287422 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5cc7f-e050-435e-a236-cfecba9a6482 admin admin] REQUEST_METHOD: `PUT` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:15.288206 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5cc7f-e050-435e-a236-cfecba9a6482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:15.288478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5cc7f-e050-435e-a236-cfecba9a6482 admin admin] PATH_INFO: `/v3/projects/01a4471e6a6d40a3929b66245d2f2430/users/6e0cb4ba1cb9407caa3233145ffa4f17/roles/28e65a5027f7406cac824e6ff6474bb2` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:15.302923 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5cc7f-e050-435e-a236-cfecba9a6482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01a4471e6a6d40a3929b66245d2f2430, user_id=6e0cb4ba1cb9407caa3233145ffa4f17, role_id=28e65a5027f7406cac824e6ff6474bb2)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:15.306229 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5cc7f-e050-435e-a236-cfecba9a6482 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:15.318727 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1438/2903] 10.222.0.27 () {60 vars in 1483 bytes} [Sun Aug 7 11:06:15 2022] PUT /identity/v3/projects/01a4471e6a6d40a3929b66245d2f2430/users/6e0cb4ba1cb9407caa3233145ffa4f17/roles/28e65a5027f7406cac824e6ff6474bb2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:06:15.329196 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f81b6-107b-4658-a43a-326190bbfe0d None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:15.329708 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f81b6-107b-4658-a43a-326190bbfe0d None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:15.329826 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f81b6-107b-4658-a43a-326190bbfe0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:15.357337 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-3b1f81b6-107b-4658-a43a-326190bbfe0d None None] MFA Rules not processed for user `6e0cb4ba1cb9407caa3233145ffa4f17`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:06:15.358543 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-3b1f81b6-107b-4658-a43a-326190bbfe0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:06:15.421425 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1466/2904] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:06:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:06:15.432473 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5cc7f-e050-435e-a236-cfecba9a6482 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:15.434170 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-25d5cc7f-e050-435e-a236-cfecba9a6482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:06:15.489434 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5cc7f-e050-435e-a236-cfecba9a6482 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:15.493702 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a588f8-c299-4774-970b-6b2f90aaac53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5fca18c4ee74043a5acc9aeb297c9c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:15.494289 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a588f8-c299-4774-970b-6b2f90aaac53 service cinder] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:15.494568 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a588f8-c299-4774-970b-6b2f90aaac53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:15.494840 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a588f8-c299-4774-970b-6b2f90aaac53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:15.502946 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a588f8-c299-4774-970b-6b2f90aaac53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:15.504576 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a588f8-c299-4774-970b-6b2f90aaac53 service cinder] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:15.513576 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1439/2905] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:06:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:06:21.938949 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f81b6-107b-4658-a43a-326190bbfe0d None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:21.940375 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-3b1f81b6-107b-4658-a43a-326190bbfe0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:06:21.962640 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:06:22.017026 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a588f8-c299-4774-970b-6b2f90aaac53 service cinder] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:22.025069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-96a588f8-c299-4774-970b-6b2f90aaac53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:06:22.034048 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f81b6-107b-4658-a43a-326190bbfe0d None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:22.041043 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f506bf-b727-4f80-b1e2-d48c4cc9f3a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b33f797a9af946a4b296d973388891be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:22.041762 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f506bf-b727-4f80-b1e2-d48c4cc9f3a6 service placement] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:22.042591 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f506bf-b727-4f80-b1e2-d48c4cc9f3a6 service placement] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:22.042704 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:06:22.043134 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f506bf-b727-4f80-b1e2-d48c4cc9f3a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:22.045227 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-10f506bf-b727-4f80-b1e2-d48c4cc9f3a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:06:22.058806 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f506bf-b727-4f80-b1e2-d48c4cc9f3a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:22.060489 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f506bf-b727-4f80-b1e2-d48c4cc9f3a6 service placement] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:22.072158 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1467/2906] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:06:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:06:22.095215 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a588f8-c299-4774-970b-6b2f90aaac53 service cinder] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:22.100081 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde2e26-898d-4453-a1f2-edd83e7988c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:22.100835 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde2e26-898d-4453-a1f2-edd83e7988c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:22.101340 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde2e26-898d-4453-a1f2-edd83e7988c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:22.101617 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde2e26-898d-4453-a1f2-edd83e7988c3 admin admin] PATH_INFO: `/v3/users/16509e38d0eb491f8ccc940123536a73` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:22.102841 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde2e26-898d-4453-a1f2-edd83e7988c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16509e38d0eb491f8ccc940123536a73)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:22.105004 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde2e26-898d-4453-a1f2-edd83e7988c3 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:22.163999 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0cde2e26-898d-4453-a1f2-edd83e7988c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16509e38d0eb491f8ccc940123536a73'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:22.176257 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0cde2e26-898d-4453-a1f2-edd83e7988c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16509e38d0eb491f8ccc940123536a73'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:22.177011 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0cde2e26-898d-4453-a1f2-edd83e7988c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16509e38d0eb491f8ccc940123536a73'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:22.184280 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0cde2e26-898d-4453-a1f2-edd83e7988c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16509e38d0eb491f8ccc940123536a73'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:22.194638 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-0cde2e26-898d-4453-a1f2-edd83e7988c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16509e38d0eb491f8ccc940123536a73'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:22.201376 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1440/2907] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:06:22 2022] DELETE /identity/v3/users/16509e38d0eb491f8ccc940123536a73 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 11:06:22.381924 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f506bf-b727-4f80-b1e2-d48c4cc9f3a6 service placement] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:22.393127 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f506bf-b727-4f80-b1e2-d48c4cc9f3a6 service placement] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:22.455354 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe9331-cbf8-46fe-af76-b143f400cfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:22.455971 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe9331-cbf8-46fe-af76-b143f400cfbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:22.456248 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe9331-cbf8-46fe-af76-b143f400cfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:22.456518 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe9331-cbf8-46fe-af76-b143f400cfbf admin admin] PATH_INFO: `/v3/projects/02e176428ebc413ab96d138f59cf4db6` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:22.457690 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe9331-cbf8-46fe-af76-b143f400cfbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=02e176428ebc413ab96d138f59cf4db6)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:22.459612 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe9331-cbf8-46fe-af76-b143f400cfbf admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:22.504515 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-6ffe9331-cbf8-46fe-af76-b143f400cfbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02e176428ebc413ab96d138f59cf4db6', 'request_id': 'req-6ffe9331-cbf8-46fe-af76-b143f400cfbf'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:22.510586 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-6ffe9331-cbf8-46fe-af76-b143f400cfbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02e176428ebc413ab96d138f59cf4db6', 'request_id': 'req-6ffe9331-cbf8-46fe-af76-b143f400cfbf'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:22.517690 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-6ffe9331-cbf8-46fe-af76-b143f400cfbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02e176428ebc413ab96d138f59cf4db6', 'request_id': 'req-6ffe9331-cbf8-46fe-af76-b143f400cfbf'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:22.528482 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-6ffe9331-cbf8-46fe-af76-b143f400cfbf admin admin] The token cache is being invalidate because project 02e176428ebc413ab96d138f59cf4db6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:06:22.528769 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-6ffe9331-cbf8-46fe-af76-b143f400cfbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:22.529403 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-6ffe9331-cbf8-46fe-af76-b143f400cfbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:22.530875 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1468/2908] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:06:22 2022] DELETE /identity/v3/projects/02e176428ebc413ab96d138f59cf4db6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:06:25.529274 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde2e26-898d-4453-a1f2-edd83e7988c3 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:25.530684 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-0cde2e26-898d-4453-a1f2-edd83e7988c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:06:25.543238 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde2e26-898d-4453-a1f2-edd83e7988c3 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:25.597288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a9a6f-3fd2-479d-8828-925e901efb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:25.597984 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a9a6f-3fd2-479d-8828-925e901efb40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:25.598195 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a9a6f-3fd2-479d-8828-925e901efb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:25.598464 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a9a6f-3fd2-479d-8828-925e901efb40 admin admin] PATH_INFO: `/v3/users/6e0cb4ba1cb9407caa3233145ffa4f17` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:25.599577 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a9a6f-3fd2-479d-8828-925e901efb40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e0cb4ba1cb9407caa3233145ffa4f17)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:25.601486 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a9a6f-3fd2-479d-8828-925e901efb40 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:25.641745 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:06:25.649499 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-2d3a9a6f-3fd2-479d-8828-925e901efb40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e0cb4ba1cb9407caa3233145ffa4f17'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:25.662140 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-2d3a9a6f-3fd2-479d-8828-925e901efb40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e0cb4ba1cb9407caa3233145ffa4f17'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:25.662812 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-2d3a9a6f-3fd2-479d-8828-925e901efb40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e0cb4ba1cb9407caa3233145ffa4f17'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:25.670072 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-2d3a9a6f-3fd2-479d-8828-925e901efb40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e0cb4ba1cb9407caa3233145ffa4f17'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:25.678369 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-2d3a9a6f-3fd2-479d-8828-925e901efb40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e0cb4ba1cb9407caa3233145ffa4f17'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:25.685457 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1441/2909] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:06:25 2022] DELETE /identity/v3/users/6e0cb4ba1cb9407caa3233145ffa4f17 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 11:06:25.689910 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fde52e-c6cc-4bfc-9d24-bf9b06b7927d None None] REQUEST_METHOD: `POST` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:25.690393 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fde52e-c6cc-4bfc-9d24-bf9b06b7927d None None] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:25.690493 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fde52e-c6cc-4bfc-9d24-bf9b06b7927d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:25.711538 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.auth.core [None req-34fde52e-c6cc-4bfc-9d24-bf9b06b7927d None None] MFA Rules not processed for user `fc0da4248e9e4613a07fa1302193fe96`. Rule list: `[]` (Enabled: `True`). {{(pid=80144) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 11:06:25.712725 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-34fde52e-c6cc-4bfc-9d24-bf9b06b7927d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:06:25.745095 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:06:25.774017 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1469/2910] 10.222.0.27 () {58 vars in 958 bytes} [Sun Aug 7 11:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 11:06:25.783884 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a9a6f-3fd2-479d-8828-925e901efb40 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:25.785271 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-2d3a9a6f-3fd2-479d-8828-925e901efb40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:06:25.841772 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a9a6f-3fd2-479d-8828-925e901efb40 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:25.845395 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc417b-85ef-45ed-9ceb-b4c11dc6f81c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:25.845985 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc417b-85ef-45ed-9ceb-b4c11dc6f81c service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:25.846259 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc417b-85ef-45ed-9ceb-b4c11dc6f81c service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:25.846528 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc417b-85ef-45ed-9ceb-b4c11dc6f81c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:25.855875 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc417b-85ef-45ed-9ceb-b4c11dc6f81c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:25.857223 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc417b-85ef-45ed-9ceb-b4c11dc6f81c service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:25.867115 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1442/2911] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:06:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:06:26.139409 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fde52e-c6cc-4bfc-9d24-bf9b06b7927d None None] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:06:26.141235 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-34fde52e-c6cc-4bfc-9d24-bf9b06b7927d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:06:26.156363 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fde52e-c6cc-4bfc-9d24-bf9b06b7927d None None] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:06:26.161716 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c1f48-cd9b-4569-9f74-cda40faf2921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:06:26.162989 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c1f48-cd9b-4569-9f74-cda40faf2921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:06:26.163268 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c1f48-cd9b-4569-9f74-cda40faf2921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:06:26.163561 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c1f48-cd9b-4569-9f74-cda40faf2921 admin admin] PATH_INFO: `/v3/projects/01a4471e6a6d40a3929b66245d2f2430` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:06:26.165059 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c1f48-cd9b-4569-9f74-cda40faf2921 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01a4471e6a6d40a3929b66245d2f2430)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:06:26.167261 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c1f48-cd9b-4569-9f74-cda40faf2921 admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:06:26.213054 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d44c1f48-cd9b-4569-9f74-cda40faf2921 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01a4471e6a6d40a3929b66245d2f2430', 'request_id': 'req-d44c1f48-cd9b-4569-9f74-cda40faf2921'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:26.218593 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d44c1f48-cd9b-4569-9f74-cda40faf2921 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01a4471e6a6d40a3929b66245d2f2430', 'request_id': 'req-d44c1f48-cd9b-4569-9f74-cda40faf2921'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:26.226158 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d44c1f48-cd9b-4569-9f74-cda40faf2921 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01a4471e6a6d40a3929b66245d2f2430', 'request_id': 'req-d44c1f48-cd9b-4569-9f74-cda40faf2921'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:26.237022 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d44c1f48-cd9b-4569-9f74-cda40faf2921 admin admin] The token cache is being invalidate because project 01a4471e6a6d40a3929b66245d2f2430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80144) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:06:26.237332 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d44c1f48-cd9b-4569-9f74-cda40faf2921 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:26.237967 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-d44c1f48-cd9b-4569-9f74-cda40faf2921 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:06:26.239429 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1470/2912] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:06:26 2022] DELETE /identity/v3/projects/01a4471e6a6d40a3929b66245d2f2430 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:06:35.862396 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:DELETE=5,keystone:SELECT=40,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:06:36.234171 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=37,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:07:09.843634 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc417b-85ef-45ed-9ceb-b4c11dc6f81c service neutron] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:07:09.845037 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-7bfc417b-85ef-45ed-9ceb-b4c11dc6f81c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:07:09.916875 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc417b-85ef-45ed-9ceb-b4c11dc6f81c service neutron] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:07:09.978478 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2bf7a-15db-4ae7-9ecd-d06d80f5b81a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b33f797a9af946a4b296d973388891be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:07:09.979069 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2bf7a-15db-4ae7-9ecd-d06d80f5b81a service placement] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:07:09.979339 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2bf7a-15db-4ae7-9ecd-d06d80f5b81a service placement] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:07:09.979602 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2bf7a-15db-4ae7-9ecd-d06d80f5b81a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:07:09.981298 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-41b2bf7a-15db-4ae7-9ecd-d06d80f5b81a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:07:09.992379 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2bf7a-15db-4ae7-9ecd-d06d80f5b81a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:07:09.993969 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2bf7a-15db-4ae7-9ecd-d06d80f5b81a service placement] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:07:10.003738 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1443/2913] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:07:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:07:12.192012 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c1f48-cd9b-4569-9f74-cda40faf2921 admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:07:12.193488 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-d44c1f48-cd9b-4569-9f74-cda40faf2921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:07:12.268206 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c1f48-cd9b-4569-9f74-cda40faf2921 admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:07:12.273674 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af615fd-0169-429f-a6c1-5c1ac437eaf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f98cb7abbb8942cebb71aa98da80a05a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:07:12.274371 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af615fd-0169-429f-a6c1-5c1ac437eaf8 service nova] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:07:12.274647 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af615fd-0169-429f-a6c1-5c1ac437eaf8 service nova] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:07:12.274915 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af615fd-0169-429f-a6c1-5c1ac437eaf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:07:12.276660 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-5af615fd-0169-429f-a6c1-5c1ac437eaf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:07:12.288473 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af615fd-0169-429f-a6c1-5c1ac437eaf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:07:12.290631 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af615fd-0169-429f-a6c1-5c1ac437eaf8 service nova] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:07:12.300930 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1471/2914] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:07:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:07:19.999372 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=58 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:07:22.296542 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=34 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:08:25.457813 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2bf7a-15db-4ae7-9ecd-d06d80f5b81a service placement] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:08:25.459193 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-41b2bf7a-15db-4ae7-9ecd-d06d80f5b81a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:08:25.472263 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2bf7a-15db-4ae7-9ecd-d06d80f5b81a service placement] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:08:25.477229 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d5ce3-22f4-456f-be53-4c65b707bb14 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b33f797a9af946a4b296d973388891be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:08:25.477839 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d5ce3-22f4-456f-be53-4c65b707bb14 service placement] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:08:25.478112 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d5ce3-22f4-456f-be53-4c65b707bb14 service placement] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:08:25.478375 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d5ce3-22f4-456f-be53-4c65b707bb14 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:08:25.479988 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-1c2d5ce3-22f4-456f-be53-4c65b707bb14 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:08:25.491616 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d5ce3-22f4-456f-be53-4c65b707bb14 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:08:25.493194 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d5ce3-22f4-456f-be53-4c65b707bb14 service placement] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:08:25.502862 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1444/2915] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:08:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:08:35.498735 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=6 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:08:50.591222 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af615fd-0169-429f-a6c1-5c1ac437eaf8 service nova] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:08:50.592647 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-5af615fd-0169-429f-a6c1-5c1ac437eaf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:08:50.648548 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af615fd-0169-429f-a6c1-5c1ac437eaf8 service nova] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:08:50.652114 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7323c0-de7e-4368-aa1a-3ec1d2900eac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:08:50.652700 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7323c0-de7e-4368-aa1a-3ec1d2900eac service neutron] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:08:50.652974 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7323c0-de7e-4368-aa1a-3ec1d2900eac service neutron] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:08:50.653239 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7323c0-de7e-4368-aa1a-3ec1d2900eac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:08:50.654939 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-4a7323c0-de7e-4368-aa1a-3ec1d2900eac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:08:50.711987 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7323c0-de7e-4368-aa1a-3ec1d2900eac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:08:50.713431 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7323c0-de7e-4368-aa1a-3ec1d2900eac service neutron] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:08:50.722227 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1472/2916] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:08:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:08:55.396963 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d5ce3-22f4-456f-be53-4c65b707bb14 service placement] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:08:55.406859 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d5ce3-22f4-456f-be53-4c65b707bb14 service placement] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:08:55.410436 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbc561-5eca-410f-bcbb-aa4cf7ec51ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b03428b48264b9da9800283496de2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:08:55.411012 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbc561-5eca-410f-bcbb-aa4cf7ec51ba service neutron] REQUEST_METHOD: `GET` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:08:55.411288 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbc561-5eca-410f-bcbb-aa4cf7ec51ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:08:55.411556 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbc561-5eca-410f-bcbb-aa4cf7ec51ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:08:55.413270 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-31dbc561-5eca-410f-bcbb-aa4cf7ec51ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:08:55.474041 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dbc561-5eca-410f-bcbb-aa4cf7ec51ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:08:55.475462 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dbc561-5eca-410f-bcbb-aa4cf7ec51ba service neutron] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:08:55.484979 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1445/2917] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:08:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:09:00.718190 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=48 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:09:01.382062 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7323c0-de7e-4368-aa1a-3ec1d2900eac service neutron] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:09:01.383916 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-4a7323c0-de7e-4368-aa1a-3ec1d2900eac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:09:01.399874 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7323c0-de7e-4368-aa1a-3ec1d2900eac service neutron] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:09:01.404915 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b55e3-cfde-46dc-911a-576b9a294b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:09:01.405662 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b55e3-cfde-46dc-911a-576b9a294b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:09:01.405938 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b55e3-cfde-46dc-911a-576b9a294b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:09:01.406207 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b55e3-cfde-46dc-911a-576b9a294b9c admin admin] PATH_INFO: `/v3/users/c498a538726748059f0a71d257129aa4` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:09:01.407347 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b55e3-cfde-46dc-911a-576b9a294b9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c498a538726748059f0a71d257129aa4)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:09:01.409914 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b55e3-cfde-46dc-911a-576b9a294b9c admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:09:01.464610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-110b55e3-cfde-46dc-911a-576b9a294b9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c498a538726748059f0a71d257129aa4'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:09:01.477250 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-110b55e3-cfde-46dc-911a-576b9a294b9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c498a538726748059f0a71d257129aa4'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:09:01.477941 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-110b55e3-cfde-46dc-911a-576b9a294b9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c498a538726748059f0a71d257129aa4'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:09:01.484721 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-110b55e3-cfde-46dc-911a-576b9a294b9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c498a538726748059f0a71d257129aa4'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:09:01.493610 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-110b55e3-cfde-46dc-911a-576b9a294b9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c498a538726748059f0a71d257129aa4'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:09:01.499964 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1473/2918] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:09:01 2022] DELETE /identity/v3/users/c498a538726748059f0a71d257129aa4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:09:01.672406 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbc561-5eca-410f-bcbb-aa4cf7ec51ba service neutron] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:09:01.683116 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbc561-5eca-410f-bcbb-aa4cf7ec51ba service neutron] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:09:01.739651 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755f98a-57c4-4e09-af20-f3df9889a6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:09:01.740258 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755f98a-57c4-4e09-af20-f3df9889a6c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:09:01.740532 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755f98a-57c4-4e09-af20-f3df9889a6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:09:01.740798 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755f98a-57c4-4e09-af20-f3df9889a6c7 admin admin] PATH_INFO: `/v3/projects/81f327d645ea4445a5137f7a021804ac` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:09:01.741919 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755f98a-57c4-4e09-af20-f3df9889a6c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81f327d645ea4445a5137f7a021804ac)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:09:01.743785 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755f98a-57c4-4e09-af20-f3df9889a6c7 admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:09:01.788110 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-d755f98a-57c4-4e09-af20-f3df9889a6c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81f327d645ea4445a5137f7a021804ac', 'request_id': 'req-d755f98a-57c4-4e09-af20-f3df9889a6c7'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:09:01.793424 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-d755f98a-57c4-4e09-af20-f3df9889a6c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81f327d645ea4445a5137f7a021804ac', 'request_id': 'req-d755f98a-57c4-4e09-af20-f3df9889a6c7'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:09:01.799260 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-d755f98a-57c4-4e09-af20-f3df9889a6c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81f327d645ea4445a5137f7a021804ac', 'request_id': 'req-d755f98a-57c4-4e09-af20-f3df9889a6c7'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:09:01.811580 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-d755f98a-57c4-4e09-af20-f3df9889a6c7 admin admin] The token cache is being invalidate because project 81f327d645ea4445a5137f7a021804ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:09:01.811870 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-d755f98a-57c4-4e09-af20-f3df9889a6c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:09:01.812482 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-d755f98a-57c4-4e09-af20-f3df9889a6c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:09:01.813970 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1446/2919] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:09:01 2022] DELETE /identity/v3/projects/81f327d645ea4445a5137f7a021804ac => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:09:01.818010 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b55e3-cfde-46dc-911a-576b9a294b9c admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:09:01.819400 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-110b55e3-cfde-46dc-911a-576b9a294b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:09:01.832803 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b55e3-cfde-46dc-911a-576b9a294b9c admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:09:01.888481 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e51c2b-ba48-46fa-b529-541689d2a63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:09:01.889283 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e51c2b-ba48-46fa-b529-541689d2a63d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:09:01.890078 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e51c2b-ba48-46fa-b529-541689d2a63d admin admin] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:09:01.890582 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e51c2b-ba48-46fa-b529-541689d2a63d admin admin] PATH_INFO: `/v3/users/c8e82545df4347b0bc8fd8f17e353d8f` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:09:01.892112 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e51c2b-ba48-46fa-b529-541689d2a63d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8e82545df4347b0bc8fd8f17e353d8f)` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:09:01.894868 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e51c2b-ba48-46fa-b529-541689d2a63d admin admin] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:09:01.939764 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-64e51c2b-ba48-46fa-b529-541689d2a63d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8e82545df4347b0bc8fd8f17e353d8f'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:09:01.951343 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-64e51c2b-ba48-46fa-b529-541689d2a63d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8e82545df4347b0bc8fd8f17e353d8f'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:09:01.951999 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-64e51c2b-ba48-46fa-b529-541689d2a63d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8e82545df4347b0bc8fd8f17e353d8f'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:09:01.959186 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-64e51c2b-ba48-46fa-b529-541689d2a63d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8e82545df4347b0bc8fd8f17e353d8f'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:09:01.960796 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:09:01.966494 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.notifications [None req-64e51c2b-ba48-46fa-b529-541689d2a63d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8e82545df4347b0bc8fd8f17e353d8f'} {{(pid=80144) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:09:01.973864 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1474/2920] 10.222.0.27 () {58 vars in 1224 bytes} [Sun Aug 7 11:09:01 2022] DELETE /identity/v3/users/c8e82545df4347b0bc8fd8f17e353d8f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:09:02.141452 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755f98a-57c4-4e09-af20-f3df9889a6c7 admin admin] Authenticating user token {{(pid=80145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:09:02.143588 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.fernet_utils [None req-d755f98a-57c4-4e09-af20-f3df9889a6c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:09:02.158126 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755f98a-57c4-4e09-af20-f3df9889a6c7 admin admin] Validating token access rules against request {{(pid=80145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:09:02.183029 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:09:02.224653 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb821f97-218f-4f71-9574-1c159c4e0b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0da4248e9e4613a07fa1302193fe96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a981d307e79a4251be167c0015c9f536', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:09:02.225275 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb821f97-218f-4f71-9574-1c159c4e0b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:09:02.225583 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb821f97-218f-4f71-9574-1c159c4e0b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:09:02.225852 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb821f97-218f-4f71-9574-1c159c4e0b0a admin admin] PATH_INFO: `/v3/projects/f8d45f6b8188470ca3ee12d9e27bf0f3` {{(pid=80145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:09:02.226992 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb821f97-218f-4f71-9574-1c159c4e0b0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8d45f6b8188470ca3ee12d9e27bf0f3)` {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:09:02.228865 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb821f97-218f-4f71-9574-1c159c4e0b0a admin admin] RBAC: Authorization granted {{(pid=80145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:09:02.276649 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-fb821f97-218f-4f71-9574-1c159c4e0b0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8d45f6b8188470ca3ee12d9e27bf0f3', 'request_id': 'req-fb821f97-218f-4f71-9574-1c159c4e0b0a'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:09:02.282120 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-fb821f97-218f-4f71-9574-1c159c4e0b0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8d45f6b8188470ca3ee12d9e27bf0f3', 'request_id': 'req-fb821f97-218f-4f71-9574-1c159c4e0b0a'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:09:02.288553 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-fb821f97-218f-4f71-9574-1c159c4e0b0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8d45f6b8188470ca3ee12d9e27bf0f3', 'request_id': 'req-fb821f97-218f-4f71-9574-1c159c4e0b0a'} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:09:02.300413 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-fb821f97-218f-4f71-9574-1c159c4e0b0a admin admin] The token cache is being invalidate because project f8d45f6b8188470ca3ee12d9e27bf0f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 11:09:02.300702 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-fb821f97-218f-4f71-9574-1c159c4e0b0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:09:02.301334 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG keystone.notifications [None req-fb821f97-218f-4f71-9574-1c159c4e0b0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 11:09:02.302822 dv-cinder-850320-3-smb devstack@keystone.service[80145]: [pid: 80145|app: 0|req: 1447/2921] 10.222.0.27 () {58 vars in 1233 bytes} [Sun Aug 7 11:09:02 2022] DELETE /identity/v3/projects/f8d45f6b8188470ca3ee12d9e27bf0f3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 11:09:11.972155 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:09:12.297487 dv-cinder-850320-3-smb devstack@keystone.service[80145]: DEBUG dbcounter [-] [80145] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 11:13:27.430928 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e51c2b-ba48-46fa-b529-541689d2a63d admin admin] Authenticating user token {{(pid=80144) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 11:13:27.432962 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-64e51c2b-ba48-46fa-b529-541689d2a63d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:13:27.572815 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e51c2b-ba48-46fa-b529-541689d2a63d admin admin] Validating token access rules against request {{(pid=80144) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 11:13:27.630678 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a39bd-1b07-484e-86be-693807e44df4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b33f797a9af946a4b296d973388891be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62eed8550ae3403f8a75894dbd19cf4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80144) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 11:13:27.631272 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a39bd-1b07-484e-86be-693807e44df4 service placement] REQUEST_METHOD: `GET` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 11:13:27.631544 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a39bd-1b07-484e-86be-693807e44df4 service placement] SCRIPT_NAME: `/identity` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 11:13:27.631808 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a39bd-1b07-484e-86be-693807e44df4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80144) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 11:13:27.633567 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.fernet_utils [None req-146a39bd-1b07-484e-86be-693807e44df4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80144) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 11:13:27.645115 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a39bd-1b07-484e-86be-693807e44df4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 11:13:27.646708 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a39bd-1b07-484e-86be-693807e44df4 service placement] RBAC: Authorization granted {{(pid=80144) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 11:13:27.656910 dv-cinder-850320-3-smb devstack@keystone.service[80144]: [pid: 80144|app: 0|req: 1475/2922] 10.222.0.27 () {60 vars in 1365 bytes} [Sun Aug 7 11:13:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 11:13:37.652648 dv-cinder-850320-3-smb devstack@keystone.service[80144]: DEBUG dbcounter [-] [80144] Writing DB stats keystone:SELECT=89 {{(pid=80144) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}